Jul 01 22:21:40.855187 ip-10-0-128-178 systemd[1]: Starting Kubernetes Kubelet... Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.254793 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263482 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263500 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263504 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263507 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263514 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263517 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263519 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.287742 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263522 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263525 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263527 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263530 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263533 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263537 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263543 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263546 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263548 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263551 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263556 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263559 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263562 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263565 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263568 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263571 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263574 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263577 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263579 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263582 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.288569 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263585 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263587 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263592 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263595 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263598 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263600 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263604 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263608 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263611 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263615 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263620 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263625 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263628 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263630 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263636 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263639 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263641 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263644 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263647 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263650 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.289174 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263652 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263655 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263657 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263660 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263663 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263665 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263670 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263673 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263676 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263679 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263681 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263684 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263687 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263690 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263695 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263699 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263704 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263710 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263713 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.290009 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263717 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263720 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263722 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263725 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263728 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263732 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263735 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263738 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263741 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263743 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263746 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263751 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263754 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263757 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263760 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263762 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263765 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263767 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263770 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263772 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.290821 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263775 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263777 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263780 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263783 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263788 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263790 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263793 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263796 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263799 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263802 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263805 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263807 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.263809 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265042 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265057 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265061 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265065 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265071 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265073 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.291492 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265077 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265080 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265083 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265086 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265089 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265092 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265095 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265097 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265100 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265103 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265105 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265108 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265111 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265113 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265116 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265118 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265121 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265126 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265129 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.292224 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265133 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265136 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265139 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265142 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265145 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265148 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265151 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265154 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265157 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265160 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265166 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265168 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265171 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265174 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265176 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265179 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265182 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265185 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265187 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.292894 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265190 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265192 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265195 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265198 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265200 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265203 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265205 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265207 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265210 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265212 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265217 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265220 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265222 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265226 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265230 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265232 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265235 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265237 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265240 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265242 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.293478 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265247 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265250 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265253 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265256 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265258 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265261 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265263 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265266 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265269 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265271 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265274 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265277 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265279 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265281 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265286 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265289 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265292 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265294 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265299 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265301 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.294018 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265304 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265306 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265310 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265313 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265316 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265318 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265322 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265325 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265328 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265330 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265333 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265336 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265338 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265341 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265718 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265723 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265726 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265728 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265731 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.294627 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265733 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265736 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265739 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265741 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265744 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265746 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265749 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265753 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265756 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265761 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265764 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265767 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265769 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265772 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265776 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265779 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265781 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265784 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265786 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.295179 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265789 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265791 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265794 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265796 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265799 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265801 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265803 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265806 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265808 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265811 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265813 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265816 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265818 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265821 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265823 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265826 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265837 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265841 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265844 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265848 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.295773 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265851 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265869 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265872 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265876 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265880 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265883 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265886 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265890 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265893 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265895 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265898 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265901 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265903 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265906 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265908 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265911 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265914 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265916 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265919 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.296406 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265921 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265924 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265926 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265930 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265933 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265938 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265940 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265943 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265945 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265948 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265950 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265953 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265957 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265959 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265962 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265965 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265967 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265970 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265972 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265975 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.297073 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265979 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265982 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265985 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265987 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265990 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265992 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265995 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.265997 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266000 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266002 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266005 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266008 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266010 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266013 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266015 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266093 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266105 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266111 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266116 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266120 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266123 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 22:21:41.297581 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266127 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266131 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266135 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266139 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266142 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266145 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266148 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266151 2577 flags.go:64] FLAG: --cgroup-root="" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266154 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266157 2577 flags.go:64] FLAG: --client-ca-file="" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266161 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266165 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266171 2577 flags.go:64] FLAG: --cluster-domain="" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266174 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266177 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266180 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266183 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266188 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266190 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266193 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266196 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266199 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266202 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266205 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 22:21:41.298311 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266208 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266211 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266215 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266218 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266221 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266224 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266227 2577 flags.go:64] FLAG: --enable-server="true" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266230 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266233 2577 flags.go:64] FLAG: --event-burst="100" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266237 2577 flags.go:64] FLAG: --event-qps="50" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266239 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266247 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266250 2577 flags.go:64] FLAG: --eviction-hard="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266254 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266257 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266260 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266262 2577 flags.go:64] FLAG: --eviction-soft="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266265 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266268 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266276 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266279 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266281 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266284 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266287 2577 flags.go:64] FLAG: --feature-gates="" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266291 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 22:21:41.299167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266294 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266297 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266300 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266303 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266306 2577 flags.go:64] FLAG: --help="false" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266309 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266312 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266315 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266318 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266321 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266324 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266327 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266330 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266333 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266335 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266338 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266341 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266344 2577 flags.go:64] FLAG: --kube-reserved="" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266348 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266351 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266354 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266357 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266360 2577 flags.go:64] FLAG: --lock-file="" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266363 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 22:21:41.300055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266365 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266369 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266375 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266378 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266381 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266384 2577 flags.go:64] FLAG: --logging-format="text" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266387 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266390 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266393 2577 flags.go:64] FLAG: --manifest-url="" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266396 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266400 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266403 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266407 2577 flags.go:64] FLAG: --max-pods="110" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266410 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266413 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266416 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266419 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266422 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266425 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266427 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266434 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266437 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266440 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 22:21:41.304258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266443 2577 flags.go:64] FLAG: --pod-cidr="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266446 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266451 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266455 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266458 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266461 2577 flags.go:64] FLAG: --port="10250" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266464 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266467 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-048d3974c86b5288a" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266470 2577 flags.go:64] FLAG: --qos-reserved="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266473 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266476 2577 flags.go:64] FLAG: --register-node="true" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266479 2577 flags.go:64] FLAG: --register-with-taints="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266483 2577 flags.go:64] FLAG: --registry-burst="10" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266487 2577 flags.go:64] FLAG: --registry-qps="5" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266489 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266493 2577 flags.go:64] FLAG: --reserved-memory="" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266496 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266499 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266502 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266505 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266507 2577 flags.go:64] FLAG: --runonce="false" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266510 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266513 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266516 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266518 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 22:21:41.305101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266521 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266524 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266527 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266530 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266533 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266535 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266538 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266541 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266544 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266547 2577 flags.go:64] FLAG: --system-cgroups="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266550 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266555 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266558 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266561 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266565 2577 flags.go:64] FLAG: --tls-min-version="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266568 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266571 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266573 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266576 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266580 2577 flags.go:64] FLAG: --v="2" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266584 2577 flags.go:64] FLAG: --version="false" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266589 2577 flags.go:64] FLAG: --vmodule="" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266592 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.266596 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266704 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.403315 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266707 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.324764 ip-10-0-128-178 systemd[1]: Started Kubernetes Kubelet. Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266710 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266714 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266716 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266719 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266722 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266725 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266727 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266729 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266732 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266735 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266738 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266740 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266743 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266745 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266748 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266750 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266754 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266757 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266759 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.420520 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266762 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266764 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266767 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266769 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266772 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266775 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266779 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266781 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266784 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266788 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266791 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266795 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266797 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266800 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266803 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266806 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266808 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266812 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266815 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.421370 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266818 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266821 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266823 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266826 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266829 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266831 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266834 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266836 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266839 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266841 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266845 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266848 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266850 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266867 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266870 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266873 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266875 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266878 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266880 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266885 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.422058 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266888 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266890 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266892 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266895 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266898 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266901 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266903 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266906 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266908 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266911 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266913 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266916 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266919 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266921 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266924 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266927 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266929 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266932 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266934 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266937 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.422673 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266940 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266942 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266947 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266951 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266954 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266957 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266960 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266962 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266965 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266967 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266970 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266973 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266976 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266979 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266981 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266984 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266987 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266989 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.423405 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.266992 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.267001 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.273705 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.273722 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.273741 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.273746 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273808 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273813 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273816 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273820 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273823 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273826 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273829 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273831 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273834 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.423976 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273837 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273839 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273842 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273844 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273847 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273850 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273875 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273879 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273883 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273886 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273888 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273891 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273894 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273897 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273899 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273902 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273905 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273907 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273911 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273913 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.424491 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273917 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273920 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273922 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273925 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273928 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273930 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273933 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273935 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273938 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273941 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273945 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273949 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273952 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273955 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273959 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273962 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273965 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273969 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273972 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.425100 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273975 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273977 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273980 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273983 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273988 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273991 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273994 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273996 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.273999 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274002 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274005 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274008 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274010 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274013 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274016 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274019 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274028 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274031 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274034 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274036 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.425714 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274039 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274041 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274044 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274047 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274049 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274052 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274055 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274057 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274060 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274062 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274065 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274068 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274070 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274073 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274075 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274078 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274083 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274087 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274091 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274094 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.426369 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274096 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274099 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274101 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274104 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274106 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274109 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274112 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274115 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274117 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274120 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274122 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.274127 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274241 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274245 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:21:41.427197 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274248 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274251 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274254 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274257 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274262 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274264 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274267 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274269 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274272 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274274 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274277 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274279 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274282 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274285 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274287 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274291 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274294 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274296 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274299 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274302 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:21:41.427804 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274304 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274307 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274309 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274312 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274314 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274317 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274320 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274322 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274325 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274328 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274330 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274332 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274335 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274337 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274340 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274343 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274347 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274350 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274352 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274355 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274357 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:21:41.428383 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274360 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274362 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274365 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274367 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274370 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274372 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274376 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274378 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274381 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274384 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274386 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274389 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274391 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274394 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274396 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274399 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274401 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274404 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274407 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274410 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:21:41.428983 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274412 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274415 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274418 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274420 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274422 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274425 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274427 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274431 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274434 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274438 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274441 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274444 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274447 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274450 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274453 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274456 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274459 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274462 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274467 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:21:41.429801 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274471 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274475 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274478 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274480 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274483 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274486 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274489 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274491 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274493 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274497 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274500 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274503 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274507 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274510 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274512 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274515 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:21:41.430393 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:41.274518 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.274523 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.274630 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.276675 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.278049 2577 server.go:1019] "Starting client certificate rotation" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.279322 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.279359 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.280748 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.281876 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.293580 2577 log.go:25] "Validated CRI v1 runtime API" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.295959 2577 log.go:25] "Validated CRI v1 image API" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.296752 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 22:21:41.430899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.299064 2577 fs.go:135] Filesystem UUIDs: map[60884da0-d047-4d77-a414-5c51d408c2e0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9f6dab78-7717-48b3-876b-bc5332b01c93:/dev/nvme0n1p3] Jul 01 22:21:41.431271 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.299082 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.305875 2577 manager.go:216] Machine: {Timestamp:2026-07-01 22:21:41.303737608 +0000 UTC m=+0.324288824 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100159 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce49492e9fd5ee5b014e7e5d3eb30 SystemUUID:ec2ce494-92e9-fd5e-e5b0-14e7e5d3eb30 BootID:02edaf22-af38-4810-9d5d-56031df7405c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:5a:ac:b6:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:5a:ac:b6:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:5b:76:cb:f6:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.306029 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.306161 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.309199 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.309223 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.309867 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.309877 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 22:21:41.431383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.309884 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.310448 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.311129 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.313829 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.313945 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.314633 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.314656 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.314673 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.314685 2577 kubelet.go:398] "Adding apiserver pod source" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.314698 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.315092 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.315110 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.316973 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.317641 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.318889 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.318918 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319589 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319602 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319607 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319613 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319622 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319627 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319784 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319790 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319797 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319803 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319816 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.319824 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.320598 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.320608 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.323924 2577 server.go:1268] "Started kubelet" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.324018 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.324067 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.324162 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.325091 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.329182 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.329284 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.329487 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.330161 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 22:21:41.431983 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.334093 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.334597 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.334814 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.336472 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.336483 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.336527 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.336532 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.342644 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.333076 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18be4a93d7a58bb8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-01 22:21:41.323893688 +0000 UTC m=+0.344444903,LastTimestamp:2026-07-01 22:21:41.323893688 +0000 UTC m=+0.344444903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.349717 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qz6ff" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.349771 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qz6ff" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.350736 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.350963 2577 factory.go:153] Registering CRI-O factory Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.350976 2577 factory.go:223] Registration of the crio container factory successfully Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351023 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351033 2577 factory.go:55] Registering systemd factory Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351041 2577 factory.go:223] Registration of the systemd container factory successfully Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351058 2577 factory.go:103] Registering Raw factory Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351069 2577 manager.go:1196] Started watching for new ooms in manager Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.351380 2577 manager.go:349] Starting recovery of all containers Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.351594 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.351619 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.360758 2577 manager.go:354] Recovery completed Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.366225 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368214 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368244 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368258 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368816 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368829 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368849 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.368832 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369541 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.607235 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369562 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369572 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369847 2577 policy_none.go:49] "None policy: Start" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369894 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.369906 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.370900 2577 policy_none.go:47] "Start" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.405622 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.406823 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.406882 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.406906 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.406936 2577 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.408762 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.418485 2577 manager.go:337] "Starting Device Plugin manager" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.418521 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.418531 2577 server.go:87] "Starting device plugin registration server" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.418816 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.418826 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.418928 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.419194 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.419201 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.419504 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.419552 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.507040 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"] Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.507125 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.508035 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.508067 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.508079 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509313 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509466 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509956 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509956 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509998 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.510009 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.509980 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.510046 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.511067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.511089 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.610622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.511647 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.511669 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.511681 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.520322 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.522360 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.522383 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.522392 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.522408 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.528399 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.529301 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.529321 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-178.ec2.internal\": node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.531533 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.537194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.537214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.537233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/630d830233945d606370114bbcf2182a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"630d830233945d606370114bbcf2182a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.611678 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.546939 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/630d830233945d606370114bbcf2182a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"630d830233945d606370114bbcf2182a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/630d830233945d606370114bbcf2182a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"630d830233945d606370114bbcf2182a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.638807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26db5ccefc68603216d3d6d5b542614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"26db5ccefc68603216d3d6d5b542614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.647756 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.756594 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.748215 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:41.891425 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.831612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.891425 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:41.834396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:41.891425 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.848424 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:42.055371 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:41.948900 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:42.055371 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.049313 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:42.219243 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.149761 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jul 01 22:21:42.219243 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.165433 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.243311 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.253911 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.255443 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.262825 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.277923 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.278030 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.278070 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.315164 2577 apiserver.go:52] "Watching apiserver" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.329047 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.329998 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-kfhsc","openshift-image-registry/node-ca-kqdjp","openshift-multus/multus-additional-cni-plugins-lvvrm","openshift-network-diagnostics/network-check-target-vhhn5","openshift-ovn-kubernetes/ovnkube-node-cfphh","kube-system/konnectivity-agent-sd7xc","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","openshift-multus/multus-qpd9p","openshift-multus/network-metrics-daemon-6lntk","openshift-network-operator/iptables-alerter-tvnlf","kube-system/global-pull-secret-syncer-ksgr7","openshift-cluster-node-tuning-operator/tuned-xj6k7"] Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.334899 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.337394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.339232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baaf8382-fb94-42cf-8342-7533e64353ce-hosts-file\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaf8382-fb94-42cf-8342-7533e64353ce-tmp-dir\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzw68\" (UniqueName: \"kubernetes.io/projected/baaf8382-fb94-42cf-8342-7533e64353ce-kube-api-access-vzw68\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341780 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341870 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p8mdv\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.341933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.342005 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jl9qj\"" Jul 01 22:21:42.352279 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.342027 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.343823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.345693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.345750 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347254 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-76dxq\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347279 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347362 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.347457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.348075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.349155 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.350172 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8k29c\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351523 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351641 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351726 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351756 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.351922 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.353184 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 22:16:40 +0000 UTC" deadline="2027-11-30 20:47:38.913419393 +0000 UTC" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.353221 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12406h25m56.560201595s" Jul 01 22:21:42.354477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.354149 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 22:21:42.355465 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.355246 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bqqd9\"" Jul 01 22:21:42.355465 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.355274 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.358013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.360138 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.360206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.360216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mk7ds\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.360207 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.360527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.362443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.362679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-77jt9\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.362912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.362959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.365557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.366939 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zppxx" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.367599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.367654 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.367926 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.367934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.367938 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kkgdg\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.368316 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.370709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.372843 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.372864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4kq7k\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.372883 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.374410 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zppxx" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.435820 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-netns\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.470314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-device-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-kubelet\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-conf\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8zm\" (UniqueName: \"kubernetes.io/projected/7e9b48c6-fa84-4094-b01a-240210d5f091-kube-api-access-cs8zm\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-config\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cni-binary-copy\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-multus\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-kubelet-config\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-host\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-cnibin\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a11874-d207-48d9-beb2-7389fe32d839-agent-certs\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-hostroot\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.471687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-etc-kubernetes\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovn-node-metrics-cert\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-netns\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-kubelet\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-modprobe-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-tuned\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baaf8382-fb94-42cf-8342-7533e64353ce-hosts-file\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aad090eb-c3cd-41d8-8baa-d51bee14d2be-host-slash\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-script-lib\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-bin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-lib-modules\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.472803 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-systemd-units\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-etc-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-log-socket\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-k8s-cni-cncf-io\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7rl\" (UniqueName: \"kubernetes.io/projected/dbb342d6-29e2-45da-82c1-bbfd57078bf2-kube-api-access-kt7rl\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85gz\" (UniqueName: \"kubernetes.io/projected/4620035a-50f0-4265-a2d0-1550c20e6898-kube-api-access-f85gz\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysconfig\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-conf-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.444993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-sys-fs\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-slash\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-ovn\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a11874-d207-48d9-beb2-7389fe32d839-konnectivity-ca\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.473388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-daemon-config\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-etc-selinux\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769ll\" (UniqueName: \"kubernetes.io/projected/aad090eb-c3cd-41d8-8baa-d51bee14d2be-kube-api-access-769ll\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-kubernetes\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-tmp\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8frg\" (UniqueName: \"kubernetes.io/projected/595194e4-526d-4fa6-9906-50a5c49a01d3-kube-api-access-t8frg\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-var-lib-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-node-log\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-bin\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaf8382-fb94-42cf-8342-7533e64353ce-tmp-dir\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzw68\" (UniqueName: \"kubernetes.io/projected/baaf8382-fb94-42cf-8342-7533e64353ce-kube-api-access-vzw68\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aad090eb-c3cd-41d8-8baa-d51bee14d2be-iptables-alerter-script\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-systemd\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.473979 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-system-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-os-release\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-netd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-env-overrides\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cb6\" (UniqueName: \"kubernetes.io/projected/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-kube-api-access-k5cb6\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-socket-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gntwf\" (UniqueName: \"kubernetes.io/projected/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-kube-api-access-gntwf\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-system-cni-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-systemd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhzvk\" (UniqueName: \"kubernetes.io/projected/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-kube-api-access-rhzvk\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-socket-dir-parent\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474464 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-var-lib-kubelet\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-os-release\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cnibin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-multus-certs\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-dbus\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-host\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-serviceca\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-registration-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-run\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-sys\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.445842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baaf8382-fb94-42cf-8342-7533e64353ce-hosts-file\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.474952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.446168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaf8382-fb94-42cf-8342-7533e64353ce-tmp-dir\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.475431 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.452455 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 22:21:42.475431 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.457148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzw68\" (UniqueName: \"kubernetes.io/projected/baaf8382-fb94-42cf-8342-7533e64353ce-kube-api-access-vzw68\") pod \"node-resolver-kfhsc\" (UID: \"baaf8382-fb94-42cf-8342-7533e64353ce\") " pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.514372 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.531202 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630d830233945d606370114bbcf2182a.slice/crio-963371b9f14d6c5f59d56cd57e254c05e2eec133b83c2cccf92147892b389499 WatchSource:0}: Error finding container 963371b9f14d6c5f59d56cd57e254c05e2eec133b83c2cccf92147892b389499: Status 404 returned error can't find the container with id 963371b9f14d6c5f59d56cd57e254c05e2eec133b83c2cccf92147892b389499 Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.531607 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26db5ccefc68603216d3d6d5b542614e.slice/crio-91370c2d4171c3edd73d845cb2f14ebcf411e921bb7420d3ad29a503506dd508 WatchSource:0}: Error finding container 91370c2d4171c3edd73d845cb2f14ebcf411e921bb7420d3ad29a503506dd508: Status 404 returned error can't find the container with id 91370c2d4171c3edd73d845cb2f14ebcf411e921bb7420d3ad29a503506dd508 Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.535200 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-tmp\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8frg\" (UniqueName: \"kubernetes.io/projected/595194e4-526d-4fa6-9906-50a5c49a01d3-kube-api-access-t8frg\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-var-lib-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-node-log\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-bin\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aad090eb-c3cd-41d8-8baa-d51bee14d2be-iptables-alerter-script\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-systemd\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546397 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-bin\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-systemd\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.561994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-var-lib-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-system-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-node-log\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-system-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-os-release\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-netd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-env-overrides\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cb6\" (UniqueName: \"kubernetes.io/projected/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-kube-api-access-k5cb6\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-socket-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.546647 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gntwf\" (UniqueName: \"kubernetes.io/projected/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-kube-api-access-gntwf\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-cni-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-os-release\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.562522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-system-cni-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.546707 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:43.046689644 +0000 UTC m=+2.067240866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-system-cni-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-cni-netd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-systemd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhzvk\" (UniqueName: \"kubernetes.io/projected/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-kube-api-access-rhzvk\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-socket-dir-parent\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-socket-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-systemd\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-var-lib-kubelet\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-socket-dir-parent\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563135 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-os-release\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aad090eb-c3cd-41d8-8baa-d51bee14d2be-iptables-alerter-script\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-os-release\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cnibin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.546984 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.546989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-var-lib-kubelet\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-multus-certs\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.547031 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:21:43.047016067 +0000 UTC m=+2.067567268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-multus-certs\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-dbus\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-host\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563539 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cnibin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-serviceca\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-dbus\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-env-overrides\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-registration-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-host\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-run\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-sys\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-registration-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-netns\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-run\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-sys\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-device-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-netns\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.563989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-device-dir\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-kubelet\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-conf\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-kubelet\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8zm\" (UniqueName: \"kubernetes.io/projected/7e9b48c6-fa84-4094-b01a-240210d5f091-kube-api-access-cs8zm\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-serviceca\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-config\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cni-binary-copy\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-conf\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-multus\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-kubelet-config\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-multus\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564426 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-host\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-cnibin\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a11874-d207-48d9-beb2-7389fe32d839-agent-certs\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-host\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-hostroot\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547672 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4505d52-904f-4bd5-b0cb-b18930b7111a-kubelet-config\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-etc-kubernetes\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-etc-kubernetes\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-hostroot\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysctl-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-cnibin\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.547849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovn-node-metrics-cert\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.564863 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-netns\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-config\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-cni-binary-copy\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-netns\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-kubelet\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-kubelet\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-modprobe-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-tuned\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e9b48c6-fa84-4094-b01a-240210d5f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aad090eb-c3cd-41d8-8baa-d51bee14d2be-host-slash\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-script-lib\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-bin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-modprobe-d\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-lib-modules\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-var-lib-cni-bin\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-systemd-units\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-lib-modules\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aad090eb-c3cd-41d8-8baa-d51bee14d2be-host-slash\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-systemd-units\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-etc-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-log-socket\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-etc-openvswitch\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-k8s-cni-cncf-io\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7rl\" (UniqueName: \"kubernetes.io/projected/dbb342d6-29e2-45da-82c1-bbfd57078bf2-kube-api-access-kt7rl\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-log-socket\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85gz\" (UniqueName: \"kubernetes.io/projected/4620035a-50f0-4265-a2d0-1550c20e6898-kube-api-access-f85gz\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysconfig\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.565811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-host-run-k8s-cni-cncf-io\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-conf-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-sys-fs\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovnkube-script-lib\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-slash\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-ovn\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-conf-dir\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e9b48c6-fa84-4094-b01a-240210d5f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a11874-d207-48d9-beb2-7389fe32d839-konnectivity-ca\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-daemon-config\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-slash\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-run-ovn\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-etc-selinux\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-etc-selinux\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.548678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769ll\" (UniqueName: \"kubernetes.io/projected/aad090eb-c3cd-41d8-8baa-d51bee14d2be-kube-api-access-769ll\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4620035a-50f0-4265-a2d0-1550c20e6898-sys-fs\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-kubernetes\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549091 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-sysconfig\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-kubernetes\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a11874-d207-48d9-beb2-7389fe32d839-konnectivity-ca\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-tmp\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.549341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbb342d6-29e2-45da-82c1-bbfd57078bf2-multus-daemon-config\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.550012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-ovn-node-metrics-cert\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.550035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a11874-d207-48d9-beb2-7389fe32d839-agent-certs\") pod \"konnectivity-agent-sd7xc\" (UID: \"f4a11874-d207-48d9-beb2-7389fe32d839\") " pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.550134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/595194e4-526d-4fa6-9906-50a5c49a01d3-etc-tuned\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.553196 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:42.566818 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.553213 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.553223 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:42.553264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:43.053253803 +0000 UTC m=+2.073805004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.553503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8frg\" (UniqueName: \"kubernetes.io/projected/595194e4-526d-4fa6-9906-50a5c49a01d3-kube-api-access-t8frg\") pod \"tuned-xj6k7\" (UID: \"595194e4-526d-4fa6-9906-50a5c49a01d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.554961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cb6\" (UniqueName: \"kubernetes.io/projected/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-kube-api-access-k5cb6\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.555209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gntwf\" (UniqueName: \"kubernetes.io/projected/bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb-kube-api-access-gntwf\") pod \"node-ca-kqdjp\" (UID: \"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb\") " pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.555527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhzvk\" (UniqueName: \"kubernetes.io/projected/ee45233a-b4ad-4596-8b10-bc3d30c7dd08-kube-api-access-rhzvk\") pod \"ovnkube-node-cfphh\" (UID: \"ee45233a-b4ad-4596-8b10-bc3d30c7dd08\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.557797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8zm\" (UniqueName: \"kubernetes.io/projected/7e9b48c6-fa84-4094-b01a-240210d5f091-kube-api-access-cs8zm\") pod \"multus-additional-cni-plugins-lvvrm\" (UID: \"7e9b48c6-fa84-4094-b01a-240210d5f091\") " pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.558296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7rl\" (UniqueName: \"kubernetes.io/projected/dbb342d6-29e2-45da-82c1-bbfd57078bf2-kube-api-access-kt7rl\") pod \"multus-qpd9p\" (UID: \"dbb342d6-29e2-45da-82c1-bbfd57078bf2\") " pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.558926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85gz\" (UniqueName: \"kubernetes.io/projected/4620035a-50f0-4265-a2d0-1550c20e6898-kube-api-access-f85gz\") pod \"aws-ebs-csi-driver-node-lpt9v\" (UID: \"4620035a-50f0-4265-a2d0-1550c20e6898\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.567761 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.559316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769ll\" (UniqueName: \"kubernetes.io/projected/aad090eb-c3cd-41d8-8baa-d51bee14d2be-kube-api-access-769ll\") pod \"iptables-alerter-tvnlf\" (UID: \"aad090eb-c3cd-41d8-8baa-d51bee14d2be\") " pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.715622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.642267 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:42.715622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.679318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kfhsc" Jul 01 22:21:42.715622 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.690407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaaf8382_fb94_42cf_8342_7533e64353ce.slice/crio-9d3c9a2edbac47c2677d5efdb6f74bfe3ef1c6c7fa78bf95984ff732099e1639 WatchSource:0}: Error finding container 9d3c9a2edbac47c2677d5efdb6f74bfe3ef1c6c7fa78bf95984ff732099e1639: Status 404 returned error can't find the container with id 9d3c9a2edbac47c2677d5efdb6f74bfe3ef1c6c7fa78bf95984ff732099e1639 Jul 01 22:21:42.715622 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.697722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqdjp" Jul 01 22:21:42.715622 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.705440 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcb3029_16b7_4d4c_b8d2_94b5bd0eaecb.slice/crio-168aeb10ac3ccb8849615f11693d7c8e3b4d87b8b60cd932a0a4b93b9cee3c26 WatchSource:0}: Error finding container 168aeb10ac3ccb8849615f11693d7c8e3b4d87b8b60cd932a0a4b93b9cee3c26: Status 404 returned error can't find the container with id 168aeb10ac3ccb8849615f11693d7c8e3b4d87b8b60cd932a0a4b93b9cee3c26 Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.720383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.727593 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9b48c6_fa84_4094_b01a_240210d5f091.slice/crio-3a4109b869d7330b3f297d04d7116653073e6de64e4064b0255299b6f39512f0 WatchSource:0}: Error finding container 3a4109b869d7330b3f297d04d7116653073e6de64e4064b0255299b6f39512f0: Status 404 returned error can't find the container with id 3a4109b869d7330b3f297d04d7116653073e6de64e4064b0255299b6f39512f0 Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.740289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.747549 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee45233a_b4ad_4596_8b10_bc3d30c7dd08.slice/crio-06a6b274b395cb8aefe676e75d814735d8486285d55c0d7d41498fdbca8d7b3a WatchSource:0}: Error finding container 06a6b274b395cb8aefe676e75d814735d8486285d55c0d7d41498fdbca8d7b3a: Status 404 returned error can't find the container with id 06a6b274b395cb8aefe676e75d814735d8486285d55c0d7d41498fdbca8d7b3a Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.763975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.772210 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a11874_d207_48d9_beb2_7389fe32d839.slice/crio-aa85cddb620b1c4c690c3d326bc41f29cfc74c28cf367ea22f46b6ef1bd03966 WatchSource:0}: Error finding container aa85cddb620b1c4c690c3d326bc41f29cfc74c28cf367ea22f46b6ef1bd03966: Status 404 returned error can't find the container with id aa85cddb620b1c4c690c3d326bc41f29cfc74c28cf367ea22f46b6ef1bd03966 Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.782722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.791091 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4620035a_50f0_4265_a2d0_1550c20e6898.slice/crio-beb6f2af4bc9627e6a6b1671360e104ca15248b034f6e5b35f45fa4273a994c8 WatchSource:0}: Error finding container beb6f2af4bc9627e6a6b1671360e104ca15248b034f6e5b35f45fa4273a994c8: Status 404 returned error can't find the container with id beb6f2af4bc9627e6a6b1671360e104ca15248b034f6e5b35f45fa4273a994c8 Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.800949 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpd9p" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.808176 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb342d6_29e2_45da_82c1_bbfd57078bf2.slice/crio-10d3d9cbbb9ecf991ba474cdb4399286a5d9b9398f9942acaf2a9aae501f178b WatchSource:0}: Error finding container 10d3d9cbbb9ecf991ba474cdb4399286a5d9b9398f9942acaf2a9aae501f178b: Status 404 returned error can't find the container with id 10d3d9cbbb9ecf991ba474cdb4399286a5d9b9398f9942acaf2a9aae501f178b Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.829676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tvnlf" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:42.832276 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" Jul 01 22:21:42.840361 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.838912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad090eb_c3cd_41d8_8baa_d51bee14d2be.slice/crio-b33c59603a4dd3c41da5ebddb56797c2c3e97b8eb5d5e96dc037602dd39bcd3e WatchSource:0}: Error finding container b33c59603a4dd3c41da5ebddb56797c2c3e97b8eb5d5e96dc037602dd39bcd3e: Status 404 returned error can't find the container with id b33c59603a4dd3c41da5ebddb56797c2c3e97b8eb5d5e96dc037602dd39bcd3e Jul 01 22:21:42.842896 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:21:42.841162 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595194e4_526d_4fa6_9906_50a5c49a01d3.slice/crio-e26dbe42fab3eae4a62a1e0e42bb739764edfbca3d0b95fe372d3c425b0be2e6 WatchSource:0}: Error finding container e26dbe42fab3eae4a62a1e0e42bb739764edfbca3d0b95fe372d3c425b0be2e6: Status 404 returned error can't find the container with id e26dbe42fab3eae4a62a1e0e42bb739764edfbca3d0b95fe372d3c425b0be2e6 Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.055783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.055847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.055917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056039 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056093 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:44.056078034 +0000 UTC m=+3.076629238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056151 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:21:44.056180036 +0000 UTC m=+3.076731255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056257 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056271 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056283 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:43.106341 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:43.056389 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:44.056302551 +0000 UTC m=+3.076853768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:43.378161 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.377991 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:16:42 +0000 UTC" deadline="2027-11-27 18:50:15.96488695 +0000 UTC" Jul 01 22:21:43.378161 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.378071 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12332h28m32.586820116s" Jul 01 22:21:43.432371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.432315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerStarted","Data":"3a4109b869d7330b3f297d04d7116653073e6de64e4064b0255299b6f39512f0"} Jul 01 22:21:43.450418 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.450165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"26db5ccefc68603216d3d6d5b542614e","Type":"ContainerStarted","Data":"91370c2d4171c3edd73d845cb2f14ebcf411e921bb7420d3ad29a503506dd508"} Jul 01 22:21:43.467221 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.467138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" event={"ID":"595194e4-526d-4fa6-9906-50a5c49a01d3","Type":"ContainerStarted","Data":"e26dbe42fab3eae4a62a1e0e42bb739764edfbca3d0b95fe372d3c425b0be2e6"} Jul 01 22:21:43.490187 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.490143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpd9p" event={"ID":"dbb342d6-29e2-45da-82c1-bbfd57078bf2","Type":"ContainerStarted","Data":"10d3d9cbbb9ecf991ba474cdb4399286a5d9b9398f9942acaf2a9aae501f178b"} Jul 01 22:21:43.508397 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.508315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqdjp" event={"ID":"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb","Type":"ContainerStarted","Data":"168aeb10ac3ccb8849615f11693d7c8e3b4d87b8b60cd932a0a4b93b9cee3c26"} Jul 01 22:21:43.525214 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.525121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kfhsc" event={"ID":"baaf8382-fb94-42cf-8342-7533e64353ce","Type":"ContainerStarted","Data":"9d3c9a2edbac47c2677d5efdb6f74bfe3ef1c6c7fa78bf95984ff732099e1639"} Jul 01 22:21:43.537264 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.537190 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"630d830233945d606370114bbcf2182a","Type":"ContainerStarted","Data":"963371b9f14d6c5f59d56cd57e254c05e2eec133b83c2cccf92147892b389499"} Jul 01 22:21:43.544119 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.544062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tvnlf" event={"ID":"aad090eb-c3cd-41d8-8baa-d51bee14d2be","Type":"ContainerStarted","Data":"b33c59603a4dd3c41da5ebddb56797c2c3e97b8eb5d5e96dc037602dd39bcd3e"} Jul 01 22:21:43.555048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.554883 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:43.558314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.558225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" event={"ID":"4620035a-50f0-4265-a2d0-1550c20e6898","Type":"ContainerStarted","Data":"beb6f2af4bc9627e6a6b1671360e104ca15248b034f6e5b35f45fa4273a994c8"} Jul 01 22:21:43.578294 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.578259 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd7xc" event={"ID":"f4a11874-d207-48d9-beb2-7389fe32d839","Type":"ContainerStarted","Data":"aa85cddb620b1c4c690c3d326bc41f29cfc74c28cf367ea22f46b6ef1bd03966"} Jul 01 22:21:43.602463 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:43.602360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"06a6b274b395cb8aefe676e75d814735d8486285d55c0d7d41498fdbca8d7b3a"} Jul 01 22:21:44.064669 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.064633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:44.064871 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.064687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:44.064871 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.064720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:44.064986 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.064878 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:44.064986 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.064895 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:44.064986 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.064906 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:44.064986 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.064959 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:46.06494338 +0000 UTC m=+5.085494585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:44.065969 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.065310 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:44.065969 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.065356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:46.065342192 +0000 UTC m=+5.085893394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:44.065969 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.065403 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:44.065969 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.065433 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:21:46.065421753 +0000 UTC m=+5.085972969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:44.378866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.378732 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:16:42 +0000 UTC" deadline="2028-04-04 12:22:49.402111736 +0000 UTC" Jul 01 22:21:44.378866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.378766 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15422h1m5.023350494s" Jul 01 22:21:44.408096 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.408065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:44.408256 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.408184 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:44.408629 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.408610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:44.408728 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.408706 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:44.408795 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:44.408781 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:44.409055 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:44.408881 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:45.475228 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:45.475198 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:21:46.080557 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.080521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:46.080731 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.080577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:46.080731 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.080615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:46.080879 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.080755 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:46.080879 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.080775 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:46.080879 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.080788 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:46.080879 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.080845 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:50.080827562 +0000 UTC m=+9.101378766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:46.081236 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.081212 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:46.081315 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.081249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:50.081238377 +0000 UTC m=+9.101789579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:46.081315 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.081282 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:46.081315 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.081303 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:21:50.08129489 +0000 UTC m=+9.101846091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.407304 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.407343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:46.407309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.407453 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.407542 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:46.407866 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:46.407635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:48.408072 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:48.408037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:48.408561 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:48.408037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:48.408561 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:48.408211 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:48.408561 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:48.408036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:48.408561 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:48.408311 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:48.408561 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:48.408377 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:50.114069 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.114036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:50.114529 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.114087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:50.114529 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.114142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:50.114529 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114275 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:50.114529 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114336 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:58.114317496 +0000 UTC m=+17.134868717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:50.114736 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114703 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:50.114786 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114768 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:21:58.1147399 +0000 UTC m=+17.135291120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:50.114909 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114849 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:50.114909 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114885 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:50.114909 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114897 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:50.115077 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.114940 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:21:58.114927981 +0000 UTC m=+17.135479200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:50.407688 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.407603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:50.407688 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.407627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:50.407688 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:50.407647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:50.407993 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.407776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:50.407993 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.407836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:50.407993 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:50.407920 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:52.407388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:52.407308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:52.407811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:52.407309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:52.407811 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:52.407437 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:52.407811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:52.407309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:52.407811 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:52.407518 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:52.407811 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:52.407602 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:54.407372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:54.407339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:54.407683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:54.407384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:54.407683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:54.407389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:54.407683 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:54.407472 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:54.407683 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:54.407512 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:54.407683 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:54.407577 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:56.407980 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:56.407940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:56.407980 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:56.407971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:56.408518 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:56.407978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:56.408518 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:56.408061 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:56.408518 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:56.408137 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:21:56.408518 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:56.408237 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:58.176236 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.176193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.176261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176319 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176387 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:22:14.176370898 +0000 UTC m=+33.196922100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176396 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.176319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176409 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176429 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176441 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176447 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:22:14.176431117 +0000 UTC m=+33.196982322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:21:58.176707 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.176481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:22:14.176468898 +0000 UTC m=+33.197020113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:21:58.407167 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.407128 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:21:58.407391 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.407172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:21:58.407391 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:21:58.407182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:21:58.407391 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.407260 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:21:58.407391 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.407338 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:21:58.407585 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:21:58.407411 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:00.407625 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:00.407598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:00.408063 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:00.407727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:00.408063 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:00.407740 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:00.408063 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:00.407758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:00.408063 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:00.407847 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:00.408063 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:00.407957 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:02.407954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:02.407916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:02.407954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:02.407941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:02.408350 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:02.407924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:02.408350 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:02.408018 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:02.408350 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:02.408096 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:02.408350 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:02.408149 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:03.649533 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.649290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" event={"ID":"595194e4-526d-4fa6-9906-50a5c49a01d3","Type":"ContainerStarted","Data":"df4c3fcb9fcace7c0102dd5a8662a5bc6890c0c7693fa5110936e81af619060e"} Jul 01 22:22:03.651808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.651784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpd9p" event={"ID":"dbb342d6-29e2-45da-82c1-bbfd57078bf2","Type":"ContainerStarted","Data":"fc6b57e3f3679448cbf95f4b9d724c21241c3f63892b5c16445bdcade41ec2ac"} Jul 01 22:22:03.653325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.653299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"630d830233945d606370114bbcf2182a","Type":"ContainerStarted","Data":"a9b32455aaa3f06b46d9d1b4acbfd947ec828ded6ea1b8a6a537ef460b129dfd"} Jul 01 22:22:03.656411 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"d81f01c6214da88b1f3021a505de6848ebb05540690e39fba081b8e22f9315cd"} Jul 01 22:22:03.656497 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"82ee4e63971e29e7332e882c44e383d9b071d9b49226c8f640670f283e115d22"} Jul 01 22:22:03.656497 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"ac0501362e54f4db0a68a7e925260a88d9634b759339c8289a792eff0375f1b6"} Jul 01 22:22:03.656563 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"808da88d2fc36ace167b864a234d039ddecc489913da37f1f618b4c14d03520b"} Jul 01 22:22:03.656563 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"44b22242eb3ff4adb05b743d3e3d0c6fcf28ac7915d06adab5ab4261dee5c46f"} Jul 01 22:22:03.656635 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.656573 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"84225815f31f92ead8f58fe711a0359f4610138c1746de936969b9edf5381b0e"} Jul 01 22:22:03.671924 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.671875 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xj6k7" podStartSLOduration=2.7046276970000003 podStartE2EDuration="22.671841939s" totalImagesPullingTime="19.967214242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:03.671459325 +0000 UTC m=+22.692010549" watchObservedRunningTime="2026-07-01 22:22:03.671841939 +0000 UTC m=+22.692393165" Jul 01 22:22:03.692692 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:03.692646 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpd9p" podStartSLOduration=2.6580446220000002 podStartE2EDuration="22.692631744s" totalImagesPullingTime="20.034587122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:03.692328461 +0000 UTC m=+22.712879686" watchObservedRunningTime="2026-07-01 22:22:03.692631744 +0000 UTC m=+22.713182968" Jul 01 22:22:04.407871 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.407690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:04.408146 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.407690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:04.408146 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:04.407969 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:04.408146 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.407690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:04.408146 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:04.408012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:04.408146 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:04.408079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:04.659533 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.659447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kfhsc" event={"ID":"baaf8382-fb94-42cf-8342-7533e64353ce","Type":"ContainerStarted","Data":"ccf6fe106ddbe2798aeac79bc6a7e6d2b2af6b2bc670e60d93890628a01e3762"} Jul 01 22:22:04.660811 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.660788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tvnlf" event={"ID":"aad090eb-c3cd-41d8-8baa-d51bee14d2be","Type":"ContainerStarted","Data":"6014d0fc2ee14c87fc856db4d44c5c7c3790c42824bd514d6b8b32400ce597dd"} Jul 01 22:22:04.662109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.662086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" event={"ID":"4620035a-50f0-4265-a2d0-1550c20e6898","Type":"ContainerStarted","Data":"cc3aa21f613c846df7fcef5874afa887ff764103b8505ea56f067a4e9f48a97d"} Jul 01 22:22:04.663388 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.663365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd7xc" event={"ID":"f4a11874-d207-48d9-beb2-7389fe32d839","Type":"ContainerStarted","Data":"263ab51e5c0b25d5a21dedc80e52a0cd0e20ee80455606cf0bda4d77bd2f6c04"} Jul 01 22:22:04.664711 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.664691 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="c895d0331f09633285d7c7b33290df570de24eeaa137585e518815c1a975a2cb" exitCode=0 Jul 01 22:22:04.664804 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.664751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"c895d0331f09633285d7c7b33290df570de24eeaa137585e518815c1a975a2cb"} Jul 01 22:22:04.666056 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.666033 2577 generic.go:356] "Generic (PLEG): container finished" podID="26db5ccefc68603216d3d6d5b542614e" containerID="1e10b083294812e1f16adc6bf52610d9a1f55b37987bf8cb4918ca3fc813f8a3" exitCode=0 Jul 01 22:22:04.666107 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.666059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"26db5ccefc68603216d3d6d5b542614e","Type":"ContainerDied","Data":"1e10b083294812e1f16adc6bf52610d9a1f55b37987bf8cb4918ca3fc813f8a3"} Jul 01 22:22:04.667601 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.667579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqdjp" event={"ID":"bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb","Type":"ContainerStarted","Data":"41c743d7b30630795ba7c31a09acbc5edecfe786634fc9aed188f5e7741aeae6"} Jul 01 22:22:04.676579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.676512 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kfhsc" podStartSLOduration=3.748934825 podStartE2EDuration="23.676496584s" totalImagesPullingTime="19.927561759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:04.676075519 +0000 UTC m=+23.696626745" watchObservedRunningTime="2026-07-01 22:22:04.676496584 +0000 UTC m=+23.697047808" Jul 01 22:22:04.678251 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.677224 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" podStartSLOduration=23.677212095 podStartE2EDuration="23.677212095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:03.708350616 +0000 UTC m=+22.728901840" watchObservedRunningTime="2026-07-01 22:22:04.677212095 +0000 UTC m=+23.697763320" Jul 01 22:22:04.694230 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.693523 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kqdjp" podStartSLOduration=3.781678584 podStartE2EDuration="23.69350493s" totalImagesPullingTime="19.911826346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:04.693313361 +0000 UTC m=+23.713864586" watchObservedRunningTime="2026-07-01 22:22:04.69350493 +0000 UTC m=+23.714056155" Jul 01 22:22:04.733374 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.733307 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sd7xc" podStartSLOduration=12.145340038 podStartE2EDuration="23.733291905s" totalImagesPullingTime="11.587951867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:04.732801732 +0000 UTC m=+23.753352956" watchObservedRunningTime="2026-07-01 22:22:04.733291905 +0000 UTC m=+23.753843128" Jul 01 22:22:04.765410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:04.765368 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tvnlf" podStartSLOduration=3.796364422 podStartE2EDuration="23.765352176s" totalImagesPullingTime="19.968987754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:04.765257406 +0000 UTC m=+23.785808630" watchObservedRunningTime="2026-07-01 22:22:04.765352176 +0000 UTC m=+23.785903399" Jul 01 22:22:05.010300 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.010210 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 22:22:05.431456 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.431346 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T22:22:05.01022644Z","UUID":"b4e4c9b6-47fa-4df4-9c3b-12cb90891d58","Handler":null,"Name":"","Endpoint":""} Jul 01 22:22:05.433103 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.433060 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 22:22:05.433238 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.433142 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 22:22:05.672338 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.672305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" event={"ID":"4620035a-50f0-4265-a2d0-1550c20e6898","Type":"ContainerStarted","Data":"5cf206669cb755c02748b75555e1968f02465d027f2f31caa80ee1f18cc3e204"} Jul 01 22:22:05.674416 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.674388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"26db5ccefc68603216d3d6d5b542614e","Type":"ContainerStarted","Data":"4b95188aeff7f05f3da1217ca5ceb74de917f11aae2c070b5a24c3c0d13f6734"} Jul 01 22:22:05.714792 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:05.714737 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" podStartSLOduration=24.714714999 podStartE2EDuration="24.714714999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:05.714551534 +0000 UTC m=+24.735102758" watchObservedRunningTime="2026-07-01 22:22:05.714714999 +0000 UTC m=+24.735266225" Jul 01 22:22:06.407490 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.407436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:06.407490 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.407466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:06.407654 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.407436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:06.407654 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:06.407557 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:06.407764 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:06.407645 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:06.407764 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:06.407720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:06.680132 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.680049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" event={"ID":"4620035a-50f0-4265-a2d0-1550c20e6898","Type":"ContainerStarted","Data":"e24abe2ed54031d8326d51d63fbbe3457282aa909a9ecfea1c7573f963662e16"} Jul 01 22:22:06.683900 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.683875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"6d869edf93dd4f14993a6db100e67a4794d1c9acebbce62243d5489bab0b9fe5"} Jul 01 22:22:06.700748 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:06.700706 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lpt9v" podStartSLOduration=3.268005749 podStartE2EDuration="25.700694282s" totalImagesPullingTime="22.432688533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:06.700549703 +0000 UTC m=+25.721100926" watchObservedRunningTime="2026-07-01 22:22:06.700694282 +0000 UTC m=+25.721245506" Jul 01 22:22:07.264093 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:07.264059 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:22:07.264791 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:07.264765 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:22:07.687102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:07.687009 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:22:07.687530 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:07.687239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sd7xc" Jul 01 22:22:08.407377 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:08.407340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:08.407553 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:08.407444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:08.407553 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:08.407454 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:08.407553 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:08.407467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:08.407689 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:08.407558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:08.407689 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:08.407638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:09.695078 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.694770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" event={"ID":"ee45233a-b4ad-4596-8b10-bc3d30c7dd08","Type":"ContainerStarted","Data":"d7297d988838d2496c046e60da52cf8cc523f7269f7c1a03b590bc29f59ca328"} Jul 01 22:22:09.695978 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.695075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:09.695978 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.695126 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:09.696834 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.696664 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="fce1feaf9670dbfdf982324268bec9fcc258259cc6e9628d7b1daadd1c56aa4e" exitCode=0 Jul 01 22:22:09.696963 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.696720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"fce1feaf9670dbfdf982324268bec9fcc258259cc6e9628d7b1daadd1c56aa4e"} Jul 01 22:22:09.711347 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.711317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:09.733599 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:09.733557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" podStartSLOduration=8.567183067 podStartE2EDuration="28.733544376s" totalImagesPullingTime="20.166361309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:09.733196549 +0000 UTC m=+28.753747774" watchObservedRunningTime="2026-07-01 22:22:09.733544376 +0000 UTC m=+28.754095633" Jul 01 22:22:10.412745 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:10.412705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:10.412745 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:10.412732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:10.413108 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:10.412705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:10.413108 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:10.412825 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:10.413108 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:10.412973 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:10.413108 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:10.413053 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:10.699668 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:10.699565 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:10.713977 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:10.713947 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:11.212485 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.212458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kfhsc_baaf8382-fb94-42cf-8342-7533e64353ce/dns-node-resolver/0.log" Jul 01 22:22:11.380280 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.380247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhhn5"] Jul 01 22:22:11.380444 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.380413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:11.380541 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:11.380513 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:11.381030 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.381011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ksgr7"] Jul 01 22:22:11.381121 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.381111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:11.381224 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:11.381207 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:11.396775 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.396747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6lntk"] Jul 01 22:22:11.396899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.396879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:11.397015 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:11.396995 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:11.703186 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.703153 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="cc9ad0e976370164766bc9a1609a294dbe225bfd881f91a3cbee9e435349fdbd" exitCode=0 Jul 01 22:22:11.703711 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.703241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"cc9ad0e976370164766bc9a1609a294dbe225bfd881f91a3cbee9e435349fdbd"} Jul 01 22:22:11.982323 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:11.982300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqdjp_bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb/node-ca/0.log" Jul 01 22:22:12.708274 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:12.708054 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="a213f684c97a855174d9815a9dd537b0b7b4e8e7afde657c8d72507c3883da4d" exitCode=0 Jul 01 22:22:12.708274 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:12.708137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"a213f684c97a855174d9815a9dd537b0b7b4e8e7afde657c8d72507c3883da4d"} Jul 01 22:22:13.408091 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:13.408058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:13.408273 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:13.408055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:13.408273 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:13.408186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:13.408273 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:13.408189 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:13.408402 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:13.408280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:13.408402 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:13.408359 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:14.191277 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:14.191240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:14.191295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:14.191335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191437 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191470 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191490 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191503 2577 projected.go:196] Error preparing data for projected volume kube-api-access-6dkl4 for pod openshift-network-diagnostics/network-check-target-vhhn5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191506 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs podName:f5e2ff3e-e306-4e63-9cf6-f273ed049a20 nodeName:}" failed. No retries permitted until 2026-07-01 22:22:46.191485769 +0000 UTC m=+65.212036988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs") pod "network-metrics-daemon-6lntk" (UID: "f5e2ff3e-e306-4e63-9cf6-f273ed049a20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191554 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4 podName:b65d92aa-790c-49eb-946b-acf6f8e52632 nodeName:}" failed. No retries permitted until 2026-07-01 22:22:46.191537774 +0000 UTC m=+65.212088991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dkl4" (UniqueName: "kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4") pod "network-check-target-vhhn5" (UID: "b65d92aa-790c-49eb-946b-acf6f8e52632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191437 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:22:14.191806 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:14.191603 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret podName:f4505d52-904f-4bd5-b0cb-b18930b7111a nodeName:}" failed. No retries permitted until 2026-07-01 22:22:46.191591812 +0000 UTC m=+65.212143014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret") pod "global-pull-secret-syncer-ksgr7" (UID: "f4505d52-904f-4bd5-b0cb-b18930b7111a") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:22:15.407727 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:15.407690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:15.407727 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:15.407716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:15.408257 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:15.407829 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:15.408257 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:15.407892 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:15.408257 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:15.407915 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:15.408257 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:15.408000 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:17.407483 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:17.407444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:17.408153 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:17.407462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:17.408153 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:17.407581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:17.408153 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:17.407581 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:17.408153 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:17.407692 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:17.408153 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:17.407796 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:17.722903 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:17.722847 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="cc7869018a40d625aa8adf268482a43935e5850a16b1d63cd5737a593d2bee12" exitCode=0 Jul 01 22:22:17.722903 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:17.722890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"cc7869018a40d625aa8adf268482a43935e5850a16b1d63cd5737a593d2bee12"} Jul 01 22:22:18.728672 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:18.728639 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e9b48c6-fa84-4094-b01a-240210d5f091" containerID="d7328813009b3dcf206b0c2c681c7258c382e114fe98678b10dd0e0b9abf5949" exitCode=0 Jul 01 22:22:18.729043 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:18.728692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerDied","Data":"d7328813009b3dcf206b0c2c681c7258c382e114fe98678b10dd0e0b9abf5949"} Jul 01 22:22:19.408222 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:19.408181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:19.408406 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:19.408242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:19.408406 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:19.408252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:19.408406 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:19.408327 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:19.408556 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:19.408470 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:19.408556 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:19.408512 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:19.734320 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:19.734232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" event={"ID":"7e9b48c6-fa84-4094-b01a-240210d5f091","Type":"ContainerStarted","Data":"58838f135a0adb0f58266113c9ee18dbfad791d12d09d823ba754aaeb4af51f3"} Jul 01 22:22:19.759850 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:19.759799 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lvvrm" podStartSLOduration=7.79889391 podStartE2EDuration="38.759785223s" totalImagesPullingTime="30.960891313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:19.759580263 +0000 UTC m=+38.780131487" watchObservedRunningTime="2026-07-01 22:22:19.759785223 +0000 UTC m=+38.780336447" Jul 01 22:22:21.410214 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:21.410179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:21.410579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:21.410180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:21.410579 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:21.410283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:21.410579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:21.410177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:21.410579 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:21.410350 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:21.410579 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:21.410407 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:23.410325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:23.410293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:23.410748 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:23.410394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:23.410748 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:23.410395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:23.410748 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:23.410439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:23.410748 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:23.410531 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:23.410748 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:23.410580 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:25.407989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:25.407955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:25.407989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:25.407969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:25.408446 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:25.407958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:25.408446 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:25.408061 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:25.408446 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:25.408142 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:25.408446 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:25.408262 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:27.407658 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:27.407627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:27.407658 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:27.407644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:27.408163 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:27.407636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:27.408163 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:27.407719 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:27.408163 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:27.407778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:27.408163 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:27.407871 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:29.407876 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:29.407817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:29.407876 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:29.407848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:29.408405 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:29.407817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:29.408405 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:29.407949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:29.408405 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:29.408002 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:29.408405 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:29.408087 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:31.408683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:31.408647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:31.409083 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:31.408748 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:31.409083 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:31.408768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:31.409083 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:31.408842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:31.409083 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:31.408936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:31.409083 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:31.409016 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:33.407613 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:33.407569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:33.407613 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:33.407595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:33.407613 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:33.407613 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:33.408084 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:33.407699 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:33.408084 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:33.407763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:33.408084 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:33.407836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:35.407984 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.407945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:35.408474 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.407961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:35.408474 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:35.408075 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhhn5" podUID="b65d92aa-790c-49eb-946b-acf6f8e52632" Jul 01 22:22:35.408474 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.407961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:35.408474 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:35.408149 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ksgr7" podUID="f4505d52-904f-4bd5-b0cb-b18930b7111a" Jul 01 22:22:35.408474 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:35.408251 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lntk" podUID="f5e2ff3e-e306-4e63-9cf6-f273ed049a20" Jul 01 22:22:35.720176 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.720103 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeReady" Jul 01 22:22:35.720312 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.720240 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 22:22:35.787614 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.787580 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zrnb9"] Jul 01 22:22:35.789460 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.789444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.792844 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.792823 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9nw5d\"" Jul 01 22:22:35.793017 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.792996 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 22:22:35.793085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.793059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 22:22:35.793143 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.793116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 22:22:35.793627 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.793608 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qhs8j"] Jul 01 22:22:35.795593 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.795574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.802096 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.801687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 22:22:35.802096 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.801910 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 22:22:35.805118 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.804003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8gbff\"" Jul 01 22:22:35.805118 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.804281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 22:22:35.805118 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.804912 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 22:22:35.811592 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.811572 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k6t78"] Jul 01 22:22:35.814004 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.813987 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.817126 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.817111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 22:22:35.817340 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.817324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 22:22:35.817551 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.817536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjcnx\"" Jul 01 22:22:35.824158 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.824129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zrnb9"] Jul 01 22:22:35.825092 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.825073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhs8j"] Jul 01 22:22:35.839770 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.839748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k6t78"] Jul 01 22:22:35.857697 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33e11b1-2d54-4a08-82db-5a5fd22a03be-cert\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.857808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3cef175-e9c7-4fcb-80af-f08c584446b4-config-volume\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.857808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.857808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3cef175-e9c7-4fcb-80af-f08c584446b4-metrics-tls\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.857808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cef175-e9c7-4fcb-80af-f08c584446b4-tmp-dir\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a67656-66f0-4da5-8db4-58d13e6489d8-crio-socket\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a67656-66f0-4da5-8db4-58d13e6489d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8m92\" (UniqueName: \"kubernetes.io/projected/e33e11b1-2d54-4a08-82db-5a5fd22a03be-kube-api-access-b8m92\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpnk2\" (UniqueName: \"kubernetes.io/projected/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-api-access-xpnk2\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlgn\" (UniqueName: \"kubernetes.io/projected/c3cef175-e9c7-4fcb-80af-f08c584446b4-kube-api-access-mjlgn\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.857994 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.857968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a67656-66f0-4da5-8db4-58d13e6489d8-data-volume\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958467 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cef175-e9c7-4fcb-80af-f08c584446b4-tmp-dir\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.958632 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a67656-66f0-4da5-8db4-58d13e6489d8-crio-socket\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958632 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a67656-66f0-4da5-8db4-58d13e6489d8-crio-socket\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958703 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a67656-66f0-4da5-8db4-58d13e6489d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958703 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8m92\" (UniqueName: \"kubernetes.io/projected/e33e11b1-2d54-4a08-82db-5a5fd22a03be-kube-api-access-b8m92\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.958785 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cef175-e9c7-4fcb-80af-f08c584446b4-tmp-dir\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.958822 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpnk2\" (UniqueName: \"kubernetes.io/projected/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-api-access-xpnk2\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958879 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlgn\" (UniqueName: \"kubernetes.io/projected/c3cef175-e9c7-4fcb-80af-f08c584446b4-kube-api-access-mjlgn\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.958879 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a67656-66f0-4da5-8db4-58d13e6489d8-data-volume\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.958980 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33e11b1-2d54-4a08-82db-5a5fd22a03be-cert\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.958980 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3cef175-e9c7-4fcb-80af-f08c584446b4-config-volume\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.959142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.958985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.959142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.959008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3cef175-e9c7-4fcb-80af-f08c584446b4-metrics-tls\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.959265 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.959244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a67656-66f0-4da5-8db4-58d13e6489d8-data-volume\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.959514 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.959485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3cef175-e9c7-4fcb-80af-f08c584446b4-config-volume\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.959514 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.959496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.962752 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.962730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3cef175-e9c7-4fcb-80af-f08c584446b4-metrics-tls\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:35.962840 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.962761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a67656-66f0-4da5-8db4-58d13e6489d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.962840 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.962769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33e11b1-2d54-4a08-82db-5a5fd22a03be-cert\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.972516 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.972417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpnk2\" (UniqueName: \"kubernetes.io/projected/54a67656-66f0-4da5-8db4-58d13e6489d8-kube-api-access-xpnk2\") pod \"insights-runtime-extractor-qhs8j\" (UID: \"54a67656-66f0-4da5-8db4-58d13e6489d8\") " pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:35.973112 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.973090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8m92\" (UniqueName: \"kubernetes.io/projected/e33e11b1-2d54-4a08-82db-5a5fd22a03be-kube-api-access-b8m92\") pod \"ingress-canary-zrnb9\" (UID: \"e33e11b1-2d54-4a08-82db-5a5fd22a03be\") " pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:35.973418 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:35.973401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlgn\" (UniqueName: \"kubernetes.io/projected/c3cef175-e9c7-4fcb-80af-f08c584446b4-kube-api-access-mjlgn\") pod \"dns-default-k6t78\" (UID: \"c3cef175-e9c7-4fcb-80af-f08c584446b4\") " pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:36.099657 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.099617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zrnb9" Jul 01 22:22:36.111265 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.111243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qhs8j" Jul 01 22:22:36.127063 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.127035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:36.255460 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.255435 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qhs8j"] Jul 01 22:22:36.259647 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:36.259619 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a67656_66f0_4da5_8db4_58d13e6489d8.slice/crio-ecade483e0b89b0a37ef9bedf9f730ddf78987995a69186f0e9bd4e2d9e27575 WatchSource:0}: Error finding container ecade483e0b89b0a37ef9bedf9f730ddf78987995a69186f0e9bd4e2d9e27575: Status 404 returned error can't find the container with id ecade483e0b89b0a37ef9bedf9f730ddf78987995a69186f0e9bd4e2d9e27575 Jul 01 22:22:36.268596 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.268573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zrnb9"] Jul 01 22:22:36.271015 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:36.270987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33e11b1_2d54_4a08_82db_5a5fd22a03be.slice/crio-f0646290fd5dd670ca0685c56ab7bd07beba101f4496885244c4f21c68543646 WatchSource:0}: Error finding container f0646290fd5dd670ca0685c56ab7bd07beba101f4496885244c4f21c68543646: Status 404 returned error can't find the container with id f0646290fd5dd670ca0685c56ab7bd07beba101f4496885244c4f21c68543646 Jul 01 22:22:36.287608 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.287586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k6t78"] Jul 01 22:22:36.291435 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:36.291405 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cef175_e9c7_4fcb_80af_f08c584446b4.slice/crio-efab43485abde1c112a3a5d0f78f6f873fd02783ba207927df8a9669390b260b WatchSource:0}: Error finding container efab43485abde1c112a3a5d0f78f6f873fd02783ba207927df8a9669390b260b: Status 404 returned error can't find the container with id efab43485abde1c112a3a5d0f78f6f873fd02783ba207927df8a9669390b260b Jul 01 22:22:36.709467 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.709434 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf"] Jul 01 22:22:36.711429 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.711407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:36.714191 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.714148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 22:22:36.714191 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.714173 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4bfpq\"" Jul 01 22:22:36.725008 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.724797 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf"] Jul 01 22:22:36.764231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.764193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6hxhf\" (UID: \"acc5d231-71cd-4532-8113-f7baec18344b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:36.774494 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.774462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6t78" event={"ID":"c3cef175-e9c7-4fcb-80af-f08c584446b4","Type":"ContainerStarted","Data":"efab43485abde1c112a3a5d0f78f6f873fd02783ba207927df8a9669390b260b"} Jul 01 22:22:36.776057 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.776030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zrnb9" event={"ID":"e33e11b1-2d54-4a08-82db-5a5fd22a03be","Type":"ContainerStarted","Data":"f0646290fd5dd670ca0685c56ab7bd07beba101f4496885244c4f21c68543646"} Jul 01 22:22:36.778752 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.778682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhs8j" event={"ID":"54a67656-66f0-4da5-8db4-58d13e6489d8","Type":"ContainerStarted","Data":"ecade483e0b89b0a37ef9bedf9f730ddf78987995a69186f0e9bd4e2d9e27575"} Jul 01 22:22:36.864889 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:36.864832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6hxhf\" (UID: \"acc5d231-71cd-4532-8113-f7baec18344b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:36.865409 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:36.865085 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 22:22:36.865409 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:36.865155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates podName:acc5d231-71cd-4532-8113-f7baec18344b nodeName:}" failed. No retries permitted until 2026-07-01 22:22:37.36513734 +0000 UTC m=+56.385688547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" (UID: "acc5d231-71cd-4532-8113-f7baec18344b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 22:22:37.369427 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.369388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6hxhf\" (UID: \"acc5d231-71cd-4532-8113-f7baec18344b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:37.379568 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.379531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/acc5d231-71cd-4532-8113-f7baec18344b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6hxhf\" (UID: \"acc5d231-71cd-4532-8113-f7baec18344b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:37.413369 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.411843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:37.413369 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.412264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:37.413369 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.412638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:37.415584 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.415559 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:22:37.415814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.415796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:22:37.416378 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.416355 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-smgl4\"" Jul 01 22:22:37.416661 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.416641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7p2h\"" Jul 01 22:22:37.416888 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.416843 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:22:37.417242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.417041 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:22:37.624366 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.624091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:37.793845 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:37.793808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf"] Jul 01 22:22:37.800472 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:37.800442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc5d231_71cd_4532_8113_f7baec18344b.slice/crio-fba84640623e70e6eec53b10a95b629d297bbd6f35af454c3cf23de753c448dd WatchSource:0}: Error finding container fba84640623e70e6eec53b10a95b629d297bbd6f35af454c3cf23de753c448dd: Status 404 returned error can't find the container with id fba84640623e70e6eec53b10a95b629d297bbd6f35af454c3cf23de753c448dd Jul 01 22:22:38.784976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:38.784943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" event={"ID":"acc5d231-71cd-4532-8113-f7baec18344b","Type":"ContainerStarted","Data":"fba84640623e70e6eec53b10a95b629d297bbd6f35af454c3cf23de753c448dd"} Jul 01 22:22:41.795272 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.795031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zrnb9" event={"ID":"e33e11b1-2d54-4a08-82db-5a5fd22a03be","Type":"ContainerStarted","Data":"b49e9f372befd258e422e343303d08c2a5980987fed3106b50e75472be8b9ff8"} Jul 01 22:22:41.797420 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.797385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6t78" event={"ID":"c3cef175-e9c7-4fcb-80af-f08c584446b4","Type":"ContainerStarted","Data":"7615b5520ec6b8558b70bd04cca394158691ebae35cb4a1e5077a36961640215"} Jul 01 22:22:41.799310 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.799267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" event={"ID":"acc5d231-71cd-4532-8113-f7baec18344b","Type":"ContainerStarted","Data":"829790405d82304e45bc407dcbb7c3c3059881edfc147b0707add6507799851e"} Jul 01 22:22:41.802099 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.801508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:41.807339 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.807317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhs8j" event={"ID":"54a67656-66f0-4da5-8db4-58d13e6489d8","Type":"ContainerStarted","Data":"73a216fdffea25298a0a3c17107b334344d1ccfe9a2ce588b03f2f5e73781d65"} Jul 01 22:22:41.809354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.809326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" Jul 01 22:22:41.818488 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.818449 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zrnb9" podStartSLOduration=1.4840605230000001 podStartE2EDuration="6.818436306s" totalImagesPullingTime="5.334375783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:41.817973485 +0000 UTC m=+60.838524711" watchObservedRunningTime="2026-07-01 22:22:41.818436306 +0000 UTC m=+60.838987530" Jul 01 22:22:41.843463 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:41.843359 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6hxhf" podStartSLOduration=2.033877351 podStartE2EDuration="5.843341974s" totalImagesPullingTime="3.809464623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:41.842593135 +0000 UTC m=+60.863144362" watchObservedRunningTime="2026-07-01 22:22:41.843341974 +0000 UTC m=+60.863893202" Jul 01 22:22:42.720382 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.720354 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfphh" Jul 01 22:22:42.817029 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.816981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6t78" event={"ID":"c3cef175-e9c7-4fcb-80af-f08c584446b4","Type":"ContainerStarted","Data":"8242d4dd17727b7f20befca00b7b4a8371123286698df2063f60386aa9d30087"} Jul 01 22:22:42.817510 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.817096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:42.819076 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.819045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhs8j" event={"ID":"54a67656-66f0-4da5-8db4-58d13e6489d8","Type":"ContainerStarted","Data":"dac4b7385129e8bbac4ff9ba924debc33a9b50be649a555a2d5ca83a848016aa"} Jul 01 22:22:42.839368 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.839342 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-mgtwb"] Jul 01 22:22:42.844057 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.844037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:42.848272 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.848244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 22:22:42.848436 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.848416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 22:22:42.848589 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.848566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 22:22:42.848754 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.848635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 22:22:42.848754 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.848655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2shpk\"" Jul 01 22:22:42.849408 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.849384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 22:22:42.857816 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.857765 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k6t78" podStartSLOduration=2.566365927 podStartE2EDuration="7.857745593s" totalImagesPullingTime="5.291379666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:42.857328647 +0000 UTC m=+61.877879874" watchObservedRunningTime="2026-07-01 22:22:42.857745593 +0000 UTC m=+61.878296816" Jul 01 22:22:42.860047 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.860026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-mgtwb"] Jul 01 22:22:42.914352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.914311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nkq5\" (UniqueName: \"kubernetes.io/projected/060121e4-de31-42ec-ac6f-96188951d0cc-kube-api-access-7nkq5\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:42.914590 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.914409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/060121e4-de31-42ec-ac6f-96188951d0cc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:42.914590 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.914440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:42.914590 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:42.914473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.015497 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.015463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.015667 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.015505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.015667 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.015588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nkq5\" (UniqueName: \"kubernetes.io/projected/060121e4-de31-42ec-ac6f-96188951d0cc-kube-api-access-7nkq5\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.015769 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.015719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/060121e4-de31-42ec-ac6f-96188951d0cc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.016477 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.016452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/060121e4-de31-42ec-ac6f-96188951d0cc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.018214 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.018190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.018466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.018444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/060121e4-de31-42ec-ac6f-96188951d0cc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.032124 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.032097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nkq5\" (UniqueName: \"kubernetes.io/projected/060121e4-de31-42ec-ac6f-96188951d0cc-kube-api-access-7nkq5\") pod \"prometheus-operator-7b7d896497-mgtwb\" (UID: \"060121e4-de31-42ec-ac6f-96188951d0cc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.154680 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.154649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" Jul 01 22:22:43.316028 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.315939 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-mgtwb"] Jul 01 22:22:43.319803 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:43.319777 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060121e4_de31_42ec_ac6f_96188951d0cc.slice/crio-a12a560a4fc1dde47a6817b20a18908f5da33659c851ea34aa6bfd7664fc9a47 WatchSource:0}: Error finding container a12a560a4fc1dde47a6817b20a18908f5da33659c851ea34aa6bfd7664fc9a47: Status 404 returned error can't find the container with id a12a560a4fc1dde47a6817b20a18908f5da33659c851ea34aa6bfd7664fc9a47 Jul 01 22:22:43.828356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:43.828322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" event={"ID":"060121e4-de31-42ec-ac6f-96188951d0cc","Type":"ContainerStarted","Data":"a12a560a4fc1dde47a6817b20a18908f5da33659c851ea34aa6bfd7664fc9a47"} Jul 01 22:22:44.832579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:44.832539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qhs8j" event={"ID":"54a67656-66f0-4da5-8db4-58d13e6489d8","Type":"ContainerStarted","Data":"b02e567950d90b9afcb74f2ef5d425d2ec47947f51c97f8b7aa021c3ffcc3379"} Jul 01 22:22:44.857870 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:44.857807 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qhs8j" podStartSLOduration=1.540590642 podStartE2EDuration="9.857791306s" totalImagesPullingTime="8.317200664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:22:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:44.857126785 +0000 UTC m=+63.877678009" watchObservedRunningTime="2026-07-01 22:22:44.857791306 +0000 UTC m=+63.878342567" Jul 01 22:22:45.839014 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:45.838902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" event={"ID":"060121e4-de31-42ec-ac6f-96188951d0cc","Type":"ContainerStarted","Data":"5d0e1974d1cfb84314556bf8208476a69a9367f655851742ea6eb6404c59ac02"} Jul 01 22:22:45.839014 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:45.838974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" event={"ID":"060121e4-de31-42ec-ac6f-96188951d0cc","Type":"ContainerStarted","Data":"264a49e2e57e747e41aaa965fa48782e3eb60f4576e99b12bbde1d78ad0c2e4f"} Jul 01 22:22:45.860435 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:45.860343 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-mgtwb" podStartSLOduration=1.541827877 podStartE2EDuration="3.860321075s" totalImagesPullingTime="2.318493198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:45.859103439 +0000 UTC m=+64.879654664" watchObservedRunningTime="2026-07-01 22:22:45.860321075 +0000 UTC m=+64.880872301" Jul 01 22:22:46.238625 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.238568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:46.238840 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.238668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:46.238840 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.238696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:46.241717 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.241694 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:22:46.241945 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.241927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:22:46.242760 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.242747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:22:46.251987 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.251959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4505d52-904f-4bd5-b0cb-b18930b7111a-original-pull-secret\") pod \"global-pull-secret-syncer-ksgr7\" (UID: \"f4505d52-904f-4bd5-b0cb-b18930b7111a\") " pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:46.252611 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.252591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5e2ff3e-e306-4e63-9cf6-f273ed049a20-metrics-certs\") pod \"network-metrics-daemon-6lntk\" (UID: \"f5e2ff3e-e306-4e63-9cf6-f273ed049a20\") " pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:46.253402 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.253386 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:22:46.263051 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.263032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dkl4\" (UniqueName: \"kubernetes.io/projected/b65d92aa-790c-49eb-946b-acf6f8e52632-kube-api-access-6dkl4\") pod \"network-check-target-vhhn5\" (UID: \"b65d92aa-790c-49eb-946b-acf6f8e52632\") " pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:46.430961 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.430937 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-smgl4\"" Jul 01 22:22:46.438541 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.438519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lntk" Jul 01 22:22:46.440725 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.440591 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7p2h\"" Jul 01 22:22:46.446090 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.446070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ksgr7" Jul 01 22:22:46.447734 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.447715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:46.580744 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.580709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6lntk"] Jul 01 22:22:46.584237 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:46.584206 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e2ff3e_e306_4e63_9cf6_f273ed049a20.slice/crio-2b519b2ccdafed545261ff0abdb02ab438f0376cdab8844d4a04db5659412a6b WatchSource:0}: Error finding container 2b519b2ccdafed545261ff0abdb02ab438f0376cdab8844d4a04db5659412a6b: Status 404 returned error can't find the container with id 2b519b2ccdafed545261ff0abdb02ab438f0376cdab8844d4a04db5659412a6b Jul 01 22:22:46.812066 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.812011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhhn5"] Jul 01 22:22:46.812871 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.812834 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ksgr7"] Jul 01 22:22:46.813787 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:46.813761 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4505d52_904f_4bd5_b0cb_b18930b7111a.slice/crio-82ccd70e9b7b0d099715c65742d37f9e5284e6fe4ab64c39954ca566715ffc94 WatchSource:0}: Error finding container 82ccd70e9b7b0d099715c65742d37f9e5284e6fe4ab64c39954ca566715ffc94: Status 404 returned error can't find the container with id 82ccd70e9b7b0d099715c65742d37f9e5284e6fe4ab64c39954ca566715ffc94 Jul 01 22:22:46.814412 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:46.814394 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65d92aa_790c_49eb_946b_acf6f8e52632.slice/crio-a612dd39168c60fadc748b64b2f5abfa539c2732889d9efffdde8d38cc04cc49 WatchSource:0}: Error finding container a612dd39168c60fadc748b64b2f5abfa539c2732889d9efffdde8d38cc04cc49: Status 404 returned error can't find the container with id a612dd39168c60fadc748b64b2f5abfa539c2732889d9efffdde8d38cc04cc49 Jul 01 22:22:46.843222 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.843191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lntk" event={"ID":"f5e2ff3e-e306-4e63-9cf6-f273ed049a20","Type":"ContainerStarted","Data":"2b519b2ccdafed545261ff0abdb02ab438f0376cdab8844d4a04db5659412a6b"} Jul 01 22:22:46.844297 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.844274 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhhn5" event={"ID":"b65d92aa-790c-49eb-946b-acf6f8e52632","Type":"ContainerStarted","Data":"a612dd39168c60fadc748b64b2f5abfa539c2732889d9efffdde8d38cc04cc49"} Jul 01 22:22:46.845315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:46.845297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ksgr7" event={"ID":"f4505d52-904f-4bd5-b0cb-b18930b7111a","Type":"ContainerStarted","Data":"82ccd70e9b7b0d099715c65742d37f9e5284e6fe4ab64c39954ca566715ffc94"} Jul 01 22:22:47.853685 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:47.853635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lntk" event={"ID":"f5e2ff3e-e306-4e63-9cf6-f273ed049a20","Type":"ContainerStarted","Data":"badd59a53d7cb988ab863e30fa7165aa0ac4ea1fd9c3e5a98ed5f6c548d61bb9"} Jul 01 22:22:47.854203 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:47.853747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lntk" event={"ID":"f5e2ff3e-e306-4e63-9cf6-f273ed049a20","Type":"ContainerStarted","Data":"9552cde6c532e9c07bf39607803b5522a122809de65c1701bfe00682fed0a6f7"} Jul 01 22:22:48.370248 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.370176 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6lntk" podStartSLOduration=66.533963461 podStartE2EDuration="1m7.370152973s" totalImagesPullingTime="836.189512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:47.876931867 +0000 UTC m=+66.897483093" watchObservedRunningTime="2026-07-01 22:22:48.370152973 +0000 UTC m=+67.390704199" Jul 01 22:22:48.370493 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.370478 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz"] Jul 01 22:22:48.373110 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.373031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.377875 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.377827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 22:22:48.378883 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.378847 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wqpqw\"" Jul 01 22:22:48.378984 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.378887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 22:22:48.423798 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.423750 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz"] Jul 01 22:22:48.448066 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.448031 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pm6n2"] Jul 01 22:22:48.450521 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.450496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.455381 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.455350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.455502 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.455400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.455502 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.455450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 22:22:48.455813 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.455786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.455944 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.455845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv829\" (UniqueName: \"kubernetes.io/projected/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-kube-api-access-pv829\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.457155 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.457135 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t6jwk\"" Jul 01 22:22:48.467180 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.467083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 22:22:48.467180 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.467135 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 22:22:48.476073 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.475818 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6cnmj"] Jul 01 22:22:48.478505 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.478484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.482427 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.482390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 22:22:48.490345 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.490322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 22:22:48.490612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.490594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h64q6\"" Jul 01 22:22:48.490958 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.490875 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 22:22:48.504708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.504623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pm6n2"] Jul 01 22:22:48.557430 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49f7d556-42f9-4066-9fc4-7eba00c9f45a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.557895 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.557895 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.558085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.558085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-root\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.557987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.558085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.558085 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-wtmp\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558323 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558323 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn2jh\" (UniqueName: \"kubernetes.io/projected/de21620d-ddfc-4824-9923-d2038bc52c1b-kube-api-access-bn2jh\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558323 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558323 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrrq\" (UniqueName: \"kubernetes.io/projected/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-api-access-zrrrq\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-textfile\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-metrics-client-ca\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv829\" (UniqueName: \"kubernetes.io/projected/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-kube-api-access-pv829\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.558512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.558494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-sys\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.559693 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.559649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.561898 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.561846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.561898 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.561884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.572988 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.572964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv829\" (UniqueName: \"kubernetes.io/projected/fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f-kube-api-access-pv829\") pod \"openshift-state-metrics-57f99c8b49-h5qgz\" (UID: \"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.659104 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-sys\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659104 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49f7d556-42f9-4066-9fc4-7eba00c9f45a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659104 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-root\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-wtmp\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn2jh\" (UniqueName: \"kubernetes.io/projected/de21620d-ddfc-4824-9923-d2038bc52c1b-kube-api-access-bn2jh\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659371 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrrq\" (UniqueName: \"kubernetes.io/projected/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-api-access-zrrrq\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.659821 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-textfile\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659821 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-metrics-client-ca\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659821 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.659736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-sys\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.659821 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:48.659799 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 22:22:48.660031 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:48.659877 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls podName:de21620d-ddfc-4824-9923-d2038bc52c1b nodeName:}" failed. No retries permitted until 2026-07-01 22:22:49.15983805 +0000 UTC m=+68.180389271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls") pod "node-exporter-6cnmj" (UID: "de21620d-ddfc-4824-9923-d2038bc52c1b") : secret "node-exporter-tls" not found Jul 01 22:22:48.660095 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:48.660081 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 01 22:22:48.660423 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:48.660154 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls podName:49f7d556-42f9-4066-9fc4-7eba00c9f45a nodeName:}" failed. No retries permitted until 2026-07-01 22:22:49.160134667 +0000 UTC m=+68.180685884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-pm6n2" (UID: "49f7d556-42f9-4066-9fc4-7eba00c9f45a") : secret "kube-state-metrics-tls" not found Jul 01 22:22:48.660423 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-root\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.660423 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-wtmp\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.660423 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-metrics-client-ca\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.660708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/49f7d556-42f9-4066-9fc4-7eba00c9f45a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.660708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.660708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.660702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.661036 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.661016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-textfile\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.661144 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.661068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.662900 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.662877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.663617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.663594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.674097 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.674067 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrrq\" (UniqueName: \"kubernetes.io/projected/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-api-access-zrrrq\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:48.675146 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.675119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn2jh\" (UniqueName: \"kubernetes.io/projected/de21620d-ddfc-4824-9923-d2038bc52c1b-kube-api-access-bn2jh\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:48.685314 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.685294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" Jul 01 22:22:48.852004 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:48.851794 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz"] Jul 01 22:22:49.162990 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.162948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:49.163471 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.163053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:49.166014 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.165986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f7d556-42f9-4066-9fc4-7eba00c9f45a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-pm6n2\" (UID: \"49f7d556-42f9-4066-9fc4-7eba00c9f45a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:49.166220 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.166159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de21620d-ddfc-4824-9923-d2038bc52c1b-node-exporter-tls\") pod \"node-exporter-6cnmj\" (UID: \"de21620d-ddfc-4824-9923-d2038bc52c1b\") " pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:49.363096 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.363062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" Jul 01 22:22:49.389417 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.389379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cnmj" Jul 01 22:22:49.424508 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.424166 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:22:49.430991 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.430961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.435576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.435322 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 22:22:49.435576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.435344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 22:22:49.435576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.435378 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 22:22:49.435887 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.435846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 22:22:49.435974 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.435955 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 22:22:49.436122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.436089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 22:22:49.436193 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.436106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 22:22:49.436193 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.436110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 22:22:49.436556 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.436531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 22:22:49.436651 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.436544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zzz58\"" Jul 01 22:22:49.452208 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.452147 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:22:49.465264 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465397 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465397 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465397 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465601 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465651 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465711 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465757 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465800 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465840 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465912 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxcsc\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.465955 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.466006 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.465980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568122 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.567680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxcsc\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568693 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:22:49.568174 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle podName:cb86762c-7bec-4812-991a-7686f318e086 nodeName:}" failed. No retries permitted until 2026-07-01 22:22:50.068150736 +0000 UTC m=+69.088701944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "cb86762c-7bec-4812-991a-7686f318e086") : configmap references non-existent config key: ca-bundle.crt Jul 01 22:22:49.568693 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.568391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568798 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.568737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568798 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.568786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.568925 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.568820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.573485 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.573106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.573485 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.573216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.574797 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.574633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.578575 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.578551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.579996 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.579304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.581659 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.581445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.581659 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.581602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.581930 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.581908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.582008 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.581932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.582079 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.582055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.582671 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.582652 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.584528 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:49.584504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxcsc\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:49.957485 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:49.957447 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1d5e4a_54f3_4209_8b19_dd6293a2bc7f.slice/crio-41565db30c2810410f216c1490c40ea606fdfde260ff4bf14c8a6cd560c49910 WatchSource:0}: Error finding container 41565db30c2810410f216c1490c40ea606fdfde260ff4bf14c8a6cd560c49910: Status 404 returned error can't find the container with id 41565db30c2810410f216c1490c40ea606fdfde260ff4bf14c8a6cd560c49910 Jul 01 22:22:49.970323 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:49.970295 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde21620d_ddfc_4824_9923_d2038bc52c1b.slice/crio-3364d51f6fe7a1989d1ce709d2c63be7e1aa217df3d310a4cf577177db7a6a16 WatchSource:0}: Error finding container 3364d51f6fe7a1989d1ce709d2c63be7e1aa217df3d310a4cf577177db7a6a16: Status 404 returned error can't find the container with id 3364d51f6fe7a1989d1ce709d2c63be7e1aa217df3d310a4cf577177db7a6a16 Jul 01 22:22:50.073522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.073483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:50.074416 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.074395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:50.102462 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.102433 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-pm6n2"] Jul 01 22:22:50.106017 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:50.105993 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f7d556_42f9_4066_9fc4_7eba00c9f45a.slice/crio-c6fd3bfc507f4d4030ba0da3d1d6d2f9ed0d428668fae7f38e732dd9fe5aef22 WatchSource:0}: Error finding container c6fd3bfc507f4d4030ba0da3d1d6d2f9ed0d428668fae7f38e732dd9fe5aef22: Status 404 returned error can't find the container with id c6fd3bfc507f4d4030ba0da3d1d6d2f9ed0d428668fae7f38e732dd9fe5aef22 Jul 01 22:22:50.343330 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.343304 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:22:50.866702 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.866662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" event={"ID":"49f7d556-42f9-4066-9fc4-7eba00c9f45a","Type":"ContainerStarted","Data":"c6fd3bfc507f4d4030ba0da3d1d6d2f9ed0d428668fae7f38e732dd9fe5aef22"} Jul 01 22:22:50.868137 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.868104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cnmj" event={"ID":"de21620d-ddfc-4824-9923-d2038bc52c1b","Type":"ContainerStarted","Data":"3364d51f6fe7a1989d1ce709d2c63be7e1aa217df3d310a4cf577177db7a6a16"} Jul 01 22:22:50.870271 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.870238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" event={"ID":"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f","Type":"ContainerStarted","Data":"5d10eee757998912cf57d7443f81125f6da698253aac33a1ff0f5d51bf806376"} Jul 01 22:22:50.870380 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.870294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" event={"ID":"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f","Type":"ContainerStarted","Data":"7a02c8695e59c1b109b49f3261b9000cdbe46398af5449374e27b5d517167c59"} Jul 01 22:22:50.870380 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:50.870314 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" event={"ID":"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f","Type":"ContainerStarted","Data":"41565db30c2810410f216c1490c40ea606fdfde260ff4bf14c8a6cd560c49910"} Jul 01 22:22:51.879789 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:51.879755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhhn5" event={"ID":"b65d92aa-790c-49eb-946b-acf6f8e52632","Type":"ContainerStarted","Data":"2ab9c4a2228ab0430eefad76ae2f782dddb568a6f736efc5c417a776d1631fc3"} Jul 01 22:22:51.880207 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:51.880028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:22:51.904278 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:51.904222 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vhhn5" podStartSLOduration=65.930657592 podStartE2EDuration="1m10.90420206s" totalImagesPullingTime="4.973544468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:51.903257914 +0000 UTC m=+70.923809139" watchObservedRunningTime="2026-07-01 22:22:51.90420206 +0000 UTC m=+70.924753286" Jul 01 22:22:51.923090 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:51.923066 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:22:51.925192 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:51.925163 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb86762c_7bec_4812_991a_7686f318e086.slice/crio-4e63e85ec70cf08633f26a0adadff4db86418cb8b7232f58081945174e951416 WatchSource:0}: Error finding container 4e63e85ec70cf08633f26a0adadff4db86418cb8b7232f58081945174e951416: Status 404 returned error can't find the container with id 4e63e85ec70cf08633f26a0adadff4db86418cb8b7232f58081945174e951416 Jul 01 22:22:52.830584 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.830498 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k6t78" Jul 01 22:22:52.885389 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.885352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"4e63e85ec70cf08633f26a0adadff4db86418cb8b7232f58081945174e951416"} Jul 01 22:22:52.887320 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.887279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ksgr7" event={"ID":"f4505d52-904f-4bd5-b0cb-b18930b7111a","Type":"ContainerStarted","Data":"64bb99935b9aab43579f7e23ab08b3943d261a2e328706b05920ce214cd2d8bd"} Jul 01 22:22:52.912110 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.912060 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ksgr7" podStartSLOduration=66.922527227 podStartE2EDuration="1m11.912043068s" totalImagesPullingTime="4.989515841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:52.910201799 +0000 UTC m=+71.930753034" watchObservedRunningTime="2026-07-01 22:22:52.912043068 +0000 UTC m=+71.932594300" Jul 01 22:22:52.924093 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.924065 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-687679989c-zlmbh"] Jul 01 22:22:52.926478 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.926461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:52.929462 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.929432 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 22:22:52.929606 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.929473 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 22:22:52.929606 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.929571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6bsfb\"" Jul 01 22:22:52.929807 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.929751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 22:22:52.929807 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.929795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-79if63678dga\"" Jul 01 22:22:52.930074 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.930059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 22:22:52.943753 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:52.941704 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-687679989c-zlmbh"] Jul 01 22:22:53.000275 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.000242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-metrics-server-audit-profiles\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-client-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002359 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-client-certs\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002538 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsk4\" (UniqueName: \"kubernetes.io/projected/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-kube-api-access-pjsk4\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002651 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002651 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-tls\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.002651 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.002623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-audit-log\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103250 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-client-certs\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103408 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsk4\" (UniqueName: \"kubernetes.io/projected/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-kube-api-access-pjsk4\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103408 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103408 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-tls\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103408 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-audit-log\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103620 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-metrics-server-audit-profiles\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.103620 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.103468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-client-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.104277 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.104195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-audit-log\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.104444 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.104421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.105123 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.105088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-metrics-server-audit-profiles\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.106985 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.106937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-tls\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.107395 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.107350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-secret-metrics-server-client-certs\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.108543 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.108404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-client-ca-bundle\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.122173 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.121922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsk4\" (UniqueName: \"kubernetes.io/projected/a6bb6b95-3008-48b5-af50-4a5fb0b6401f-kube-api-access-pjsk4\") pod \"metrics-server-687679989c-zlmbh\" (UID: \"a6bb6b95-3008-48b5-af50-4a5fb0b6401f\") " pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.236633 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.236571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:22:53.387624 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.387540 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-687679989c-zlmbh"] Jul 01 22:22:53.614917 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:53.614884 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bb6b95_3008_48b5_af50_4a5fb0b6401f.slice/crio-c1d64923cbef987f01a9ab1c9d4f78bad176d8c1dcf66058c6e37d1198404f21 WatchSource:0}: Error finding container c1d64923cbef987f01a9ab1c9d4f78bad176d8c1dcf66058c6e37d1198404f21: Status 404 returned error can't find the container with id c1d64923cbef987f01a9ab1c9d4f78bad176d8c1dcf66058c6e37d1198404f21 Jul 01 22:22:53.685484 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.685461 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-764d9dd659-w66zq"] Jul 01 22:22:53.687945 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.687929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.690678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690657 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 22:22:53.690769 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690658 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 22:22:53.690823 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2c7fx\"" Jul 01 22:22:53.690823 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 22:22:53.690949 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690823 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 22:22:53.690949 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.690660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 22:22:53.697133 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.697114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 22:22:53.706231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.704847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-764d9dd659-w66zq"] Jul 01 22:22:53.808907 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.808849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809086 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.808921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2f57\" (UniqueName: \"kubernetes.io/projected/f9614e66-d48a-4ce8-8477-849946c98879-kube-api-access-d2f57\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809086 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.808944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-federate-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809086 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.808966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-metrics-client-ca\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809086 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.808990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809211 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.809088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809211 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.809120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.809211 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.809145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-serving-certs-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.893248 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.893217 2577 generic.go:356] "Generic (PLEG): container finished" podID="de21620d-ddfc-4824-9923-d2038bc52c1b" containerID="355c1aa0cf90e8479c93e6b2c642e5f566f9a9d897dd183796fb17c672061d3a" exitCode=0 Jul 01 22:22:53.893662 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.893284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cnmj" event={"ID":"de21620d-ddfc-4824-9923-d2038bc52c1b","Type":"ContainerDied","Data":"355c1aa0cf90e8479c93e6b2c642e5f566f9a9d897dd183796fb17c672061d3a"} Jul 01 22:22:53.895546 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.895469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" event={"ID":"fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f","Type":"ContainerStarted","Data":"065ea2f6010f7ca781f1204de39e5f09defe07245f69e81298fa7c732a30cfd7"} Jul 01 22:22:53.896650 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.896627 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" event={"ID":"a6bb6b95-3008-48b5-af50-4a5fb0b6401f","Type":"ContainerStarted","Data":"c1d64923cbef987f01a9ab1c9d4f78bad176d8c1dcf66058c6e37d1198404f21"} Jul 01 22:22:53.898842 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.898819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" event={"ID":"49f7d556-42f9-4066-9fc4-7eba00c9f45a","Type":"ContainerStarted","Data":"0bda37f5c1a34b36ae96d524efdf1f0e8be86d15cdeba71a8f76b49f1c147a96"} Jul 01 22:22:53.898954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.898898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" event={"ID":"49f7d556-42f9-4066-9fc4-7eba00c9f45a","Type":"ContainerStarted","Data":"0c4a4e1576ec083b4774405508cd0e2268c6a7476dbe0581ddd69b0e9e3005fb"} Jul 01 22:22:53.898954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.898930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" event={"ID":"49f7d556-42f9-4066-9fc4-7eba00c9f45a","Type":"ContainerStarted","Data":"be9d40f449d1978a76f2ce59bae60375ce497d1120ecacff01242d48057a0e7f"} Jul 01 22:22:53.900300 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.900279 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0" exitCode=0 Jul 01 22:22:53.900380 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.900327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0"} Jul 01 22:22:53.909954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.909877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2f57\" (UniqueName: \"kubernetes.io/projected/f9614e66-d48a-4ce8-8477-849946c98879-kube-api-access-d2f57\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.909954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.909917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-federate-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.909954 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.909950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-metrics-client-ca\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.909986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910253 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910253 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-serving-certs-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910253 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910723 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-metrics-client-ca\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.910915 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-serving-certs-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.911066 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.910903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.912687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.912660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.912783 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.912670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-secret-telemeter-client\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.912867 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.912806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-federate-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.913019 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.912998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9614e66-d48a-4ce8-8477-849946c98879-telemeter-client-tls\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.920113 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.920089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2f57\" (UniqueName: \"kubernetes.io/projected/f9614e66-d48a-4ce8-8477-849946c98879-kube-api-access-d2f57\") pod \"telemeter-client-764d9dd659-w66zq\" (UID: \"f9614e66-d48a-4ce8-8477-849946c98879\") " pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:53.937248 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.937208 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-h5qgz" podStartSLOduration=3.299768528 podStartE2EDuration="5.937194772s" totalImagesPullingTime="2.637426244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:53.936179972 +0000 UTC m=+72.956731196" watchObservedRunningTime="2026-07-01 22:22:53.937194772 +0000 UTC m=+72.957745995" Jul 01 22:22:53.956890 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.956828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-pm6n2" podStartSLOduration=3.097473122 podStartE2EDuration="5.956813969s" totalImagesPullingTime="2.859340847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:53.956265197 +0000 UTC m=+72.976816437" watchObservedRunningTime="2026-07-01 22:22:53.956813969 +0000 UTC m=+72.977365193" Jul 01 22:22:53.997764 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:53.997723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" Jul 01 22:22:54.138789 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.138763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-764d9dd659-w66zq"] Jul 01 22:22:54.140620 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:54.140593 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9614e66_d48a_4ce8_8477_849946c98879.slice/crio-760ec058e0bb96d3b4130c0415e06070148ab4a5acf2db11286d37d8de94c810 WatchSource:0}: Error finding container 760ec058e0bb96d3b4130c0415e06070148ab4a5acf2db11286d37d8de94c810: Status 404 returned error can't find the container with id 760ec058e0bb96d3b4130c0415e06070148ab4a5acf2db11286d37d8de94c810 Jul 01 22:22:54.525292 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.525261 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:22:54.529093 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.529070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.532518 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.532317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 22:22:54.532518 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.532412 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 22:22:54.532770 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.532755 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 22:22:54.533231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.532998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 22:22:54.533231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 22:22:54.533231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-md72c\"" Jul 01 22:22:54.533231 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 22:22:54.533507 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533364 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 22:22:54.533507 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 22:22:54.533708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533686 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 22:22:54.533809 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533731 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fbnjh1h5rsos\"" Jul 01 22:22:54.533809 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.533786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 22:22:54.534051 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.534031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 22:22:54.534365 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.534348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 22:22:54.534887 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.534705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 22:22:54.538035 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.538013 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 22:22:54.553676 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.553650 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:22:54.617927 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.617890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.617936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.617968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7z56\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.618726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.618569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.719961 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.719911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.719961 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.719961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720258 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.720636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.721061 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.720645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7z56\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.721677 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.721632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.722575 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.722276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.722575 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.722359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.722575 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.722419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.723585 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.723525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.724382 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.724354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.724479 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.724378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.724546 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.724495 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.727425 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.727371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.727703 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.727644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.728440 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.728394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.728984 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.728941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.729564 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.729521 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.730383 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.730338 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.731249 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.731200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.731974 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.731703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.731974 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.731937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.732558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.732508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.734471 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.734429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7z56\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.737776 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.737619 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.842715 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.842386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:22:54.909257 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.909013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cnmj" event={"ID":"de21620d-ddfc-4824-9923-d2038bc52c1b","Type":"ContainerStarted","Data":"88c78dc8f6b4d6b816718ef6c222ce96e6c35554e9306a9f4743aecf81970d33"} Jul 01 22:22:54.909257 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.909119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cnmj" event={"ID":"de21620d-ddfc-4824-9923-d2038bc52c1b","Type":"ContainerStarted","Data":"36c2f21d3a2199aa2f0233f5cd2f818212c0b9eb78684cdf16827da61fd548bd"} Jul 01 22:22:54.910708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.910613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" event={"ID":"f9614e66-d48a-4ce8-8477-849946c98879","Type":"ContainerStarted","Data":"760ec058e0bb96d3b4130c0415e06070148ab4a5acf2db11286d37d8de94c810"} Jul 01 22:22:54.928674 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:54.928616 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6cnmj" podStartSLOduration=3.840793191 podStartE2EDuration="6.928596207s" totalImagesPullingTime="2.992107806s" totalInitContainerRuntime="95.69521ms" isStatefulPod=true podCreationTimestamp="2026-07-01 22:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:54.928253232 +0000 UTC m=+73.948804456" watchObservedRunningTime="2026-07-01 22:22:54.928596207 +0000 UTC m=+73.949147432" Jul 01 22:22:55.443618 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:55.443584 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:22:55.791485 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:22:55.791417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087522b0_c1e1_4c37_ac04_8fd6241c46de.slice/crio-f2a7a26ad7af81c02fa8996b5815145113106d44496b96cfc44ca4e7bc459b95 WatchSource:0}: Error finding container f2a7a26ad7af81c02fa8996b5815145113106d44496b96cfc44ca4e7bc459b95: Status 404 returned error can't find the container with id f2a7a26ad7af81c02fa8996b5815145113106d44496b96cfc44ca4e7bc459b95 Jul 01 22:22:55.917820 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:55.917783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" event={"ID":"a6bb6b95-3008-48b5-af50-4a5fb0b6401f","Type":"ContainerStarted","Data":"58334f2e0df232854444920a618998a09bc85f4df40f2886d2a19e8332684ab9"} Jul 01 22:22:55.919263 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:55.919232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"f2a7a26ad7af81c02fa8996b5815145113106d44496b96cfc44ca4e7bc459b95"} Jul 01 22:22:55.938659 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:55.938608 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" podStartSLOduration=2.249050211 podStartE2EDuration="3.938592455s" totalImagesPullingTime="1.689542244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:55.937349588 +0000 UTC m=+74.957900818" watchObservedRunningTime="2026-07-01 22:22:55.938592455 +0000 UTC m=+74.959143678" Jul 01 22:22:56.926909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.926779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec"} Jul 01 22:22:56.927244 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.926929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6"} Jul 01 22:22:56.927244 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.926980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20"} Jul 01 22:22:56.927244 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.927013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801"} Jul 01 22:22:56.927244 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.927045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5"} Jul 01 22:22:56.928704 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.928683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" event={"ID":"f9614e66-d48a-4ce8-8477-849946c98879","Type":"ContainerStarted","Data":"10c8ad453d2a9fefe5caf369f2b193e51628ffb44241e5f34a70028cdf7cee4b"} Jul 01 22:22:56.928829 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.928724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" event={"ID":"f9614e66-d48a-4ce8-8477-849946c98879","Type":"ContainerStarted","Data":"03e1c89027e57cf3f6a3ad82ba0d611840c2467531392fb9804f77eab08fac1d"} Jul 01 22:22:56.928829 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.928787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" event={"ID":"f9614e66-d48a-4ce8-8477-849946c98879","Type":"ContainerStarted","Data":"2b8b9e189b6795a028432263e304df291abe604de6835d8d34c2c595af350219"} Jul 01 22:22:56.930196 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.930178 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" exitCode=0 Jul 01 22:22:56.930276 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.930252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} Jul 01 22:22:56.959336 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:56.959286 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-764d9dd659-w66zq" podStartSLOduration=1.792254159 podStartE2EDuration="3.959267922s" totalImagesPullingTime="2.167013763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:56.957432609 +0000 UTC m=+75.977983833" watchObservedRunningTime="2026-07-01 22:22:56.959267922 +0000 UTC m=+75.979819146" Jul 01 22:22:57.944088 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:57.944048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerStarted","Data":"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3"} Jul 01 22:22:58.002762 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:22:58.002654 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.147739254 podStartE2EDuration="9.002631302s" totalImagesPullingTime="4.830094351s" totalInitContainerRuntime="24.797697ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:57.999523301 +0000 UTC m=+77.020074525" watchObservedRunningTime="2026-07-01 22:22:58.002631302 +0000 UTC m=+77.023182527" Jul 01 22:23:00.959296 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:00.959220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} Jul 01 22:23:00.959296 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:00.959284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} Jul 01 22:23:02.973591 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:02.973558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} Jul 01 22:23:03.980425 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:03.980394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} Jul 01 22:23:03.980802 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:03.980454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} Jul 01 22:23:03.980802 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:03.980480 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerStarted","Data":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} Jul 01 22:23:04.015919 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:04.015867 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.212011754 podStartE2EDuration="10.015837766s" totalImagesPullingTime="5.775288916s" totalInitContainerRuntime="28.537096ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:23:04.01315283 +0000 UTC m=+83.033704057" watchObservedRunningTime="2026-07-01 22:23:04.015837766 +0000 UTC m=+83.036388990" Jul 01 22:23:04.843118 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:04.843087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:23:13.237261 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:13.237220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:23:13.237775 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:13.237290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:23:22.890126 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:22.890094 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vhhn5" Jul 01 22:23:24.278228 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:24.278195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/init-config-reloader/0.log" Jul 01 22:23:24.285024 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:24.285001 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/alertmanager/0.log" Jul 01 22:23:24.442772 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:24.442741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/config-reloader/0.log" Jul 01 22:23:24.638917 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:24.638820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/kube-rbac-proxy-web/0.log" Jul 01 22:23:24.835604 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:24.835576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/kube-rbac-proxy/0.log" Jul 01 22:23:25.035035 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:25.035007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/kube-rbac-proxy-metric/0.log" Jul 01 22:23:25.244286 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:25.244259 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb86762c-7bec-4812-991a-7686f318e086/prom-label-proxy/0.log" Jul 01 22:23:25.636136 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:25.636104 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-state-metrics/0.log" Jul 01 22:23:25.834148 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:25.834123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-rbac-proxy-main/0.log" Jul 01 22:23:26.035501 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:26.035469 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-rbac-proxy-self/0.log" Jul 01 22:23:26.238694 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:26.238664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-687679989c-zlmbh_a6bb6b95-3008-48b5-af50-4a5fb0b6401f/metrics-server/0.log" Jul 01 22:23:26.634038 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:26.634015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/init-textfile/0.log" Jul 01 22:23:26.836003 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:26.835963 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/node-exporter/0.log" Jul 01 22:23:27.034715 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:27.034690 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/kube-rbac-proxy/0.log" Jul 01 22:23:28.435679 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:28.435651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/kube-rbac-proxy-main/0.log" Jul 01 22:23:28.634745 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:28.634704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/kube-rbac-proxy-self/0.log" Jul 01 22:23:28.835048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:28.835023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/openshift-state-metrics/0.log" Jul 01 22:23:29.035676 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:29.035651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/init-config-reloader/0.log" Jul 01 22:23:29.236062 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:29.235992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/prometheus/0.log" Jul 01 22:23:29.435936 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:29.435906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/config-reloader/0.log" Jul 01 22:23:29.638139 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:29.638115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/thanos-sidecar/0.log" Jul 01 22:23:29.835220 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:29.835194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/kube-rbac-proxy-web/0.log" Jul 01 22:23:30.035374 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:30.035345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/kube-rbac-proxy/0.log" Jul 01 22:23:30.235242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:30.235212 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_087522b0-c1e1-4c37-ac04-8fd6241c46de/kube-rbac-proxy-thanos/0.log" Jul 01 22:23:30.437900 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:30.437806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-mgtwb_060121e4-de31-42ec-ac6f-96188951d0cc/prometheus-operator/0.log" Jul 01 22:23:30.635522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:30.635495 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-mgtwb_060121e4-de31-42ec-ac6f-96188951d0cc/kube-rbac-proxy/0.log" Jul 01 22:23:30.835174 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:30.835116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-6hxhf_acc5d231-71cd-4532-8113-f7baec18344b/prometheus-operator-admission-webhook/0.log" Jul 01 22:23:31.035354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:31.035310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/telemeter-client/0.log" Jul 01 22:23:31.234740 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:31.234663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/reload/0.log" Jul 01 22:23:31.435586 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:31.435550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/kube-rbac-proxy/0.log" Jul 01 22:23:33.242504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:33.242478 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:23:33.246355 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:33.246320 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-687679989c-zlmbh" Jul 01 22:23:54.843568 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:54.843521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:23:54.863283 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:54.863259 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:23:55.197187 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:23:55.197112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:08.677245 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677213 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:08.677710 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677531 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="alertmanager" containerID="cri-o://c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" gracePeriod=120 Jul 01 22:24:08.677710 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677585 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-metric" containerID="cri-o://a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" gracePeriod=120 Jul 01 22:24:08.677710 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677617 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-web" containerID="cri-o://6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" gracePeriod=120 Jul 01 22:24:08.677710 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677644 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="config-reloader" containerID="cri-o://3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" gracePeriod=120 Jul 01 22:24:08.677959 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677692 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy" containerID="cri-o://2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" gracePeriod=120 Jul 01 22:24:08.677959 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:08.677656 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="prom-label-proxy" containerID="cri-o://1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" gracePeriod=120 Jul 01 22:24:09.236714 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236686 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" exitCode=0 Jul 01 22:24:09.236714 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236708 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" exitCode=0 Jul 01 22:24:09.236714 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236716 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" exitCode=0 Jul 01 22:24:09.236714 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236721 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" exitCode=0 Jul 01 22:24:09.236986 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3"} Jul 01 22:24:09.236986 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6"} Jul 01 22:24:09.236986 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801"} Jul 01 22:24:09.236986 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.236891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5"} Jul 01 22:24:09.925271 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:09.925246 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.084130 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084094 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084303 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084140 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084303 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084165 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxcsc\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084303 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084194 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084303 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084237 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084303 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084291 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084313 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084358 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084382 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084411 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084464 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084491 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084485 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:24:10.084558 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084515 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume\") pod \"cb86762c-7bec-4812-991a-7686f318e086\" (UID: \"cb86762c-7bec-4812-991a-7686f318e086\") " Jul 01 22:24:10.084988 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.084788 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-main-db\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.087342 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087289 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.087475 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087354 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc" (OuterVolumeSpecName: "kube-api-access-nxcsc") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "kube-api-access-nxcsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:24:10.087572 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087547 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:24:10.087695 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087611 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.088160 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087915 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume" (OuterVolumeSpecName: "config-volume") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.088160 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087915 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:10.088160 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.087967 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:10.088364 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.088251 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.089246 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.089223 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.089700 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.089677 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out" (OuterVolumeSpecName: "config-out") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:24:10.091685 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.091667 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.097407 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.097385 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config" (OuterVolumeSpecName: "web-config") pod "cb86762c-7bec-4812-991a-7686f318e086" (UID: "cb86762c-7bec-4812-991a-7686f318e086"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:10.185275 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185248 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-main-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185275 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185274 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-cluster-tls-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185285 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185296 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-tls-assets\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185305 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185313 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb86762c-7bec-4812-991a-7686f318e086-config-out\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185321 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb86762c-7bec-4812-991a-7686f318e086-metrics-client-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185328 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-config-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185336 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185344 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxcsc\" (UniqueName: \"kubernetes.io/projected/cb86762c-7bec-4812-991a-7686f318e086-kube-api-access-nxcsc\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185353 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-web-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.185466 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.185362 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb86762c-7bec-4812-991a-7686f318e086-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:10.243798 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243762 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" exitCode=0 Jul 01 22:24:10.243798 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243793 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb86762c-7bec-4812-991a-7686f318e086" containerID="6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" exitCode=0 Jul 01 22:24:10.244018 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec"} Jul 01 22:24:10.244018 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243868 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.244018 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20"} Jul 01 22:24:10.244018 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb86762c-7bec-4812-991a-7686f318e086","Type":"ContainerDied","Data":"4e63e85ec70cf08633f26a0adadff4db86418cb8b7232f58081945174e951416"} Jul 01 22:24:10.244018 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.243978 2577 scope.go:117] "RemoveContainer" containerID="1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" Jul 01 22:24:10.252560 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.252542 2577 scope.go:117] "RemoveContainer" containerID="a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" Jul 01 22:24:10.259648 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.259626 2577 scope.go:117] "RemoveContainer" containerID="2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" Jul 01 22:24:10.266318 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.266302 2577 scope.go:117] "RemoveContainer" containerID="6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" Jul 01 22:24:10.269401 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.269380 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:10.273829 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.273735 2577 scope.go:117] "RemoveContainer" containerID="3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" Jul 01 22:24:10.276352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.276332 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:10.280976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.280959 2577 scope.go:117] "RemoveContainer" containerID="c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" Jul 01 22:24:10.287727 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.287712 2577 scope.go:117] "RemoveContainer" containerID="61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0" Jul 01 22:24:10.294563 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.294544 2577 scope.go:117] "RemoveContainer" containerID="1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" Jul 01 22:24:10.294823 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.294799 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3\": container with ID starting with 1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3 not found: ID does not exist" containerID="1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" Jul 01 22:24:10.294903 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.294833 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3"} err="failed to get container status \"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3\": rpc error: code = NotFound desc = could not find container \"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3\": container with ID starting with 1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3 not found: ID does not exist" Jul 01 22:24:10.294903 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.294882 2577 scope.go:117] "RemoveContainer" containerID="a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" Jul 01 22:24:10.295142 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.295124 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec\": container with ID starting with a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec not found: ID does not exist" containerID="a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" Jul 01 22:24:10.295193 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295150 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec"} err="failed to get container status \"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec\": rpc error: code = NotFound desc = could not find container \"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec\": container with ID starting with a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec not found: ID does not exist" Jul 01 22:24:10.295193 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295166 2577 scope.go:117] "RemoveContainer" containerID="2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" Jul 01 22:24:10.295384 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.295367 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6\": container with ID starting with 2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6 not found: ID does not exist" containerID="2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" Jul 01 22:24:10.295422 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295390 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6"} err="failed to get container status \"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6\": rpc error: code = NotFound desc = could not find container \"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6\": container with ID starting with 2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6 not found: ID does not exist" Jul 01 22:24:10.295422 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295406 2577 scope.go:117] "RemoveContainer" containerID="6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" Jul 01 22:24:10.295634 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.295620 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20\": container with ID starting with 6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20 not found: ID does not exist" containerID="6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" Jul 01 22:24:10.295675 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295636 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20"} err="failed to get container status \"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20\": rpc error: code = NotFound desc = could not find container \"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20\": container with ID starting with 6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20 not found: ID does not exist" Jul 01 22:24:10.295675 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295655 2577 scope.go:117] "RemoveContainer" containerID="3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" Jul 01 22:24:10.295919 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.295849 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801\": container with ID starting with 3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801 not found: ID does not exist" containerID="3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" Jul 01 22:24:10.296003 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295924 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801"} err="failed to get container status \"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801\": rpc error: code = NotFound desc = could not find container \"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801\": container with ID starting with 3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801 not found: ID does not exist" Jul 01 22:24:10.296003 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.295947 2577 scope.go:117] "RemoveContainer" containerID="c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" Jul 01 22:24:10.296179 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.296162 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5\": container with ID starting with c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5 not found: ID does not exist" containerID="c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" Jul 01 22:24:10.296218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296196 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5"} err="failed to get container status \"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5\": rpc error: code = NotFound desc = could not find container \"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5\": container with ID starting with c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5 not found: ID does not exist" Jul 01 22:24:10.296218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296209 2577 scope.go:117] "RemoveContainer" containerID="61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0" Jul 01 22:24:10.296439 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:10.296423 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0\": container with ID starting with 61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0 not found: ID does not exist" containerID="61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0" Jul 01 22:24:10.296491 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296443 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0"} err="failed to get container status \"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0\": rpc error: code = NotFound desc = could not find container \"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0\": container with ID starting with 61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0 not found: ID does not exist" Jul 01 22:24:10.296491 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296459 2577 scope.go:117] "RemoveContainer" containerID="1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3" Jul 01 22:24:10.296683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296667 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3"} err="failed to get container status \"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3\": rpc error: code = NotFound desc = could not find container \"1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3\": container with ID starting with 1e093be11260a957f84da5afd411cb581838656dd51ba855363d0fa4b895aae3 not found: ID does not exist" Jul 01 22:24:10.296726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296683 2577 scope.go:117] "RemoveContainer" containerID="a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec" Jul 01 22:24:10.296888 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296850 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec"} err="failed to get container status \"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec\": rpc error: code = NotFound desc = could not find container \"a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec\": container with ID starting with a763e91d817141b8d0c5f0da7edc39cfa64536dac0990d63f1b0c817166fa7ec not found: ID does not exist" Jul 01 22:24:10.296927 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.296890 2577 scope.go:117] "RemoveContainer" containerID="2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6" Jul 01 22:24:10.297109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297093 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6"} err="failed to get container status \"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6\": rpc error: code = NotFound desc = could not find container \"2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6\": container with ID starting with 2a33ddb0645493f2848b338984d7c92f8f7560911ce4182287456e8f1f5b36f6 not found: ID does not exist" Jul 01 22:24:10.297163 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297109 2577 scope.go:117] "RemoveContainer" containerID="6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20" Jul 01 22:24:10.297327 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297308 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20"} err="failed to get container status \"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20\": rpc error: code = NotFound desc = could not find container \"6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20\": container with ID starting with 6f06e6bd4229caec302a1f434990c23a71cb606a3c6499a785f83e562de43c20 not found: ID does not exist" Jul 01 22:24:10.297398 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297331 2577 scope.go:117] "RemoveContainer" containerID="3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801" Jul 01 22:24:10.297545 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297530 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801"} err="failed to get container status \"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801\": rpc error: code = NotFound desc = could not find container \"3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801\": container with ID starting with 3f83ddeb1a0e6ad324cc13587885a11efc29da5a86badb10e1241f0ce8df8801 not found: ID does not exist" Jul 01 22:24:10.297615 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297548 2577 scope.go:117] "RemoveContainer" containerID="c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5" Jul 01 22:24:10.297743 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297727 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5"} err="failed to get container status \"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5\": rpc error: code = NotFound desc = could not find container \"c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5\": container with ID starting with c3609aba9d38ecac0cfa0791a722caff103f26d68a9ebdc63846ffbbf1570db5 not found: ID does not exist" Jul 01 22:24:10.297807 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297745 2577 scope.go:117] "RemoveContainer" containerID="61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0" Jul 01 22:24:10.297981 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.297960 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0"} err="failed to get container status \"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0\": rpc error: code = NotFound desc = could not find container \"61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0\": container with ID starting with 61c17b4a17102a6cc817619e97083a1bb1332a523a7e90ce55bdd215abd3e5c0 not found: ID does not exist" Jul 01 22:24:10.302077 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302056 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:10.302359 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302343 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-metric" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302361 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-metric" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302373 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302379 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302387 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-web" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302393 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-web" Jul 01 22:24:10.302410 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302408 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="alertmanager" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302414 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="alertmanager" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302422 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="prom-label-proxy" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302430 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="prom-label-proxy" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302438 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="config-reloader" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302444 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="config-reloader" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302451 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="init-config-reloader" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302456 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="init-config-reloader" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302502 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="prom-label-proxy" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302513 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302520 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="config-reloader" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302525 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-web" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302530 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="alertmanager" Jul 01 22:24:10.302582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.302536 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb86762c-7bec-4812-991a-7686f318e086" containerName="kube-rbac-proxy-metric" Jul 01 22:24:10.306517 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.306495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zzz58\"" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309431 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 22:24:10.309617 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 22:24:10.310000 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309680 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 22:24:10.310000 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 22:24:10.310000 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.309914 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 22:24:10.313564 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.313547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 22:24:10.322886 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.322847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:10.489315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-out\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489315 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489916 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5k8\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-kube-api-access-8w5k8\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.489916 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.489638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-web-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590664 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-out\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590664 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590837 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590837 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590837 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590837 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.590837 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.590996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5k8\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-kube-api-access-8w5k8\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.591027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-web-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.591396 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.591350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.592687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.591875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.592687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.592054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc64f3b-b400-41db-9d46-b1ce4250c404-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.593710 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.593677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-out\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.593813 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.593774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.593813 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.593798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.593995 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.593977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.594049 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.594002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-web-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.594206 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.594185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.594384 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.594367 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.594802 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.594775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.595612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.595590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc64f3b-b400-41db-9d46-b1ce4250c404-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.600708 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.600690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5k8\" (UniqueName: \"kubernetes.io/projected/9fc64f3b-b400-41db-9d46-b1ce4250c404-kube-api-access-8w5k8\") pod \"alertmanager-main-0\" (UID: \"9fc64f3b-b400-41db-9d46-b1ce4250c404\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.616582 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.616561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 22:24:10.755487 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:10.755463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 22:24:10.758106 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:24:10.758078 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc64f3b_b400_41db_9d46_b1ce4250c404.slice/crio-dd640a97154f052b01e8efb71c8caa21ca0afbada03b1ad8717288202aa23abe WatchSource:0}: Error finding container dd640a97154f052b01e8efb71c8caa21ca0afbada03b1ad8717288202aa23abe: Status 404 returned error can't find the container with id dd640a97154f052b01e8efb71c8caa21ca0afbada03b1ad8717288202aa23abe Jul 01 22:24:11.248839 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:11.248812 2577 generic.go:356] "Generic (PLEG): container finished" podID="9fc64f3b-b400-41db-9d46-b1ce4250c404" containerID="37a0fe4a33114e2d9af69140e5579d1c5d10b58adf02dbaedc2f127a48ed470e" exitCode=0 Jul 01 22:24:11.249306 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:11.248914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerDied","Data":"37a0fe4a33114e2d9af69140e5579d1c5d10b58adf02dbaedc2f127a48ed470e"} Jul 01 22:24:11.249306 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:11.249006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"dd640a97154f052b01e8efb71c8caa21ca0afbada03b1ad8717288202aa23abe"} Jul 01 22:24:11.413333 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:11.413308 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb86762c-7bec-4812-991a-7686f318e086" path="/var/lib/kubelet/pods/cb86762c-7bec-4812-991a-7686f318e086/volumes" Jul 01 22:24:12.256965 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.256927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"efff90369ab83650b5cd941c9d8fee1008273a3885eb6e167061ac033991b0ee"} Jul 01 22:24:12.257334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.257020 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"7cc6327640522c0130902eade17fe384d29c8ca94898c0967e38113a90edb40c"} Jul 01 22:24:12.257334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.257048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"7d89f98527fb109d032000c92631b28944be62eaa69c0926f4a61923bdb07fd6"} Jul 01 22:24:12.257334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.257074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"e655a9780bb51c6ea57e10dbc225ad3cf18f6cac890f1ce76d7d46fd3d0e342c"} Jul 01 22:24:12.257334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.257100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"09d0e8e8fafbcf1f265d96cd64c231f09749fa061fd60ade2242d8208c3c2ab9"} Jul 01 22:24:12.257334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.257122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fc64f3b-b400-41db-9d46-b1ce4250c404","Type":"ContainerStarted","Data":"1942a5c14e563c9fe675d96660eb2a394d2fe7d57a272dacd898283490b24c28"} Jul 01 22:24:12.289648 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.289563 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2746748820000002 podStartE2EDuration="2.289548035s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.873153ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:24:12.287350322 +0000 UTC m=+151.307901554" watchObservedRunningTime="2026-07-01 22:24:12.289548035 +0000 UTC m=+151.310099258" Jul 01 22:24:12.936447 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936407 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:12.936801 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936772 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="prometheus" containerID="cri-o://f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" gracePeriod=600 Jul 01 22:24:12.936909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936806 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-web" containerID="cri-o://d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" gracePeriod=600 Jul 01 22:24:12.936909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936829 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" gracePeriod=600 Jul 01 22:24:12.936909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936837 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="config-reloader" containerID="cri-o://1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" gracePeriod=600 Jul 01 22:24:12.936909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936810 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="thanos-sidecar" containerID="cri-o://b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" gracePeriod=600 Jul 01 22:24:12.937082 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:12.936811 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy" containerID="cri-o://1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" gracePeriod=600 Jul 01 22:24:13.189097 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.189035 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.210790 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.210759 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.210790 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.210794 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.210812 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.210845 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.210980 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211048 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211044 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211101 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211138 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211165 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211196 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.211252 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211211 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.211574 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211549 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.212306 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.211807 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.212306 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212047 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212586 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7z56\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212690 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212736 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212758 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212782 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.213399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.212838 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2\") pod \"087522b0-c1e1-4c37-ac04-8fd6241c46de\" (UID: \"087522b0-c1e1-4c37-ac04-8fd6241c46de\") " Jul 01 22:24:13.214220 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.213635 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215006 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215056 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-db\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215077 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215091 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-metrics-client-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215105 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215120 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215264 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215335 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.215504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.215351 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out" (OuterVolumeSpecName: "config-out") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:24:13.216172 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.216136 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.216599 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.216455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:24:13.216599 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.216491 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56" (OuterVolumeSpecName: "kube-api-access-b7z56") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "kube-api-access-b7z56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:24:13.216599 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.216575 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config" (OuterVolumeSpecName: "config") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.216957 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.216931 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.217563 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.217540 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.217674 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.217563 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.217735 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.217671 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.217989 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.217973 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:24:13.218280 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.218253 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.231775 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.230521 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config" (OuterVolumeSpecName: "web-config") pod "087522b0-c1e1-4c37-ac04-8fd6241c46de" (UID: "087522b0-c1e1-4c37-ac04-8fd6241c46de"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265186 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" exitCode=0 Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265208 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" exitCode=0 Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265214 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" exitCode=0 Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265221 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" exitCode=0 Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265226 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" exitCode=0 Jul 01 22:24:13.265242 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265231 2577 generic.go:356] "Generic (PLEG): container finished" podID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" exitCode=0 Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265300 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265440 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} Jul 01 22:24:13.265952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.265583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"087522b0-c1e1-4c37-ac04-8fd6241c46de","Type":"ContainerDied","Data":"f2a7a26ad7af81c02fa8996b5815145113106d44496b96cfc44ca4e7bc459b95"} Jul 01 22:24:13.277394 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.277359 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.284679 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.284662 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.291229 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.291208 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.294109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.294089 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:13.298373 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.298356 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.302359 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.302335 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:13.305676 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.305659 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.312649 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.312634 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.318041 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.317970 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-kube-rbac-proxy\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318077 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-web-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318099 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-metrics-client-certs\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318115 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318150 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318172 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318188 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/087522b0-c1e1-4c37-ac04-8fd6241c46de-config-out\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318205 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7z56\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-kube-api-access-b7z56\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318218 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318231 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/087522b0-c1e1-4c37-ac04-8fd6241c46de-tls-assets\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318247 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318260 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-secret-grpc-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318275 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318289 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/087522b0-c1e1-4c37-ac04-8fd6241c46de-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.318354 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.318303 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/087522b0-c1e1-4c37-ac04-8fd6241c46de-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:24:13.320351 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.320336 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.320589 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.320572 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.320638 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.320596 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.320638 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.320616 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.320844 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.320828 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.320894 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.320850 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.320894 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.320886 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.321115 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.321099 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.321165 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321121 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.321165 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321135 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.321357 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.321342 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.321403 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321363 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.321403 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321376 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.321589 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.321576 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.321636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321593 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.321636 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321605 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.321811 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.321795 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.321865 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321813 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.321865 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.321825 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.322112 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:24:13.322093 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.322184 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322116 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.322184 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322132 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.322360 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322343 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.322415 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322361 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.322588 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322570 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.322631 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322590 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.322801 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322784 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.322845 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.322801 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.323058 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323043 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.323108 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323059 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.323285 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323269 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.323335 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323286 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.323472 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323455 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.323512 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323473 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.323720 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323701 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.323769 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323728 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.323978 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323959 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.323978 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.323978 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.324205 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324189 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.324262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324205 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.324392 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324378 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.324435 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324393 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.324573 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324558 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.324613 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324573 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.324754 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324739 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.324804 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324754 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.324985 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324969 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.325044 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.324986 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.325205 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325190 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.325254 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325206 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.325405 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325389 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.325448 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325406 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.325627 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325608 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.325682 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325629 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.325801 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325783 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.325842 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325804 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.326009 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.325993 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.326055 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326010 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.326255 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326239 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.326301 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326256 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.326474 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326452 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.326474 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326468 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.326698 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326679 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.326735 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326701 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.326918 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326898 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.326963 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.326917 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.327142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327122 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.327142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327140 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.327351 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327334 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.327400 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327352 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.327568 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327548 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.327629 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327567 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.327783 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327767 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.327821 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327786 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.328011 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.327995 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.328064 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328011 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.328223 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328208 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.328261 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328224 2577 scope.go:117] "RemoveContainer" containerID="bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae" Jul 01 22:24:13.328413 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328397 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae"} err="failed to get container status \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": rpc error: code = NotFound desc = could not find container \"bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae\": container with ID starting with bb6af1f9e0180d4c4a35d36c5bb718545b074942da9e737ba9f209a44ed31aae not found: ID does not exist" Jul 01 22:24:13.328453 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328414 2577 scope.go:117] "RemoveContainer" containerID="1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b" Jul 01 22:24:13.328665 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328636 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b"} err="failed to get container status \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": rpc error: code = NotFound desc = could not find container \"1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b\": container with ID starting with 1ede02793565d202367fa0f925a7dff804515c042fd03a5ab9d2e290fbc1a11b not found: ID does not exist" Jul 01 22:24:13.328665 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328664 2577 scope.go:117] "RemoveContainer" containerID="d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d" Jul 01 22:24:13.328972 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328939 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d"} err="failed to get container status \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": rpc error: code = NotFound desc = could not find container \"d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d\": container with ID starting with d335de4ecb28001b648192ee7eaaccabf3cedc576242e5a1f567747d42f81d2d not found: ID does not exist" Jul 01 22:24:13.328972 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.328964 2577 scope.go:117] "RemoveContainer" containerID="b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340" Jul 01 22:24:13.329240 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329213 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340"} err="failed to get container status \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": rpc error: code = NotFound desc = could not find container \"b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340\": container with ID starting with b162801a508fa6e8a09ff88765027bbcb10c7289a32b4106817bab1b135f9340 not found: ID does not exist" Jul 01 22:24:13.329683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329264 2577 scope.go:117] "RemoveContainer" containerID="1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540" Jul 01 22:24:13.329683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329601 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540"} err="failed to get container status \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": rpc error: code = NotFound desc = could not find container \"1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540\": container with ID starting with 1751bedebdea7311bbd92656eb7507d536c54c49c4fd816ccbbe6b9d34ee2540 not found: ID does not exist" Jul 01 22:24:13.329683 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329623 2577 scope.go:117] "RemoveContainer" containerID="f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358" Jul 01 22:24:13.329933 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329873 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358"} err="failed to get container status \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": rpc error: code = NotFound desc = could not find container \"f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358\": container with ID starting with f32f41cbc0ecd60a917ccd520fed0947721eaf76e7b58e6d8d64144130f22358 not found: ID does not exist" Jul 01 22:24:13.329933 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.329897 2577 scope.go:117] "RemoveContainer" containerID="49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419" Jul 01 22:24:13.330191 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.330164 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419"} err="failed to get container status \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": rpc error: code = NotFound desc = could not find container \"49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419\": container with ID starting with 49e5d8d3700bd4ec78f7cbe42bc23422c243f2ed15ae41d1e57ca401f9705419 not found: ID does not exist" Jul 01 22:24:13.342358 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342339 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:13.342611 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342600 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342612 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342624 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="config-reloader" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342630 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="config-reloader" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342641 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="prometheus" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342646 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="prometheus" Jul 01 22:24:13.342656 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342653 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-thanos" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342658 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-thanos" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342665 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-web" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342670 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-web" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342676 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="init-config-reloader" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342681 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="init-config-reloader" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342689 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="thanos-sidecar" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342695 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="thanos-sidecar" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342733 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="prometheus" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342741 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="config-reloader" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342747 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342753 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-web" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342759 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="thanos-sidecar" Jul 01 22:24:13.342814 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.342764 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" containerName="kube-rbac-proxy-thanos" Jul 01 22:24:13.349065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.349040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.355657 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.355627 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 22:24:13.355657 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.355650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 22:24:13.355799 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.355627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 22:24:13.355799 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.355627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 22:24:13.356352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-md72c\"" Jul 01 22:24:13.356352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356163 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 22:24:13.356352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 22:24:13.356352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 22:24:13.356892 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 22:24:13.357009 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356909 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 22:24:13.357009 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.356984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 22:24:13.357171 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.357062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 22:24:13.357171 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.357150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fbnjh1h5rsos\"" Jul 01 22:24:13.358142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.358122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 22:24:13.358453 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.358435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 22:24:13.364907 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.364888 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 22:24:13.367796 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.367778 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:13.414240 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.414212 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087522b0-c1e1-4c37-ac04-8fd6241c46de" path="/var/lib/kubelet/pods/087522b0-c1e1-4c37-ac04-8fd6241c46de/volumes" Jul 01 22:24:13.419071 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419144 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419144 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419144 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419144 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77np\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-kube-api-access-n77np\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419325 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419522 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.419678 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.419646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520661 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.520847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521165 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.520851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521476 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521612 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521939 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521939 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77np\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-kube-api-access-n77np\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521939 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521939 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.521939 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.523404 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.522742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.523901 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.523786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.523901 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.523805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524046 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.523990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524046 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.523988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524046 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.521779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524492 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524732 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.524887 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.524732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.525187 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.525160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.525694 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.525668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.525839 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.525815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6eb11914-468b-4ae7-baf6-3c37a8c529f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.526182 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.526164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6eb11914-468b-4ae7-baf6-3c37a8c529f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.526540 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.526513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.526687 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.526669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.527177 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.527161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6eb11914-468b-4ae7-baf6-3c37a8c529f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.532330 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.532313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77np\" (UniqueName: \"kubernetes.io/projected/6eb11914-468b-4ae7-baf6-3c37a8c529f7-kube-api-access-n77np\") pod \"prometheus-k8s-0\" (UID: \"6eb11914-468b-4ae7-baf6-3c37a8c529f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.659564 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.659527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:13.800588 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:13.800566 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 22:24:13.802163 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:24:13.802130 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb11914_468b_4ae7_baf6_3c37a8c529f7.slice/crio-9d24636a22d85fbf2bbfcdd36c904525ddbbe1e36fd2b00a2c0748393b715120 WatchSource:0}: Error finding container 9d24636a22d85fbf2bbfcdd36c904525ddbbe1e36fd2b00a2c0748393b715120: Status 404 returned error can't find the container with id 9d24636a22d85fbf2bbfcdd36c904525ddbbe1e36fd2b00a2c0748393b715120 Jul 01 22:24:14.272180 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:14.272148 2577 generic.go:356] "Generic (PLEG): container finished" podID="6eb11914-468b-4ae7-baf6-3c37a8c529f7" containerID="5a0199b469a4b1ca161d55b4b319cc4460e3cb5aad0fcc230d787ff67b4911f2" exitCode=0 Jul 01 22:24:14.272579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:14.272213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerDied","Data":"5a0199b469a4b1ca161d55b4b319cc4460e3cb5aad0fcc230d787ff67b4911f2"} Jul 01 22:24:14.272579 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:14.272266 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"9d24636a22d85fbf2bbfcdd36c904525ddbbe1e36fd2b00a2c0748393b715120"} Jul 01 22:24:15.279605 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"dd6b26b38ecce621f093885bcb2104a2f14b927b5167b1d5123742b4e8a5c970"} Jul 01 22:24:15.279992 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"e697056747e4cf56c9cc0e9bf79de6baa1f0e78f5f47f1d5ef2473689d07d9be"} Jul 01 22:24:15.279992 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"7f2b3585f8e387e39ebc1266f92afba5091443c598b3c2dddaf0d8ae35abd617"} Jul 01 22:24:15.279992 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"3e325e0c6b59207e3bf49c5b17378f4d30d99e6cddad6a6b5b3975a41414d1c5"} Jul 01 22:24:15.279992 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"d9835558256d07eb80063e2ebc72fcd5cb92b6b2ad3cd45670687df1eba3b6b7"} Jul 01 22:24:15.279992 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.279760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6eb11914-468b-4ae7-baf6-3c37a8c529f7","Type":"ContainerStarted","Data":"984353cd2802b169a43b957856652a18c5a265d63b7a8d31022ff5fc76dc2756"} Jul 01 22:24:15.317504 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:15.317334 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.299905163 podStartE2EDuration="2.31731644s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.411277ms" isStatefulPod=false podCreationTimestamp="2026-07-01 22:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:24:15.315249452 +0000 UTC m=+154.335800676" watchObservedRunningTime="2026-07-01 22:24:15.31731644 +0000 UTC m=+154.337867665" Jul 01 22:24:18.659781 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:18.659740 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:24:38.753879 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.753776 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq"] Jul 01 22:24:38.756054 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.756033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.758800 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.758782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 22:24:38.759941 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.759916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 22:24:38.760065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.759951 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 22:24:38.760065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.760023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 22:24:38.760065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.759951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 22:24:38.760065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.760050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 22:24:38.760340 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.760325 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 22:24:38.768629 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.768609 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq"] Jul 01 22:24:38.842883 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.842827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.843067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.842894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/db49804b-b010-47b7-bede-8f0ce6de1b07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.843067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.842938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.843067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.842962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.843067 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.843033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.843211 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.843073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxfx\" (UniqueName: \"kubernetes.io/projected/db49804b-b010-47b7-bede-8f0ce6de1b07-kube-api-access-snxfx\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944107 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944107 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxfx\" (UniqueName: \"kubernetes.io/projected/db49804b-b010-47b7-bede-8f0ce6de1b07-kube-api-access-snxfx\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/db49804b-b010-47b7-bede-8f0ce6de1b07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.944953 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.944926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/db49804b-b010-47b7-bede-8f0ce6de1b07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.946707 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.946654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-ca\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.946827 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.946748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.947109 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.947091 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.947149 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.947097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/db49804b-b010-47b7-bede-8f0ce6de1b07-hub\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:38.953789 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:38.953765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxfx\" (UniqueName: \"kubernetes.io/projected/db49804b-b010-47b7-bede-8f0ce6de1b07-kube-api-access-snxfx\") pod \"cluster-proxy-proxy-agent-5d9b4699d6-2fvgq\" (UID: \"db49804b-b010-47b7-bede-8f0ce6de1b07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:39.078071 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:39.077973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" Jul 01 22:24:39.207878 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:39.207827 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq"] Jul 01 22:24:39.210600 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:24:39.210573 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb49804b_b010_47b7_bede_8f0ce6de1b07.slice/crio-137c25b9b67d3e45cd9e9b546704603f50421ba3b3ed5bdd36ddb36469995683 WatchSource:0}: Error finding container 137c25b9b67d3e45cd9e9b546704603f50421ba3b3ed5bdd36ddb36469995683: Status 404 returned error can't find the container with id 137c25b9b67d3e45cd9e9b546704603f50421ba3b3ed5bdd36ddb36469995683 Jul 01 22:24:39.376921 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:39.376814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" event={"ID":"db49804b-b010-47b7-bede-8f0ce6de1b07","Type":"ContainerStarted","Data":"137c25b9b67d3e45cd9e9b546704603f50421ba3b3ed5bdd36ddb36469995683"} Jul 01 22:24:43.397255 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:43.397219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" event={"ID":"db49804b-b010-47b7-bede-8f0ce6de1b07","Type":"ContainerStarted","Data":"aa6addc8e50ab2a2ba7c9f6160f731933c4433ea371e3c8df2025015c04e361c"} Jul 01 22:24:43.397692 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:43.397266 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" event={"ID":"db49804b-b010-47b7-bede-8f0ce6de1b07","Type":"ContainerStarted","Data":"f0b1c7e7a27ff55652ce90608d8979cef701e51b4127e481df2e29ba5a89458d"} Jul 01 22:24:43.397692 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:43.397280 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" event={"ID":"db49804b-b010-47b7-bede-8f0ce6de1b07","Type":"ContainerStarted","Data":"1f74d15c03653b185f39f0944920087220034ec5bfffc0708a25744e4261d8e8"} Jul 01 22:24:43.419481 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:24:43.419434 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d9b4699d6-2fvgq" podStartSLOduration=1.941680453 podStartE2EDuration="5.419420398s" totalImagesPullingTime="3.477739945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:24:43.417350227 +0000 UTC m=+182.437901463" watchObservedRunningTime="2026-07-01 22:24:43.419420398 +0000 UTC m=+182.439971621" Jul 01 22:25:13.660698 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:13.660664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:25:13.675839 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:13.675815 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:25:14.527921 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:14.527895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 22:25:43.432096 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.432053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w"] Jul 01 22:25:43.436794 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.436756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.440587 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.440553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 22:25:43.441052 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.441029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 22:25:43.441169 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.441144 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cc98k\"" Jul 01 22:25:43.441288 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.441268 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 22:25:43.441353 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.441268 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 22:25:43.461358 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.461337 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w"] Jul 01 22:25:43.554797 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.554771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-tmp\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.554921 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.554806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.554921 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.554897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfz6x\" (UniqueName: \"kubernetes.io/projected/adb27d46-0f62-4c13-b728-b9ac71bc2825-kube-api-access-cfz6x\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.555002 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.554971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-manifests\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.555037 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.555004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.655588 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.655563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-tmp\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.655691 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.655598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.655691 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.655639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfz6x\" (UniqueName: \"kubernetes.io/projected/adb27d46-0f62-4c13-b728-b9ac71bc2825-kube-api-access-cfz6x\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.655691 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.655686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-manifests\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.655797 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.655726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.656128 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.656108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-manifests\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.658151 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.658129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb27d46-0f62-4c13-b728-b9ac71bc2825-tmp\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.658397 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.658377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.658467 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.658429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adb27d46-0f62-4c13-b728-b9ac71bc2825-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.672313 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.672289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfz6x\" (UniqueName: \"kubernetes.io/projected/adb27d46-0f62-4c13-b728-b9ac71bc2825-kube-api-access-cfz6x\") pod \"opendatahub-operator-controller-manager-7b6ffc8659-2jr7w\" (UID: \"adb27d46-0f62-4c13-b728-b9ac71bc2825\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.748212 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.748156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:43.884952 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:43.884926 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w"] Jul 01 22:25:43.887502 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:25:43.887461 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb27d46_0f62_4c13_b728_b9ac71bc2825.slice/crio-6e322383d14c483aed997376b5eb6a87caa6398cf2afa121e9f48d090e3da89a WatchSource:0}: Error finding container 6e322383d14c483aed997376b5eb6a87caa6398cf2afa121e9f48d090e3da89a: Status 404 returned error can't find the container with id 6e322383d14c483aed997376b5eb6a87caa6398cf2afa121e9f48d090e3da89a Jul 01 22:25:44.636102 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:44.636064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" event={"ID":"adb27d46-0f62-4c13-b728-b9ac71bc2825","Type":"ContainerStarted","Data":"6e322383d14c483aed997376b5eb6a87caa6398cf2afa121e9f48d090e3da89a"} Jul 01 22:25:47.650072 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:47.650030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" event={"ID":"adb27d46-0f62-4c13-b728-b9ac71bc2825","Type":"ContainerStarted","Data":"557b75f01eb882d0c5d7b35caa473ea40a54500a6183c179d879f07338d4f69c"} Jul 01 22:25:48.656299 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:48.656265 2577 generic.go:356] "Generic (PLEG): container finished" podID="adb27d46-0f62-4c13-b728-b9ac71bc2825" containerID="557b75f01eb882d0c5d7b35caa473ea40a54500a6183c179d879f07338d4f69c" exitCode=0 Jul 01 22:25:48.656691 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:48.656353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" event={"ID":"adb27d46-0f62-4c13-b728-b9ac71bc2825","Type":"ContainerDied","Data":"557b75f01eb882d0c5d7b35caa473ea40a54500a6183c179d879f07338d4f69c"} Jul 01 22:25:49.662616 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:49.662580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" event={"ID":"adb27d46-0f62-4c13-b728-b9ac71bc2825","Type":"ContainerStarted","Data":"3b2b4ce736f8318b2ab4ccb42666b0bae26dbc69cdaca1641f52d788f1745941"} Jul 01 22:25:49.663028 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:49.662724 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:25:49.691842 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:25:49.691790 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" podStartSLOduration=2.4935759920000002 podStartE2EDuration="6.691776342s" totalImagesPullingTime="3.124315763s" totalInitContainerRuntime="1.073884587s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:25:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:25:49.689474105 +0000 UTC m=+248.710025330" watchObservedRunningTime="2026-07-01 22:25:49.691776342 +0000 UTC m=+248.712327566" Jul 01 22:26:00.669519 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:00.669484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6ffc8659-2jr7w" Jul 01 22:26:02.408634 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.408599 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml"] Jul 01 22:26:02.413165 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.413145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.417694 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.417666 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 22:26:02.417808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.417666 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 22:26:02.417808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.417668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p4ppf\"" Jul 01 22:26:02.417808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.417671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:26:02.417808 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.417671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 22:26:02.418058 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.418043 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 22:26:02.441318 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.441293 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml"] Jul 01 22:26:02.490760 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.490738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgphg\" (UniqueName: \"kubernetes.io/projected/3113c1a4-ff46-4893-a54a-31ebd9eb8852-kube-api-access-qgphg\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.490878 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.490783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.490878 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.490805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3113c1a4-ff46-4893-a54a-31ebd9eb8852-manager-config\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.490958 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.490900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-metrics-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.591523 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.591497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.591623 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.591529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3113c1a4-ff46-4893-a54a-31ebd9eb8852-manager-config\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.591623 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.591555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-metrics-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.591623 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.591597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgphg\" (UniqueName: \"kubernetes.io/projected/3113c1a4-ff46-4893-a54a-31ebd9eb8852-kube-api-access-qgphg\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.592253 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.592236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3113c1a4-ff46-4893-a54a-31ebd9eb8852-manager-config\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.594001 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.593978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-metrics-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.594082 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.594003 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3113c1a4-ff46-4893-a54a-31ebd9eb8852-cert\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.606911 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.606892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgphg\" (UniqueName: \"kubernetes.io/projected/3113c1a4-ff46-4893-a54a-31ebd9eb8852-kube-api-access-qgphg\") pod \"lws-controller-manager-658788d8fc-sc5ml\" (UID: \"3113c1a4-ff46-4893-a54a-31ebd9eb8852\") " pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.723664 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.723616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:02.946384 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:02.946354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml"] Jul 01 22:26:02.952014 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:26:02.951984 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3113c1a4_ff46_4893_a54a_31ebd9eb8852.slice/crio-93ae55414d3508c00f0f34095407a1f42414c165de3c3f4e69574a4e4af70cba WatchSource:0}: Error finding container 93ae55414d3508c00f0f34095407a1f42414c165de3c3f4e69574a4e4af70cba: Status 404 returned error can't find the container with id 93ae55414d3508c00f0f34095407a1f42414c165de3c3f4e69574a4e4af70cba Jul 01 22:26:03.489886 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.489802 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-854f49787f-7dbzz"] Jul 01 22:26:03.493966 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.493948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.496922 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.496897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7dmc\" (UniqueName: \"kubernetes.io/projected/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-kube-api-access-b7dmc\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.497033 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.496957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tls-certs\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.497081 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.497035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tmp\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.498474 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.498458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2288\"" Jul 01 22:26:03.498547 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.498509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 22:26:03.498547 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.498532 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 22:26:03.498639 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.498544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 22:26:03.498817 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.498803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 22:26:03.521486 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.521463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-854f49787f-7dbzz"] Jul 01 22:26:03.597804 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.597782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tmp\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.597916 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.597866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7dmc\" (UniqueName: \"kubernetes.io/projected/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-kube-api-access-b7dmc\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.597966 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.597913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tls-certs\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.600127 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.600107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tmp\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.600439 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.600416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-tls-certs\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.621229 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.621211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7dmc\" (UniqueName: \"kubernetes.io/projected/c19f0a71-9256-4b44-bebb-9bb8ea0c945e-kube-api-access-b7dmc\") pod \"kube-auth-proxy-854f49787f-7dbzz\" (UID: \"c19f0a71-9256-4b44-bebb-9bb8ea0c945e\") " pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.718016 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.717991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" event={"ID":"3113c1a4-ff46-4893-a54a-31ebd9eb8852","Type":"ContainerStarted","Data":"93ae55414d3508c00f0f34095407a1f42414c165de3c3f4e69574a4e4af70cba"} Jul 01 22:26:03.803480 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:03.803463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" Jul 01 22:26:03.986970 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:26:03.986939 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19f0a71_9256_4b44_bebb_9bb8ea0c945e.slice/crio-400d9a01ea7a0782d8336acf4ccfa9e80be5026929509ca6dcb2c9dbda374650 WatchSource:0}: Error finding container 400d9a01ea7a0782d8336acf4ccfa9e80be5026929509ca6dcb2c9dbda374650: Status 404 returned error can't find the container with id 400d9a01ea7a0782d8336acf4ccfa9e80be5026929509ca6dcb2c9dbda374650 Jul 01 22:26:04.004275 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:04.003933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-854f49787f-7dbzz"] Jul 01 22:26:04.725639 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:04.725597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" event={"ID":"c19f0a71-9256-4b44-bebb-9bb8ea0c945e","Type":"ContainerStarted","Data":"400d9a01ea7a0782d8336acf4ccfa9e80be5026929509ca6dcb2c9dbda374650"} Jul 01 22:26:06.737964 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:06.737931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" event={"ID":"3113c1a4-ff46-4893-a54a-31ebd9eb8852","Type":"ContainerStarted","Data":"1cd00023165dfecc091618beb8f0d982a48de7168b2e4c5cce0152cf4c43881a"} Jul 01 22:26:06.738370 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:06.738049 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:06.759777 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:06.759735 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" podStartSLOduration=2.002776692 podStartE2EDuration="4.759720445s" totalImagesPullingTime="2.756943753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:26:06.758396079 +0000 UTC m=+265.778947303" watchObservedRunningTime="2026-07-01 22:26:06.759720445 +0000 UTC m=+265.780271724" Jul 01 22:26:07.743545 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:07.743498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" event={"ID":"c19f0a71-9256-4b44-bebb-9bb8ea0c945e","Type":"ContainerStarted","Data":"395efaf3aac389ff886b31e94cbb56c7445c46fe5dd896d918051e5d303b1a0f"} Jul 01 22:26:07.773824 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:07.773768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-854f49787f-7dbzz" podStartSLOduration=1.9799625349999999 podStartE2EDuration="4.77375303s" totalImagesPullingTime="2.793790495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:26:07.77150513 +0000 UTC m=+266.792056357" watchObservedRunningTime="2026-07-01 22:26:07.77375303 +0000 UTC m=+266.794304315" Jul 01 22:26:17.746340 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:17.746257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-658788d8fc-sc5ml" Jul 01 22:26:41.359697 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:26:41.359669 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 22:27:48.911670 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.911631 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s"] Jul 01 22:27:48.915010 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.914991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:48.917685 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.917663 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 22:27:48.917799 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.917742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 22:27:48.917878 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.917850 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 22:27:48.917944 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.917931 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pp2s8\"" Jul 01 22:27:48.918769 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.918753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 22:27:48.925508 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.925487 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s"] Jul 01 22:27:48.998559 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.998523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64p8l\" (UniqueName: \"kubernetes.io/projected/a774a9da-7c92-4e13-84c4-37709a312da8-kube-api-access-64p8l\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:48.998763 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.998578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:48.998763 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:48.998646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a774a9da-7c92-4e13-84c4-37709a312da8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.099453 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.099415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.099453 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.099455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a774a9da-7c92-4e13-84c4-37709a312da8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.099658 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.099520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64p8l\" (UniqueName: \"kubernetes.io/projected/a774a9da-7c92-4e13-84c4-37709a312da8-kube-api-access-64p8l\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.099658 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:27:49.099622 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 01 22:27:49.099749 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:27:49.099706 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert podName:a774a9da-7c92-4e13-84c4-37709a312da8 nodeName:}" failed. No retries permitted until 2026-07-01 22:27:49.599689026 +0000 UTC m=+368.620240232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rrd6s" (UID: "a774a9da-7c92-4e13-84c4-37709a312da8") : secret "plugin-serving-cert" not found Jul 01 22:27:49.100260 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.100241 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a774a9da-7c92-4e13-84c4-37709a312da8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.115812 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.115790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64p8l\" (UniqueName: \"kubernetes.io/projected/a774a9da-7c92-4e13-84c4-37709a312da8-kube-api-access-64p8l\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.604530 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.604479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.606866 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.606827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a774a9da-7c92-4e13-84c4-37709a312da8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rrd6s\" (UID: \"a774a9da-7c92-4e13-84c4-37709a312da8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.823974 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.823924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" Jul 01 22:27:49.975132 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.975095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s"] Jul 01 22:27:49.978579 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:27:49.978555 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda774a9da_7c92_4e13_84c4_37709a312da8.slice/crio-a13995d5a034982cf1909a5d8fbe696ddbd042145927ef08852c9189329233ec WatchSource:0}: Error finding container a13995d5a034982cf1909a5d8fbe696ddbd042145927ef08852c9189329233ec: Status 404 returned error can't find the container with id a13995d5a034982cf1909a5d8fbe696ddbd042145927ef08852c9189329233ec Jul 01 22:27:49.979912 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:49.979892 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:27:50.185567 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:27:50.185477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" event={"ID":"a774a9da-7c92-4e13-84c4-37709a312da8","Type":"ContainerStarted","Data":"a13995d5a034982cf1909a5d8fbe696ddbd042145927ef08852c9189329233ec"} Jul 01 22:28:13.299015 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:13.298978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" event={"ID":"a774a9da-7c92-4e13-84c4-37709a312da8","Type":"ContainerStarted","Data":"1cb5faf1c46e6252dbd5c8094d9e7b0703f38e0283cc4ddf56a284cc2e8677ed"} Jul 01 22:28:13.320613 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:13.320557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rrd6s" podStartSLOduration=2.597720421 podStartE2EDuration="25.320541767s" totalImagesPullingTime="22.722821346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:28:13.320250646 +0000 UTC m=+392.340801862" watchObservedRunningTime="2026-07-01 22:28:13.320541767 +0000 UTC m=+392.341092990" Jul 01 22:28:43.898580 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:43.898543 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:28:43.964747 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:43.964665 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:28:43.964747 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:43.964747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:43.965019 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:43.964790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:28:43.967627 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:43.967606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 22:28:44.113159 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.113118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20d70d50-3cb9-411e-830f-5aa46d26a659-config-file\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.113329 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.113181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqql\" (UniqueName: \"kubernetes.io/projected/20d70d50-3cb9-411e-830f-5aa46d26a659-kube-api-access-jrqql\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.214647 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.214541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20d70d50-3cb9-411e-830f-5aa46d26a659-config-file\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.214647 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.214622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqql\" (UniqueName: \"kubernetes.io/projected/20d70d50-3cb9-411e-830f-5aa46d26a659-kube-api-access-jrqql\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.215251 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.215229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20d70d50-3cb9-411e-830f-5aa46d26a659-config-file\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.228101 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.228072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqql\" (UniqueName: \"kubernetes.io/projected/20d70d50-3cb9-411e-830f-5aa46d26a659-kube-api-access-jrqql\") pod \"limitador-limitador-54d6d988d5-jq7rt\" (UID: \"20d70d50-3cb9-411e-830f-5aa46d26a659\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.274598 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.274559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:44.410039 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.410014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:28:44.412481 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:28:44.412453 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d70d50_3cb9_411e_830f_5aa46d26a659.slice/crio-ec03bc84d1486d5101397228ffd5245c8cddeff84aa3f0a2c6102eeaa4c2f241 WatchSource:0}: Error finding container ec03bc84d1486d5101397228ffd5245c8cddeff84aa3f0a2c6102eeaa4c2f241: Status 404 returned error can't find the container with id ec03bc84d1486d5101397228ffd5245c8cddeff84aa3f0a2c6102eeaa4c2f241 Jul 01 22:28:44.434238 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:44.434210 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" event={"ID":"20d70d50-3cb9-411e-830f-5aa46d26a659","Type":"ContainerStarted","Data":"ec03bc84d1486d5101397228ffd5245c8cddeff84aa3f0a2c6102eeaa4c2f241"} Jul 01 22:28:47.450287 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:47.450246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" event={"ID":"20d70d50-3cb9-411e-830f-5aa46d26a659","Type":"ContainerStarted","Data":"ddd4cf94d77a56c00b41d7761ed94000e9530771de1845130c022024934ad9e4"} Jul 01 22:28:47.450783 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:47.450388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:28:47.476872 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:47.476808 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" podStartSLOduration=1.996173861 podStartE2EDuration="4.47679263s" totalImagesPullingTime="2.480618769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:28:47.475792093 +0000 UTC m=+426.496343314" watchObservedRunningTime="2026-07-01 22:28:47.47679263 +0000 UTC m=+426.497343909" Jul 01 22:28:58.456586 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:28:58.456555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jq7rt" Jul 01 22:30:14.642912 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.642872 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:14.646201 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.646184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.650521 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.650503 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 22:30:14.650685 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.650668 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 22:30:14.651508 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.651488 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k5hz8\"" Jul 01 22:30:14.660352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.660332 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:14.824155 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.824124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgq5c\" (UniqueName: \"kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.824328 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.824169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.925012 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.924927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgq5c\" (UniqueName: \"kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.925012 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.924975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.927436 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.927407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.933245 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.933224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgq5c\" (UniqueName: \"kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c\") pod \"maas-controller-787755d7f-6trb6\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:14.956127 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:14.956101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:15.086525 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:15.086367 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:15.088823 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:30:15.088795 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba93160e_21dc_4c30_8e31_762b52ccf382.slice/crio-8c67abd8fa691cd1e8927594783f61f11b0961d37c3d2bcb66111b93f6f67fd2 WatchSource:0}: Error finding container 8c67abd8fa691cd1e8927594783f61f11b0961d37c3d2bcb66111b93f6f67fd2: Status 404 returned error can't find the container with id 8c67abd8fa691cd1e8927594783f61f11b0961d37c3d2bcb66111b93f6f67fd2 Jul 01 22:30:15.839873 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:15.839821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-6trb6" event={"ID":"ba93160e-21dc-4c30-8e31-762b52ccf382","Type":"ContainerStarted","Data":"8c67abd8fa691cd1e8927594783f61f11b0961d37c3d2bcb66111b93f6f67fd2"} Jul 01 22:30:17.851148 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:17.851108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-6trb6" event={"ID":"ba93160e-21dc-4c30-8e31-762b52ccf382","Type":"ContainerStarted","Data":"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98"} Jul 01 22:30:17.851510 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:17.851210 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:17.873262 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:17.873207 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-787755d7f-6trb6" podStartSLOduration=1.293892317 podStartE2EDuration="3.873191906s" totalImagesPullingTime="2.579299589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:30:17.872500556 +0000 UTC m=+516.893051782" watchObservedRunningTime="2026-07-01 22:30:17.873191906 +0000 UTC m=+516.893743130" Jul 01 22:30:28.862227 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:28.862193 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:29.652645 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.652610 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:29.652842 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.652822 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-787755d7f-6trb6" podUID="ba93160e-21dc-4c30-8e31-762b52ccf382" containerName="manager" containerID="cri-o://da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98" gracePeriod=30 Jul 01 22:30:29.898233 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.898209 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:29.905603 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.905548 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba93160e-21dc-4c30-8e31-762b52ccf382" containerID="da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98" exitCode=0 Jul 01 22:30:29.905603 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.905580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-6trb6" event={"ID":"ba93160e-21dc-4c30-8e31-762b52ccf382","Type":"ContainerDied","Data":"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98"} Jul 01 22:30:29.905603 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.905584 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-6trb6" Jul 01 22:30:29.905774 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.905619 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-6trb6" event={"ID":"ba93160e-21dc-4c30-8e31-762b52ccf382","Type":"ContainerDied","Data":"8c67abd8fa691cd1e8927594783f61f11b0961d37c3d2bcb66111b93f6f67fd2"} Jul 01 22:30:29.905774 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.905641 2577 scope.go:117] "RemoveContainer" containerID="da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98" Jul 01 22:30:29.913353 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.913334 2577 scope.go:117] "RemoveContainer" containerID="da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98" Jul 01 22:30:29.913636 ip-10-0-128-178 kubenswrapper[2577]: E0701 22:30:29.913618 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98\": container with ID starting with da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98 not found: ID does not exist" containerID="da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98" Jul 01 22:30:29.913679 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.913646 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98"} err="failed to get container status \"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98\": rpc error: code = NotFound desc = could not find container \"da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98\": container with ID starting with da1e4320c846e1f2677a26975538071dabf56fd206450bb1c011646533aa8e98 not found: ID does not exist" Jul 01 22:30:29.962130 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.962101 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert\") pod \"ba93160e-21dc-4c30-8e31-762b52ccf382\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " Jul 01 22:30:29.962304 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.962189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgq5c\" (UniqueName: \"kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c\") pod \"ba93160e-21dc-4c30-8e31-762b52ccf382\" (UID: \"ba93160e-21dc-4c30-8e31-762b52ccf382\") " Jul 01 22:30:29.964192 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.964166 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ba93160e-21dc-4c30-8e31-762b52ccf382" (UID: "ba93160e-21dc-4c30-8e31-762b52ccf382"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:30:29.964294 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:29.964251 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c" (OuterVolumeSpecName: "kube-api-access-tgq5c") pod "ba93160e-21dc-4c30-8e31-762b52ccf382" (UID: "ba93160e-21dc-4c30-8e31-762b52ccf382"). InnerVolumeSpecName "kube-api-access-tgq5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:30:30.063488 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:30.063450 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba93160e-21dc-4c30-8e31-762b52ccf382-webhook-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:30:30.063488 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:30.063483 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgq5c\" (UniqueName: \"kubernetes.io/projected/ba93160e-21dc-4c30-8e31-762b52ccf382-kube-api-access-tgq5c\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jul 01 22:30:30.228500 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:30.228472 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:30.232800 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:30.232778 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-787755d7f-6trb6"] Jul 01 22:30:31.413849 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:31.413820 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba93160e-21dc-4c30-8e31-762b52ccf382" path="/var/lib/kubelet/pods/ba93160e-21dc-4c30-8e31-762b52ccf382/volumes" Jul 01 22:30:49.389052 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.389019 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48"] Jul 01 22:30:49.389445 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.389364 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba93160e-21dc-4c30-8e31-762b52ccf382" containerName="manager" Jul 01 22:30:49.389445 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.389373 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba93160e-21dc-4c30-8e31-762b52ccf382" containerName="manager" Jul 01 22:30:49.389445 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.389424 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba93160e-21dc-4c30-8e31-762b52ccf382" containerName="manager" Jul 01 22:30:49.393419 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.393401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.398892 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.396501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57d86\"" Jul 01 22:30:49.398892 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.396799 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 01 22:30:49.398892 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.397580 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 01 22:30:49.398892 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.397825 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 01 22:30:49.406795 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.406776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48"] Jul 01 22:30:49.543529 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.543497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7857066f-7ef1-4706-bef8-3ca36d499465-openshift-service-ca\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.543689 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.543544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7857066f-7ef1-4706-bef8-3ca36d499465-maas-api-tls\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.543689 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.543576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qmg\" (UniqueName: \"kubernetes.io/projected/7857066f-7ef1-4706-bef8-3ca36d499465-kube-api-access-f4qmg\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.644832 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.644735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7857066f-7ef1-4706-bef8-3ca36d499465-openshift-service-ca\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.644832 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.644790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7857066f-7ef1-4706-bef8-3ca36d499465-maas-api-tls\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.644832 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.644809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qmg\" (UniqueName: \"kubernetes.io/projected/7857066f-7ef1-4706-bef8-3ca36d499465-kube-api-access-f4qmg\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.645467 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.645447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7857066f-7ef1-4706-bef8-3ca36d499465-openshift-service-ca\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.647291 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.647258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7857066f-7ef1-4706-bef8-3ca36d499465-maas-api-tls\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.654362 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.654340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qmg\" (UniqueName: \"kubernetes.io/projected/7857066f-7ef1-4706-bef8-3ca36d499465-kube-api-access-f4qmg\") pod \"maas-api-5c95bd9d87-chh48\" (UID: \"7857066f-7ef1-4706-bef8-3ca36d499465\") " pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.708469 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.708440 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:49.846118 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.846087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48"] Jul 01 22:30:49.849697 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:30:49.849667 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7857066f_7ef1_4706_bef8_3ca36d499465.slice/crio-a7843952e7cf30b96790b0ee292d902ad3b65b61210c6501b12e7b4cbdd24f13 WatchSource:0}: Error finding container a7843952e7cf30b96790b0ee292d902ad3b65b61210c6501b12e7b4cbdd24f13: Status 404 returned error can't find the container with id a7843952e7cf30b96790b0ee292d902ad3b65b61210c6501b12e7b4cbdd24f13 Jul 01 22:30:49.992899 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.992796 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4"] Jul 01 22:30:49.997274 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.997254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:49.999974 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:49.999954 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 22:30:50.002900 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.002845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" event={"ID":"7857066f-7ef1-4706-bef8-3ca36d499465","Type":"ContainerStarted","Data":"a7843952e7cf30b96790b0ee292d902ad3b65b61210c6501b12e7b4cbdd24f13"} Jul 01 22:30:50.007439 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.007418 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4"] Jul 01 22:30:50.150794 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.150753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfe4fcf8-7002-4626-9a1a-89580394a7cd-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.150794 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.150801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c6v5\" (UniqueName: \"kubernetes.io/projected/cfe4fcf8-7002-4626-9a1a-89580394a7cd-kube-api-access-9c6v5\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.155051 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.155026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:30:50.252288 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.252249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfe4fcf8-7002-4626-9a1a-89580394a7cd-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.252463 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.252295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c6v5\" (UniqueName: \"kubernetes.io/projected/cfe4fcf8-7002-4626-9a1a-89580394a7cd-kube-api-access-9c6v5\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.253069 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.253049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfe4fcf8-7002-4626-9a1a-89580394a7cd-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.261919 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.261897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c6v5\" (UniqueName: \"kubernetes.io/projected/cfe4fcf8-7002-4626-9a1a-89580394a7cd-kube-api-access-9c6v5\") pod \"payload-pre-processing-59f49fd4f6-ghbc4\" (UID: \"cfe4fcf8-7002-4626-9a1a-89580394a7cd\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.309602 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.309571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:50.443281 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:50.443244 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4"] Jul 01 22:30:50.446177 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:30:50.446151 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe4fcf8_7002_4626_9a1a_89580394a7cd.slice/crio-7ec86a9976096e1ec0297edad6658e37ca0f8d2bb060fec268233bf37c88c0ba WatchSource:0}: Error finding container 7ec86a9976096e1ec0297edad6658e37ca0f8d2bb060fec268233bf37c88c0ba: Status 404 returned error can't find the container with id 7ec86a9976096e1ec0297edad6658e37ca0f8d2bb060fec268233bf37c88c0ba Jul 01 22:30:51.009604 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:51.009558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" event={"ID":"cfe4fcf8-7002-4626-9a1a-89580394a7cd","Type":"ContainerStarted","Data":"7ec86a9976096e1ec0297edad6658e37ca0f8d2bb060fec268233bf37c88c0ba"} Jul 01 22:30:52.017444 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:52.017401 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" event={"ID":"7857066f-7ef1-4706-bef8-3ca36d499465","Type":"ContainerStarted","Data":"42d38a076e67725d604af2c90147f2945c4317cd05f2d3c58d0d424a276833eb"} Jul 01 22:30:52.017882 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:52.017469 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:52.039270 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:52.039212 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" podStartSLOduration=1.451841467 podStartE2EDuration="3.039188708s" totalImagesPullingTime="1.587347241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:30:52.038234785 +0000 UTC m=+551.058786010" watchObservedRunningTime="2026-07-01 22:30:52.039188708 +0000 UTC m=+551.059739933" Jul 01 22:30:53.024561 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:53.024527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" event={"ID":"cfe4fcf8-7002-4626-9a1a-89580394a7cd","Type":"ContainerStarted","Data":"515dde2e4b9f554c31169eddb24489ea292d96f3f08a0204f35d79c39b99968f"} Jul 01 22:30:53.024930 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:53.024615 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:30:58.031274 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:58.031242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c95bd9d87-chh48" Jul 01 22:30:58.051106 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:30:58.051058 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" podStartSLOduration=6.669059582 podStartE2EDuration="9.05104213s" totalImagesPullingTime="2.381982548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:30:53.041058468 +0000 UTC m=+552.061609694" watchObservedRunningTime="2026-07-01 22:30:58.05104213 +0000 UTC m=+557.071593356" Jul 01 22:31:04.031066 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:31:04.031031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-ghbc4" Jul 01 22:31:53.813062 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:31:53.813022 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:03.084872 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.084820 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4"] Jul 01 22:32:03.088445 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.088424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.091247 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.091231 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 22:32:03.092275 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.092247 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 22:32:03.092363 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.092279 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 22:32:03.092363 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.092285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f7bz4\"" Jul 01 22:32:03.098661 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.098641 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4"] Jul 01 22:32:03.248475 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.248576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.248576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr8xk\" (UniqueName: \"kubernetes.io/projected/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-kube-api-access-cr8xk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.248652 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.248652 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.248717 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.248650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349206 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349206 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349206 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349377 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr8xk\" (UniqueName: \"kubernetes.io/projected/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-kube-api-access-cr8xk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349377 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349377 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349689 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349799 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.349799 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.349757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.351616 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.351593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.351910 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.351891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.357777 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.357751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr8xk\" (UniqueName: \"kubernetes.io/projected/8a7a2840-c5bc-411b-af2b-2ecbbd55add9-kube-api-access-cr8xk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4snp4\" (UID: \"8a7a2840-c5bc-411b-af2b-2ecbbd55add9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.399973 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.399953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:03.529373 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.529346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4"] Jul 01 22:32:03.531267 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:32:03.531237 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7a2840_c5bc_411b_af2b_2ecbbd55add9.slice/crio-9a2ad3fecfc46bffc6b827ce53efea181616249ca1d60462d3594b3e60cd43da WatchSource:0}: Error finding container 9a2ad3fecfc46bffc6b827ce53efea181616249ca1d60462d3594b3e60cd43da: Status 404 returned error can't find the container with id 9a2ad3fecfc46bffc6b827ce53efea181616249ca1d60462d3594b3e60cd43da Jul 01 22:32:03.785386 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:03.785360 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:04.355297 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:04.355263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" event={"ID":"8a7a2840-c5bc-411b-af2b-2ecbbd55add9","Type":"ContainerStarted","Data":"9a2ad3fecfc46bffc6b827ce53efea181616249ca1d60462d3594b3e60cd43da"} Jul 01 22:32:05.363942 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:05.363901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" event={"ID":"8a7a2840-c5bc-411b-af2b-2ecbbd55add9","Type":"ContainerStarted","Data":"115371d1bc061ef5a411db15192cce4def7ebd3c0c7b318755b5d0651ab53f2c"} Jul 01 22:32:05.403823 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:05.403768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" podStartSLOduration=1.366262801 podStartE2EDuration="2.403748587s" totalImagesPullingTime="1.037485786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:32:05.402486923 +0000 UTC m=+624.423038149" watchObservedRunningTime="2026-07-01 22:32:05.403748587 +0000 UTC m=+624.424299857" Jul 01 22:32:13.400928 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:13.400882 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:13.401527 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:13.400959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:13.414619 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:13.414594 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:14.421633 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:14.421596 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4snp4" Jul 01 22:32:17.691459 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.691424 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb"] Jul 01 22:32:17.695005 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.694982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.697572 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.697550 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 22:32:17.706458 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.706435 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb"] Jul 01 22:32:17.755150 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.755260 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.755260 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.755260 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwlbh\" (UniqueName: \"kubernetes.io/projected/90ddadec-0c2f-4ab4-b99d-796d192c5310-kube-api-access-vwlbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.755375 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.755375 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.755292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ddadec-0c2f-4ab4-b99d-796d192c5310-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.855835 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.855955 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwlbh\" (UniqueName: \"kubernetes.io/projected/90ddadec-0c2f-4ab4-b99d-796d192c5310-kube-api-access-vwlbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.855955 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.855955 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ddadec-0c2f-4ab4-b99d-796d192c5310-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.855955 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.856140 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.855961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.856288 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.856263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.856357 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.856305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.856357 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.856321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.858307 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.858276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90ddadec-0c2f-4ab4-b99d-796d192c5310-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.858403 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.858379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ddadec-0c2f-4ab4-b99d-796d192c5310-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:17.864583 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:17.864559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwlbh\" (UniqueName: \"kubernetes.io/projected/90ddadec-0c2f-4ab4-b99d-796d192c5310-kube-api-access-vwlbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sccjb\" (UID: \"90ddadec-0c2f-4ab4-b99d-796d192c5310\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:18.004819 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.004793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:18.141163 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.141138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb"] Jul 01 22:32:18.143151 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:32:18.143124 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ddadec_0c2f_4ab4_b99d_796d192c5310.slice/crio-1753b9a57ccf0df8bd4b4272248130c0400f11d83d6689bd3035b399fb30b0c1 WatchSource:0}: Error finding container 1753b9a57ccf0df8bd4b4272248130c0400f11d83d6689bd3035b399fb30b0c1: Status 404 returned error can't find the container with id 1753b9a57ccf0df8bd4b4272248130c0400f11d83d6689bd3035b399fb30b0c1 Jul 01 22:32:18.429818 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.429783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" event={"ID":"90ddadec-0c2f-4ab4-b99d-796d192c5310","Type":"ContainerStarted","Data":"0ecdf78b67203aafc767b3321d27856707b8b2998737a7d634ae515fcc6ae8e0"} Jul 01 22:32:18.429947 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.429842 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" event={"ID":"90ddadec-0c2f-4ab4-b99d-796d192c5310","Type":"ContainerStarted","Data":"1753b9a57ccf0df8bd4b4272248130c0400f11d83d6689bd3035b399fb30b0c1"} Jul 01 22:32:18.450480 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.450439 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" podStartSLOduration=1.264453011 podStartE2EDuration="1.45042541s" totalImagesPullingTime="185.972399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:32:18.449540556 +0000 UTC m=+637.470091780" watchObservedRunningTime="2026-07-01 22:32:18.45042541 +0000 UTC m=+637.470976676" Jul 01 22:32:18.796500 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:18.796466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:24.386641 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:24.386603 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:28.005470 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:28.005433 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:28.006027 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:28.005511 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:28.017353 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:28.017327 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:28.484507 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:28.484438 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sccjb" Jul 01 22:32:33.687725 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.687688 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp"] Jul 01 22:32:33.691372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.691351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.693793 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.693773 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 22:32:33.700270 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.700249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp"] Jul 01 22:32:33.780376 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.780489 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.780489 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v55n\" (UniqueName: \"kubernetes.io/projected/18b088db-93cf-4479-9392-8742ebf56c8d-kube-api-access-6v55n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.780489 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.780585 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.780585 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.780548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18b088db-93cf-4479-9392-8742ebf56c8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881029 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v55n\" (UniqueName: \"kubernetes.io/projected/18b088db-93cf-4479-9392-8742ebf56c8d-kube-api-access-6v55n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881029 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881197 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881197 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18b088db-93cf-4479-9392-8742ebf56c8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881197 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881197 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881502 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881502 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881492 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.881588 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.881543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.883485 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.883460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18b088db-93cf-4479-9392-8742ebf56c8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.883632 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.883612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18b088db-93cf-4479-9392-8742ebf56c8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:33.888991 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:33.888968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v55n\" (UniqueName: \"kubernetes.io/projected/18b088db-93cf-4479-9392-8742ebf56c8d-kube-api-access-6v55n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r69kp\" (UID: \"18b088db-93cf-4479-9392-8742ebf56c8d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:34.003632 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:34.003609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:34.139944 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:34.139920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp"] Jul 01 22:32:34.141811 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:32:34.141782 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b088db_93cf_4479_9392_8742ebf56c8d.slice/crio-90668d7c9e0a2ded654348b1627a2a73875716798dcf63b636a1297c194852ec WatchSource:0}: Error finding container 90668d7c9e0a2ded654348b1627a2a73875716798dcf63b636a1297c194852ec: Status 404 returned error can't find the container with id 90668d7c9e0a2ded654348b1627a2a73875716798dcf63b636a1297c194852ec Jul 01 22:32:34.501813 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:34.501783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" event={"ID":"18b088db-93cf-4479-9392-8742ebf56c8d","Type":"ContainerStarted","Data":"e8648cd362550f809937ad9a52e0829b7e60accf8888dd765eda30cad7968b3f"} Jul 01 22:32:34.501962 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:34.501828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" event={"ID":"18b088db-93cf-4479-9392-8742ebf56c8d","Type":"ContainerStarted","Data":"90668d7c9e0a2ded654348b1627a2a73875716798dcf63b636a1297c194852ec"} Jul 01 22:32:34.523920 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:34.523851 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" podStartSLOduration=1.338565049 podStartE2EDuration="1.523835973s" totalImagesPullingTime="185.270924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:32:34.521405536 +0000 UTC m=+653.541956762" watchObservedRunningTime="2026-07-01 22:32:34.523835973 +0000 UTC m=+653.544387174" Jul 01 22:32:35.703801 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:35.703764 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:43.087494 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.087459 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t"] Jul 01 22:32:43.092012 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.091995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.094817 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.094794 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 22:32:43.102956 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.102936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t"] Jul 01 22:32:43.160767 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.160902 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh9kw\" (UniqueName: \"kubernetes.io/projected/eaeb43d6-f384-4107-a6de-123ba04ebf62-kube-api-access-sh9kw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.160902 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.160902 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.161030 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaeb43d6-f384-4107-a6de-123ba04ebf62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.161030 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.160967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.261948 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.261927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.261960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.261998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaeb43d6-f384-4107-a6de-123ba04ebf62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262065 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262223 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262223 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh9kw\" (UniqueName: \"kubernetes.io/projected/eaeb43d6-f384-4107-a6de-123ba04ebf62-kube-api-access-sh9kw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262446 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262545 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.262545 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.262512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.264271 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.264252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaeb43d6-f384-4107-a6de-123ba04ebf62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.264535 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.264517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaeb43d6-f384-4107-a6de-123ba04ebf62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.270458 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.270439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh9kw\" (UniqueName: \"kubernetes.io/projected/eaeb43d6-f384-4107-a6de-123ba04ebf62-kube-api-access-sh9kw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t\" (UID: \"eaeb43d6-f384-4107-a6de-123ba04ebf62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.401263 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.401209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:43.535996 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:43.535973 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t"] Jul 01 22:32:43.538670 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:32:43.538644 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaeb43d6_f384_4107_a6de_123ba04ebf62.slice/crio-7f8c71b0ec346abdcb9faf87deab8b58f5ef9aecd53a83c82ccf13064f493a37 WatchSource:0}: Error finding container 7f8c71b0ec346abdcb9faf87deab8b58f5ef9aecd53a83c82ccf13064f493a37: Status 404 returned error can't find the container with id 7f8c71b0ec346abdcb9faf87deab8b58f5ef9aecd53a83c82ccf13064f493a37 Jul 01 22:32:44.003742 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.003708 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:44.003891 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.003769 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:44.016126 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.016100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:44.549766 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.549737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" event={"ID":"eaeb43d6-f384-4107-a6de-123ba04ebf62","Type":"ContainerStarted","Data":"864745dd11b62993b700f7c286235a0f6e97169f4f5331b7b2d60f7f508f6bd7"} Jul 01 22:32:44.550248 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.549778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" event={"ID":"eaeb43d6-f384-4107-a6de-123ba04ebf62","Type":"ContainerStarted","Data":"7f8c71b0ec346abdcb9faf87deab8b58f5ef9aecd53a83c82ccf13064f493a37"} Jul 01 22:32:44.562008 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.561984 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r69kp" Jul 01 22:32:44.571823 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:44.571783 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" podStartSLOduration=1.3849929300000001 podStartE2EDuration="1.571768319s" totalImagesPullingTime="186.775389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:32:44.570473955 +0000 UTC m=+663.591025262" watchObservedRunningTime="2026-07-01 22:32:44.571768319 +0000 UTC m=+663.592319544" Jul 01 22:32:45.686976 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:45.686932 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jq7rt"] Jul 01 22:32:53.401533 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:53.401494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:53.401988 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:53.401591 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:53.422909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:53.422876 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:32:53.605230 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:32:53.605199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t" Jul 01 22:34:41.047584 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:41.047558 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6ffc8659-2jr7w_adb27d46-0f62-4c13-b728-b9ac71bc2825/copy-manifests/0.log" Jul 01 22:34:41.055553 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:41.055521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6ffc8659-2jr7w_adb27d46-0f62-4c13-b728-b9ac71bc2825/manager/0.log" Jul 01 22:34:43.027356 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:43.027326 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rrd6s_a774a9da-7c92-4e13-84c4-37709a312da8/kuadrant-console-plugin/0.log" Jul 01 22:34:43.408940 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:43.408830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jq7rt_20d70d50-3cb9-411e-830f-5aa46d26a659/limitador/0.log" Jul 01 22:34:44.122907 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:44.122874 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854f49787f-7dbzz_c19f0a71-9256-4b44-bebb-9bb8ea0c945e/kube-auth-proxy/0.log" Jul 01 22:34:44.465338 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:44.465257 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-ghbc4_cfe4fcf8-7002-4626-9a1a-89580394a7cd/payload-pre-processing/0.log" Jul 01 22:34:45.188073 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:45.188036 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4snp4_8a7a2840-c5bc-411b-af2b-2ecbbd55add9/main/0.log" Jul 01 22:34:45.309771 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:45.309740 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sccjb_90ddadec-0c2f-4ab4-b99d-796d192c5310/main/0.log" Jul 01 22:34:45.553521 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:45.553475 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-r69kp_18b088db-93cf-4479-9392-8742ebf56c8d/main/0.log" Jul 01 22:34:45.670510 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:45.670482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-c5l6t_eaeb43d6-f384-4107-a6de-123ba04ebf62/main/0.log" Jul 01 22:34:52.424120 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:52.424082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ksgr7_f4505d52-904f-4bd5-b0cb-b18930b7111a/global-pull-secret-syncer/0.log" Jul 01 22:34:52.514266 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:52.514240 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sd7xc_f4a11874-d207-48d9-beb2-7389fe32d839/konnectivity-agent/0.log" Jul 01 22:34:52.571188 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:52.571163 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-178.ec2.internal_630d830233945d606370114bbcf2182a/haproxy/0.log" Jul 01 22:34:57.295334 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:57.295305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rrd6s_a774a9da-7c92-4e13-84c4-37709a312da8/kuadrant-console-plugin/0.log" Jul 01 22:34:57.427959 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:57.427936 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jq7rt_20d70d50-3cb9-411e-830f-5aa46d26a659/limitador/0.log" Jul 01 22:34:59.141844 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.141812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/alertmanager/0.log" Jul 01 22:34:59.171372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.171349 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/config-reloader/0.log" Jul 01 22:34:59.194802 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.194775 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/kube-rbac-proxy-web/0.log" Jul 01 22:34:59.218637 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.218617 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/kube-rbac-proxy/0.log" Jul 01 22:34:59.244985 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.244964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/kube-rbac-proxy-metric/0.log" Jul 01 22:34:59.274720 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.274703 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/prom-label-proxy/0.log" Jul 01 22:34:59.302036 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.302020 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fc64f3b-b400-41db-9d46-b1ce4250c404/init-config-reloader/0.log" Jul 01 22:34:59.385024 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.384994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-state-metrics/0.log" Jul 01 22:34:59.407296 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.407233 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-rbac-proxy-main/0.log" Jul 01 22:34:59.434982 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.434961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-pm6n2_49f7d556-42f9-4066-9fc4-7eba00c9f45a/kube-rbac-proxy-self/0.log" Jul 01 22:34:59.461631 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.461615 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-687679989c-zlmbh_a6bb6b95-3008-48b5-af50-4a5fb0b6401f/metrics-server/0.log" Jul 01 22:34:59.576218 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.576200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/node-exporter/0.log" Jul 01 22:34:59.620179 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.620160 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/kube-rbac-proxy/0.log" Jul 01 22:34:59.655423 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.655404 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cnmj_de21620d-ddfc-4824-9923-d2038bc52c1b/init-textfile/0.log" Jul 01 22:34:59.885352 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.885328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/kube-rbac-proxy-main/0.log" Jul 01 22:34:59.912353 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.912330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/kube-rbac-proxy-self/0.log" Jul 01 22:34:59.935944 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.935917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-h5qgz_fe1d5e4a-54f3-4209-8b19-dd6293a2bc7f/openshift-state-metrics/0.log" Jul 01 22:34:59.981113 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:34:59.981100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/prometheus/0.log" Jul 01 22:35:00.004805 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.004789 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/config-reloader/0.log" Jul 01 22:35:00.033093 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.033037 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/thanos-sidecar/0.log" Jul 01 22:35:00.057509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.057491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/kube-rbac-proxy-web/0.log" Jul 01 22:35:00.080986 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.080970 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/kube-rbac-proxy/0.log" Jul 01 22:35:00.113142 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.113126 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/kube-rbac-proxy-thanos/0.log" Jul 01 22:35:00.139673 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.139657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6eb11914-468b-4ae7-baf6-3c37a8c529f7/init-config-reloader/0.log" Jul 01 22:35:00.173138 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.173120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-mgtwb_060121e4-de31-42ec-ac6f-96188951d0cc/prometheus-operator/0.log" Jul 01 22:35:00.195965 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.195944 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-mgtwb_060121e4-de31-42ec-ac6f-96188951d0cc/kube-rbac-proxy/0.log" Jul 01 22:35:00.224033 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.224012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-6hxhf_acc5d231-71cd-4532-8113-f7baec18344b/prometheus-operator-admission-webhook/0.log" Jul 01 22:35:00.266321 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.266264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/telemeter-client/0.log" Jul 01 22:35:00.291244 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.291177 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/reload/0.log" Jul 01 22:35:00.322360 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:00.322340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764d9dd659-w66zq_f9614e66-d48a-4ce8-8477-849946c98879/kube-rbac-proxy/0.log" Jul 01 22:35:02.499098 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.499061 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls"] Jul 01 22:35:02.502747 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.502728 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.517746 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.517724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spcv6\"/\"kube-root-ca.crt\"" Jul 01 22:35:02.518874 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.518841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spcv6\"/\"openshift-service-ca.crt\"" Jul 01 22:35:02.518874 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.518869 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-spcv6\"/\"default-dockercfg-v9l84\"" Jul 01 22:35:02.537443 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.537419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls"] Jul 01 22:35:02.594689 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.594663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-lib-modules\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.594797 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.594717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb48x\" (UniqueName: \"kubernetes.io/projected/dc62b527-6a6b-4597-b7f6-55f14274ddfa-kube-api-access-mb48x\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.594845 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.594814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-sys\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.594909 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.594847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-podres\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.594944 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.594927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-proc\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695269 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-sys\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-podres\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-proc\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695372 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-sys\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-lib-modules\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-proc\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-podres\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb48x\" (UniqueName: \"kubernetes.io/projected/dc62b527-6a6b-4597-b7f6-55f14274ddfa-kube-api-access-mb48x\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.695509 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.695473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc62b527-6a6b-4597-b7f6-55f14274ddfa-lib-modules\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.712399 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.712374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb48x\" (UniqueName: \"kubernetes.io/projected/dc62b527-6a6b-4597-b7f6-55f14274ddfa-kube-api-access-mb48x\") pod \"perf-node-gather-daemonset-zxhls\" (UID: \"dc62b527-6a6b-4597-b7f6-55f14274ddfa\") " pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.813951 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.813901 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:02.951534 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:02.951502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls"] Jul 01 22:35:02.954610 ip-10-0-128-178 kubenswrapper[2577]: W0701 22:35:02.954587 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc62b527_6a6b_4597_b7f6_55f14274ddfa.slice/crio-0d9a42fcb22ea46e4430932645308948af5d94a4fb77e9b3c24e5509ead54cab WatchSource:0}: Error finding container 0d9a42fcb22ea46e4430932645308948af5d94a4fb77e9b3c24e5509ead54cab: Status 404 returned error can't find the container with id 0d9a42fcb22ea46e4430932645308948af5d94a4fb77e9b3c24e5509ead54cab Jul 01 22:35:03.230463 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:03.230376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" event={"ID":"dc62b527-6a6b-4597-b7f6-55f14274ddfa","Type":"ContainerStarted","Data":"06ea66466a660b76ebaf6270d408b8b453ccef929bfcbd6a359526b1e639fdbc"} Jul 01 22:35:03.230463 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:03.230440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" event={"ID":"dc62b527-6a6b-4597-b7f6-55f14274ddfa","Type":"ContainerStarted","Data":"0d9a42fcb22ea46e4430932645308948af5d94a4fb77e9b3c24e5509ead54cab"} Jul 01 22:35:03.230603 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:03.230526 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:03.250133 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:03.250088 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" podStartSLOduration=1.2500746569999999 podStartE2EDuration="1.250074657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:35:03.247839385 +0000 UTC m=+802.268390611" watchObservedRunningTime="2026-07-01 22:35:03.250074657 +0000 UTC m=+802.270625880" Jul 01 22:35:04.852132 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:04.852094 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k6t78_c3cef175-e9c7-4fcb-80af-f08c584446b4/dns/0.log" Jul 01 22:35:04.876662 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:04.876635 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k6t78_c3cef175-e9c7-4fcb-80af-f08c584446b4/kube-rbac-proxy/0.log" Jul 01 22:35:04.930405 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:04.930385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kfhsc_baaf8382-fb94-42cf-8342-7533e64353ce/dns-node-resolver/0.log" Jul 01 22:35:05.518421 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:05.518395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqdjp_bfcb3029-16b7-4d4c-b8d2-94b5bd0eaecb/node-ca/0.log" Jul 01 22:35:06.599521 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:06.599484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854f49787f-7dbzz_c19f0a71-9256-4b44-bebb-9bb8ea0c945e/kube-auth-proxy/0.log" Jul 01 22:35:06.680797 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:06.680767 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-ghbc4_cfe4fcf8-7002-4626-9a1a-89580394a7cd/payload-pre-processing/0.log" Jul 01 22:35:07.436790 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:07.436761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zrnb9_e33e11b1-2d54-4a08-82db-5a5fd22a03be/serve-healthcheck-canary/0.log" Jul 01 22:35:08.105394 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:08.105368 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhs8j_54a67656-66f0-4da5-8db4-58d13e6489d8/kube-rbac-proxy/0.log" Jul 01 22:35:08.128099 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:08.128069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhs8j_54a67656-66f0-4da5-8db4-58d13e6489d8/exporter/0.log" Jul 01 22:35:08.152682 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:08.152656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qhs8j_54a67656-66f0-4da5-8db4-58d13e6489d8/extractor/0.log" Jul 01 22:35:09.245515 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:09.245491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-spcv6/perf-node-gather-daemonset-zxhls" Jul 01 22:35:10.534567 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:10.534532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6ffc8659-2jr7w_adb27d46-0f62-4c13-b728-b9ac71bc2825/manager/0.log" Jul 01 22:35:10.561769 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:10.561745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6ffc8659-2jr7w_adb27d46-0f62-4c13-b728-b9ac71bc2825/copy-manifests/0.log" Jul 01 22:35:12.288730 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:12.288705 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-658788d8fc-sc5ml_3113c1a4-ff46-4893-a54a-31ebd9eb8852/manager/0.log" Jul 01 22:35:13.167641 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:13.167597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854f49787f-7dbzz_c19f0a71-9256-4b44-bebb-9bb8ea0c945e/kube-auth-proxy/0.log" Jul 01 22:35:13.240173 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:13.240149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-ghbc4_cfe4fcf8-7002-4626-9a1a-89580394a7cd/payload-pre-processing/0.log" Jul 01 22:35:14.525246 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:14.525204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-854f49787f-7dbzz_c19f0a71-9256-4b44-bebb-9bb8ea0c945e/kube-auth-proxy/0.log" Jul 01 22:35:14.588070 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:14.588042 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-ghbc4_cfe4fcf8-7002-4626-9a1a-89580394a7cd/payload-pre-processing/0.log" Jul 01 22:35:18.888227 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:18.888201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/kube-multus-additional-cni-plugins/0.log" Jul 01 22:35:18.911847 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:18.911816 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/egress-router-binary-copy/0.log" Jul 01 22:35:18.933916 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:18.933894 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/cni-plugins/0.log" Jul 01 22:35:18.956019 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:18.955994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/bond-cni-plugin/0.log" Jul 01 22:35:18.977564 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:18.977541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/routeoverride-cni/0.log" Jul 01 22:35:19.002348 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:19.002327 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/whereabouts-cni-bincopy/0.log" Jul 01 22:35:19.026684 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:19.026667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvvrm_7e9b48c6-fa84-4094-b01a-240210d5f091/whereabouts-cni/0.log" Jul 01 22:35:19.531726 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:19.531694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpd9p_dbb342d6-29e2-45da-82c1-bbfd57078bf2/kube-multus/0.log" Jul 01 22:35:19.555772 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:19.555749 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6lntk_f5e2ff3e-e306-4e63-9cf6-f273ed049a20/network-metrics-daemon/0.log" Jul 01 22:35:19.578576 ip-10-0-128-178 kubenswrapper[2577]: I0701 22:35:19.578553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6lntk_f5e2ff3e-e306-4e63-9cf6-f273ed049a20/kube-rbac-proxy/0.log"