Jul 06 14:26:52.020555 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 14:26:52.020570 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 14:26:52.020580 ip-10-0-137-144 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 14:26:52.021299 ip-10-0-137-144 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 14:27:02.129670 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 14:27:02.129687 ip-10-0-137-144 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f9b67c77e32c48c8b820dd67925c49ca -- Jul 06 14:28:55.579965 ip-10-0-137-144 systemd[1]: Starting Kubernetes Kubelet... Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.949688 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955630 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955644 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955664 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955668 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955671 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955674 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955677 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.019836 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955680 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955682 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955685 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955688 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955691 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955693 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955696 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955698 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955701 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955704 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955707 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955710 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955712 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955715 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955717 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955720 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955724 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955726 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955729 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.021082 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955733 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955738 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955749 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955754 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955757 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955760 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955763 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955766 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955769 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955772 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955774 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955777 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955780 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955783 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955786 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955789 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955791 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955794 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955797 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.022005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955800 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955802 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955805 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955809 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955812 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955814 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955817 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955820 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955822 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955825 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955827 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955830 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955833 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955836 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955838 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955841 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955844 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955846 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955849 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955853 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.022624 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955855 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955858 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955861 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955863 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955866 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955869 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955871 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955874 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955876 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955879 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955881 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955884 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955886 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955888 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955891 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955895 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955898 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955900 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955903 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955906 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.023215 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955908 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955912 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955914 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955917 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955920 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955922 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955925 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955928 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955930 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955933 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955936 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955938 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955941 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.955943 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956675 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956682 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956685 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956688 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956691 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.023922 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956693 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956696 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956699 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956703 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956707 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956710 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956713 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956716 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956720 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956723 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956725 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956728 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956731 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956733 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956736 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956738 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956741 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956743 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956746 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956749 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.024527 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956751 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956754 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956756 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956759 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956762 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956765 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956767 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956770 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956773 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956775 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956778 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956781 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956784 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956786 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956789 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956791 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956794 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956796 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956799 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956802 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.025184 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956804 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956807 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956810 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956812 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956816 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956818 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956821 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956823 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956826 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956829 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956832 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956834 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956837 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956840 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956842 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956845 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956848 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956850 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956853 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.025805 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956856 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956860 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956862 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956866 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956869 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956871 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956874 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956877 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956879 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956882 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956884 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956887 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956890 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956894 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956897 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956900 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956903 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956906 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956909 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956911 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.027468 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956914 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956917 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956919 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956921 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956924 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956927 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956930 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956932 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956935 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956937 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956940 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956943 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956945 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956948 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.956951 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957308 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957313 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957316 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957319 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957321 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.028301 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957324 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957327 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957329 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957332 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957334 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957337 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957342 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957344 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957347 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957349 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957352 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957355 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957357 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957360 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957363 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957365 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957368 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957371 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957373 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957377 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.028918 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957381 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957384 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957388 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957391 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957394 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957397 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957399 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957402 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957404 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957406 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957409 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957411 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957414 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957417 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957419 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957424 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957426 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957429 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957433 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957436 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.029540 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957439 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957442 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957444 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957447 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957450 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957452 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957455 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957457 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957460 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957463 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957466 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957471 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957475 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957478 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957481 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957484 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957487 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957490 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957493 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.030181 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957496 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957498 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957501 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957503 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957506 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957508 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957511 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957513 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957517 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957519 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957522 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957526 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957528 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957531 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957534 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957536 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957539 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957541 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957544 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957546 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.030794 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957549 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957551 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957554 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957556 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957559 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957561 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957564 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957566 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957569 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957572 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957574 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957577 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957579 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957581 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.957584 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957661 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957668 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957674 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957678 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957682 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957686 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 14:28:56.031408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957690 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957695 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957699 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957702 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957705 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957709 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957712 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957715 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957718 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957720 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957724 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957727 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957730 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957733 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957736 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957740 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957743 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957747 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957750 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957753 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957756 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957760 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957763 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957766 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 14:28:56.032015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957769 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957771 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957776 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957779 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957782 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957785 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957788 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957792 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957796 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957799 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957803 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957806 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957809 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957813 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957816 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957819 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957822 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957824 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957827 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957830 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957833 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957835 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957838 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957841 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957845 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 14:28:56.032665 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957848 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957851 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957854 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957857 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957860 2581 flags.go:64] FLAG: --help="false" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957864 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957867 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957870 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957873 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957876 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957880 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957883 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957885 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957888 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957892 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957895 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957898 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957902 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957905 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957908 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957911 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957913 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957916 2581 flags.go:64] FLAG: --lock-file="" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957919 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 14:28:56.033514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957922 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957925 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957930 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957933 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957936 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957939 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957942 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957945 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957948 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957951 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957955 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957958 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957962 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957965 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957969 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957972 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957974 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957978 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957981 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957984 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957992 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.957995 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958000 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 14:28:56.034457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958002 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958006 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958020 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958026 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958029 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958032 2581 flags.go:64] FLAG: --port="10250" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958035 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958038 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0095457c5fe3f17a3" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958041 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958044 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958048 2581 flags.go:64] FLAG: --register-node="true" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958050 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958058 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958061 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958064 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958067 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958070 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958073 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958076 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958079 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958082 2581 flags.go:64] FLAG: --runonce="false" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958085 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958088 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958091 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958094 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 14:28:56.035115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958097 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958100 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958103 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958106 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958109 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958111 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958116 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958128 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958131 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958134 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958139 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958144 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958147 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958150 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958154 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958156 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958159 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958162 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958165 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958168 2581 flags.go:64] FLAG: --v="2" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958172 2581 flags.go:64] FLAG: --version="false" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958176 2581 flags.go:64] FLAG: --vmodule="" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958179 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.958182 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958739 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.094907 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958744 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.037736 ip-10-0-137-144 systemd[1]: Started Kubernetes Kubelet. Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958747 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958750 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958753 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958756 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958758 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958761 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958764 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958767 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958769 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958772 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958774 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958777 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958781 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958784 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958786 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958790 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958796 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958799 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.096019 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958802 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958805 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958807 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958810 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958812 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958815 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958817 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958821 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958823 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958825 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958828 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958847 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958851 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958854 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958857 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958860 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958863 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958865 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958868 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958871 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.097233 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958873 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958876 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958879 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958881 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958884 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958886 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958890 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958893 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958895 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958898 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958903 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958905 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958908 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958910 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958913 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958916 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958918 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958921 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958924 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958926 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.098393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958928 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958931 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958934 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958937 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958939 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958942 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958944 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958947 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958949 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958952 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958954 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958957 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958959 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958962 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958967 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958969 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958972 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958974 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958978 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958981 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.099393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958983 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958986 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958990 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958994 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.958997 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959000 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959003 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959005 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959008 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959010 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959013 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959016 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959018 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959020 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959024 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959028 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959031 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959034 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.100035 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.959037 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.959045 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.970139 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.970172 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.970198 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.970211 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970450 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970471 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970476 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970488 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970492 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970497 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970501 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970506 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970510 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.100606 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970514 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970518 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970523 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970528 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970538 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970543 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970548 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970557 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970560 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970563 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970566 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970569 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970572 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970576 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970579 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970582 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970602 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970673 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970767 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.101103 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970771 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970774 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970778 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970781 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970784 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970787 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970791 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970794 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970797 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970799 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970802 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970805 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970808 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970811 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970813 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970817 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970819 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970824 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970829 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.101717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970832 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970835 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970838 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970841 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970844 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970847 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970850 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970854 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970857 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970860 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970863 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970870 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970874 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970878 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970882 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970884 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970887 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970889 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970892 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970895 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.102400 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970897 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970900 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970903 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970906 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970908 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970911 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970914 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970917 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970920 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970922 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970925 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970928 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970931 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970934 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970936 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970939 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970942 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970945 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970947 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970950 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.103050 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970953 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970956 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970959 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970961 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970964 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970966 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970969 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970972 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970976 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970979 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970982 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.970985 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.970990 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971135 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971140 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:28:56.103784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971143 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971146 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971148 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971151 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971156 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971158 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971160 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971163 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971166 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971169 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971172 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971175 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971178 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971181 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971183 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971186 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971188 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971192 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971196 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:28:56.104240 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971199 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971205 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971208 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971210 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971213 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971216 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971218 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971221 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971223 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971226 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971229 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971232 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971234 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971237 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971239 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971242 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971245 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971249 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971251 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971254 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:28:56.104817 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971257 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971259 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971262 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971265 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971268 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971270 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971273 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971275 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971278 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971280 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971283 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971286 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971288 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971292 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971295 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971297 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971300 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971302 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971305 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971307 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:28:56.105393 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971310 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971312 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971315 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971317 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971319 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971322 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971325 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971327 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971329 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971333 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971336 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971338 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971341 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971343 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971346 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971348 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971351 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971354 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971356 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971359 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:28:56.105979 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971362 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971365 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971368 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971371 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971375 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971379 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971382 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971384 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971387 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971390 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971394 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971397 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971400 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971403 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971405 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971408 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971411 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:28:56.106717 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:55.971413 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.971419 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.971528 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.973743 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.975053 2581 server.go:1019] "Starting client certificate rotation" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.975153 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.975186 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.978178 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.979319 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.993040 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:55.995446 2581 log.go:25] "Validated CRI v1 image API" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.000710 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 14:28:56.107983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.003013 2581 fs.go:135] Filesystem UUIDs: map[12cb4745-68b8-448f-a383-1da4de1de056:/dev/nvme0n1p3 1495c174-e2e9-4a0a-8f95-cd593b400829:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 06 14:28:56.219153 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.003045 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 14:28:56.219153 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.005790 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.008028 2581 manager.go:216] Machine: {Timestamp:2026-07-06 14:28:56.00664466 +0000 UTC m=+0.306832135 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103783 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256edb89bb03a811faaf4388cc29bd SystemUUID:ec256edb-89bb-03a8-11fa-af4388cc29bd BootID:f9b67c77-e32c-48c8-b820-dd67925c49ca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:26:cb:c3:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:26:cb:c3:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:7b:e2:c4:cb:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.008138 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.008270 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.010665 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.010687 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.011443 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.011452 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.011459 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.011481 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.012940 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.016973 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017093 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017121 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017136 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017153 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017162 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017174 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 14:28:56.240504 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017611 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.017630 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.022052 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.024233 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.024269 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026087 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026101 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026108 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026114 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026133 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.026140 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032220 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032233 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032242 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032250 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032259 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.032264 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.033337 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.033340 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.033743 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.033752 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.036760 2581 server.go:1268] "Started kubelet" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.037452 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.037642 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.037728 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.039461 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.039495 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.042000 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.042986 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.043998 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18bfb9ae5f53139c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-07-06 14:28:56.036733852 +0000 UTC m=+0.336921328,LastTimestamp:2026-07-06 14:28:56.036733852 +0000 UTC m=+0.336921328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.045686 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.045750 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.045780 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046303 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046320 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046356 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046618 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046634 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046782 2581 factory.go:55] Registering systemd factory Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.046797 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.047118 2581 factory.go:153] Registering CRI-O factory Jul 06 14:28:56.241586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.047136 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.047203 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.047232 2581 factory.go:103] Registering Raw factory Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.047259 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.048564 2581 manager.go:349] Starting recovery of all containers Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.054988 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.055898 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.057891 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wjlpl" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.061509 2581 manager.go:354] Recovery completed Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.066627 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.066747 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wjlpl" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069160 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069190 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069203 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069728 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069736 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069752 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.069797 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.070507 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.070538 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.070552 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.071309 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18bfb9ae614215b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-144.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-07-06 14:28:56.069174706 +0000 UTC m=+0.369362184,LastTimestamp:2026-07-06 14:28:56.069174706 +0000 UTC m=+0.369362184,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.071812 2581 policy_none.go:49] "None policy: Start" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.071826 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.071838 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.073879 2581 policy_none.go:47] "Start" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.131334 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.131522 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.131537 2581 server.go:87] "Starting device plugin registration server" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.131801 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.131813 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.133862 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.133919 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.133926 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.134574 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.134611 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.227522 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.228800 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.228839 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 14:28:56.242869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.228860 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.228898 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.231786 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.231892 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.233294 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.233327 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.233343 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.233367 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.240253 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.245159 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.240275 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-144.ec2.internal\": node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.322145 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.262894 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.329298 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal"] Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.329363 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.330332 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.330359 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.330372 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.332888 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333032 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333701 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333709 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333728 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333731 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333738 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.333743 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.336057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.336080 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.342402 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.342435 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.342454 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.349900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.349932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.349951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.363589 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.380624 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.385636 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.455923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.457218 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451059 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.457218 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.457218 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.451192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.602351 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.464693 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.602351 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.565026 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.726165 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.665736 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.726165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.685314 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.726165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.689517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:56.866301 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.766236 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:56.869432 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.866945 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:57.003374 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:56.968082 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:57.003374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.974726 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 14:28:57.003374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:56.974879 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 14:28:57.167481 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:57.068856 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:57.167481 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.070017 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:23:56 +0000 UTC" deadline="2028-02-22 11:00:01.615163548 +0000 UTC" Jul 06 14:28:57.167481 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.070041 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14300h31m4.545125432s" Jul 06 14:28:57.169890 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:57.169853 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:57.271039 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:57.271001 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 06 14:28:57.281082 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.281059 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:28:57.338840 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.338808 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:28:57.346837 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.346808 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 06 14:28:57.359650 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.359625 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:28:57.360550 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.360530 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 06 14:28:57.372097 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.372075 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:28:57.436349 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.436324 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:28:57.440005 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:57.439972 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3daa949ad2399aa2ae00a9f45c827ee.slice/crio-770f824a51ee5307469f51dda67fcdb7793e08eb3af42aefd1f86ec143ab26d6 WatchSource:0}: Error finding container 770f824a51ee5307469f51dda67fcdb7793e08eb3af42aefd1f86ec143ab26d6: Status 404 returned error can't find the container with id 770f824a51ee5307469f51dda67fcdb7793e08eb3af42aefd1f86ec143ab26d6 Jul 06 14:28:57.440409 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:57.440381 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e15b28acdfde5fc6df129862ecf92ac.slice/crio-8b8bd89bb61946f7730fd29ee98c74408f2a154eb67ee1e9f585e4226c1a45d1 WatchSource:0}: Error finding container 8b8bd89bb61946f7730fd29ee98c74408f2a154eb67ee1e9f585e4226c1a45d1: Status 404 returned error can't find the container with id 8b8bd89bb61946f7730fd29ee98c74408f2a154eb67ee1e9f585e4226c1a45d1 Jul 06 14:28:57.445588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:57.445574 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:28:58.018470 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.018399 2581 apiserver.go:52] "Watching apiserver" Jul 06 14:28:58.031457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.031422 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 14:28:58.032874 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.032840 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-9l98g","openshift-multus/multus-additional-cni-plugins-pwfcl","openshift-network-diagnostics/network-check-target-wjxvb","openshift-ovn-kubernetes/ovnkube-node-95lxd","kube-system/global-pull-secret-syncer-vdvhc","kube-system/konnectivity-agent-4lp6t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd","openshift-cluster-node-tuning-operator/tuned-8vfrz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","openshift-multus/multus-cvk9z","openshift-multus/network-metrics-daemon-8r5bn","openshift-network-operator/iptables-alerter-vd8nz","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal","openshift-dns/node-resolver-hsx8l"] Jul 06 14:28:58.036102 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.036071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.038144 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.038090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.039588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.039563 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 14:28:58.039729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.039594 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 14:28:58.039729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.039671 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.039968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.039936 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.039968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.039952 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q99x9\"" Jul 06 14:28:58.040420 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.040397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:28:58.040524 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.040483 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:28:58.040595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.040533 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 14:28:58.041015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.040994 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gskn7\"" Jul 06 14:28:58.041428 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.041212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 14:28:58.042903 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.042881 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.046452 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.046380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.047247 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.046760 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 14:28:58.047247 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.047111 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.047402 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.047260 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvf5d\"" Jul 06 14:28:58.047668 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.047466 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.048494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.048430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.049692 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.049670 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 14:28:58.049901 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.049883 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.049984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.049910 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.050046 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.050006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hh8bs\"" Jul 06 14:28:58.050889 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.050865 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.051007 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.050989 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.051511 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.051488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.051594 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.051575 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:28:58.052691 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.052668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 14:28:58.052948 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.052929 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pxb5\"" Jul 06 14:28:58.054204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.054183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.056952 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.056908 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 14:28:58.057176 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.057151 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.057356 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.057304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75tjn\"" Jul 06 14:28:58.057356 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.057350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.057502 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.057426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.057502 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.057489 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:28:58.059932 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.059911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.062922 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.062778 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 14:28:58.062922 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.062807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.063077 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.062933 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 14:28:58.063417 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.063400 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pv8dm\"" Jul 06 14:28:58.065074 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.065053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.066564 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.066481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.066686 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.066488 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 14:28:58.067053 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-daemon-config\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.067184 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.067184 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.067184 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067159 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 14:28:58.067387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-sys\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.067387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-host\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.067387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-etc-tuned\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.067387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-cni-binary-copy\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.067595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.067595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.067595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.067595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-registration-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.067891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-device-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.067891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-sys-fs\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.067891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067655 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 14:28:58.067891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.067891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.067819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-96jvk\"" Jul 06 14:28:58.068146 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.068012 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069462 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069682 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-cnibin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-bin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-systemd\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx26t\" (UniqueName: \"kubernetes.io/projected/240db578-3cbf-4c1d-843f-49db38108961-kube-api-access-vx26t\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.069909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-os-release\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwf9p\" (UniqueName: \"kubernetes.io/projected/7608de2c-e75f-4761-8d79-4fe138151872-kube-api-access-kwf9p\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.069984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-kubernetes\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070047 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7df0c87f-5561-432f-8dc1-51a963845932-iptables-alerter-script\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-system-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-k8s-cni-cncf-io\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-kubelet\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshbd\" (UniqueName: \"kubernetes.io/projected/06150e0c-dfaa-4d81-9c52-8e018705f50f-kube-api-access-mshbd\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-cnibin\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysconfig\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.070462 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-lib-modules\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-os-release\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-socket-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7df0c87f-5561-432f-8dc1-51a963845932-host-slash\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-hostroot\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-multus-certs\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-etc-kubernetes\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-conf\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m87tn\"" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-var-lib-kubelet\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-socket-dir-parent\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-multus\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.070946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-modprobe-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-run\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-tmp\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxs4\" (UniqueName: \"kubernetes.io/projected/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kube-api-access-5mxs4\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcf7\" (UniqueName: \"kubernetes.io/projected/7df0c87f-5561-432f-8dc1-51a963845932-kube-api-access-wkcf7\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.071152 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-netns\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.071933 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.071216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-conf-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.122071 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.122038 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rx4x" Jul 06 14:28:58.132436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.132361 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rx4x" Jul 06 14:28:58.148259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.148230 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 14:28:58.172258 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-socket-dir-parent\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-modprobe-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-run\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-ovn\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-log-socket\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovn-node-metrics-cert\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-socket-dir-parent\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-sys\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-host\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172503 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-modprobe-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-etc-tuned\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-sys\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-device-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-script-lib\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-cni-binary-copy\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-device-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-host\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-run\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-registration-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d962d31d-9269-4268-a2e6-b618f4f26883-host\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-registration-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-systemd-units\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.172987 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-node-log\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.173984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-dbus\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173092 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-kubernetes\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-etc-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-system-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-kubernetes\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-k8s-cni-cncf-io\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-cnibin\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-cni-binary-copy\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysconfig\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173352 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-system-cni-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-k8s-cni-cncf-io\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.174647 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-os-release\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-cnibin\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysconfig\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-d\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-socket-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-os-release\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7df0c87f-5561-432f-8dc1-51a963845932-host-slash\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7df0c87f-5561-432f-8dc1-51a963845932-host-slash\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-var-lib-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-multus-certs\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173574 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-socket-dir\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-etc-kubernetes\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-multus-certs\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-conf\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-netns\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173693 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-etc-kubernetes\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-config\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.175518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-sysctl-conf\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a4da98-5148-4c51-a7b9-d6bc71aec658-hosts-file\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/827bd3e9-156d-49cb-8697-fa703a1cb74b-konnectivity-ca\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d962d31d-9269-4268-a2e6-b618f4f26883-serviceca\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-multus\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-tmp\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-multus\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxs4\" (UniqueName: \"kubernetes.io/projected/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kube-api-access-5mxs4\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcf7\" (UniqueName: \"kubernetes.io/projected/7df0c87f-5561-432f-8dc1-51a963845932-kube-api-access-wkcf7\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.173996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a4da98-5148-4c51-a7b9-d6bc71aec658-tmp-dir\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-netns\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-conf-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-daemon-config\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-sys-fs\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-slash\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-bin\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-env-overrides\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.176263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-run-netns\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-kubelet-config\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174316 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-conf-dir\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174513 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-sys-fs\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/827bd3e9-156d-49cb-8697-fa703a1cb74b-agent-certs\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-cnibin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-bin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-cnibin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-systemd\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx26t\" (UniqueName: \"kubernetes.io/projected/240db578-3cbf-4c1d-843f-49db38108961-kube-api-access-vx26t\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.174964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7df0c87f-5561-432f-8dc1-51a963845932-iptables-alerter-script\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjkpm\" (UniqueName: \"kubernetes.io/projected/88a4da98-5148-4c51-a7b9-d6bc71aec658-kube-api-access-jjkpm\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-os-release\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06150e0c-dfaa-4d81-9c52-8e018705f50f-multus-daemon-config\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwf9p\" (UniqueName: \"kubernetes.io/projected/7608de2c-e75f-4761-8d79-4fe138151872-kube-api-access-kwf9p\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnvc\" (UniqueName: \"kubernetes.io/projected/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-kube-api-access-kjnvc\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7608de2c-e75f-4761-8d79-4fe138151872-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rdv\" (UniqueName: \"kubernetes.io/projected/592dadfd-7458-4b83-82df-9796c2071bdf-kube-api-access-v6rdv\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtng\" (UniqueName: \"kubernetes.io/projected/d962d31d-9269-4268-a2e6-b618f4f26883-kube-api-access-lqtng\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-kubelet\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshbd\" (UniqueName: \"kubernetes.io/projected/06150e0c-dfaa-4d81-9c52-8e018705f50f-kube-api-access-mshbd\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7608de2c-e75f-4761-8d79-4fe138151872-os-release\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-kubelet\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-lib-modules\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-lib-modules\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-netd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-systemd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-hostroot\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-var-lib-kubelet\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.177959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-hostroot\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-kubelet\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7df0c87f-5561-432f-8dc1-51a963845932-iptables-alerter-script\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06150e0c-dfaa-4d81-9c52-8e018705f50f-host-var-lib-cni-bin\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-etc-systemd\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240db578-3cbf-4c1d-843f-49db38108961-var-lib-kubelet\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.178775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.175911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.181622 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.181558 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-etc-tuned\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.182225 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.182197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240db578-3cbf-4c1d-843f-49db38108961-tmp\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.188604 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.187412 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:28:58.188604 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.187437 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:28:58.188604 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.187450 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:58.188604 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.187527 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:28:58.68749613 +0000 UTC m=+2.987683621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:58.192316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.191752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwf9p\" (UniqueName: \"kubernetes.io/projected/7608de2c-e75f-4761-8d79-4fe138151872-kube-api-access-kwf9p\") pod \"multus-additional-cni-plugins-pwfcl\" (UID: \"7608de2c-e75f-4761-8d79-4fe138151872\") " pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.192316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.192269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxs4\" (UniqueName: \"kubernetes.io/projected/3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0-kube-api-access-5mxs4\") pod \"aws-ebs-csi-driver-node-cjcrd\" (UID: \"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.192316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.192289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx26t\" (UniqueName: \"kubernetes.io/projected/240db578-3cbf-4c1d-843f-49db38108961-kube-api-access-vx26t\") pod \"tuned-8vfrz\" (UID: \"240db578-3cbf-4c1d-843f-49db38108961\") " pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.192739 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.192699 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshbd\" (UniqueName: \"kubernetes.io/projected/06150e0c-dfaa-4d81-9c52-8e018705f50f-kube-api-access-mshbd\") pod \"multus-cvk9z\" (UID: \"06150e0c-dfaa-4d81-9c52-8e018705f50f\") " pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.193619 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.193576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcf7\" (UniqueName: \"kubernetes.io/projected/7df0c87f-5561-432f-8dc1-51a963845932-kube-api-access-wkcf7\") pod \"iptables-alerter-vd8nz\" (UID: \"7df0c87f-5561-432f-8dc1-51a963845932\") " pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.236612 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.236553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerStarted","Data":"8b8bd89bb61946f7730fd29ee98c74408f2a154eb67ee1e9f585e4226c1a45d1"} Jul 06 14:28:58.239921 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.239884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"a3daa949ad2399aa2ae00a9f45c827ee","Type":"ContainerStarted","Data":"770f824a51ee5307469f51dda67fcdb7793e08eb3af42aefd1f86ec143ab26d6"} Jul 06 14:28:58.276998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.276912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.276998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.276959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjkpm\" (UniqueName: \"kubernetes.io/projected/88a4da98-5148-4c51-a7b9-d6bc71aec658-kube-api-access-jjkpm\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.276998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.276997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnvc\" (UniqueName: \"kubernetes.io/projected/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-kube-api-access-kjnvc\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rdv\" (UniqueName: \"kubernetes.io/projected/592dadfd-7458-4b83-82df-9796c2071bdf-kube-api-access-v6rdv\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtng\" (UniqueName: \"kubernetes.io/projected/d962d31d-9269-4268-a2e6-b618f4f26883-kube-api-access-lqtng\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-netd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-systemd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-kubelet\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-ovn\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-log-socket\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.277268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovn-node-metrics-cert\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-script-lib\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d962d31d-9269-4268-a2e6-b618f4f26883-host\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-netd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-systemd-units\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-node-log\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-dbus\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-etc-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-var-lib-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-netns\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-config\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a4da98-5148-4c51-a7b9-d6bc71aec658-hosts-file\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/827bd3e9-156d-49cb-8697-fa703a1cb74b-konnectivity-ca\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-ovn\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.277712 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:58.278026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-dbus\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-run-systemd\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d962d31d-9269-4268-a2e6-b618f4f26883-serviceca\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277781 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-kubelet\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-systemd-units\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277833 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a4da98-5148-4c51-a7b9-d6bc71aec658-hosts-file\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.277876 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d962d31d-9269-4268-a2e6-b618f4f26883-host\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.277902 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:28:58.777882799 +0000 UTC m=+3.078070266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-log-socket\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-node-log\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.277922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-etc-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.277941 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:28:58.777921521 +0000 UTC m=+3.078109001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a4da98-5148-4c51-a7b9-d6bc71aec658-tmp-dir\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-slash\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-bin\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.278927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-slash\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-env-overrides\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278213 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d962d31d-9269-4268-a2e6-b618f4f26883-serviceca\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-run-netns\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278460 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a4da98-5148-4c51-a7b9-d6bc71aec658-tmp-dir\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-script-lib\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/827bd3e9-156d-49cb-8697-fa703a1cb74b-konnectivity-ca\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278568 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovnkube-config\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-var-lib-openvswitch\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278594 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-host-cni-bin\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-env-overrides\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278778 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-kubelet-config\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5395e3ce-5645-456f-8298-229892d76a52-kubelet-config\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.279854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.278855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/827bd3e9-156d-49cb-8697-fa703a1cb74b-agent-certs\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.282685 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.282658 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-ovn-node-metrics-cert\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.284013 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.283955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/827bd3e9-156d-49cb-8697-fa703a1cb74b-agent-certs\") pod \"konnectivity-agent-4lp6t\" (UID: \"827bd3e9-156d-49cb-8697-fa703a1cb74b\") " pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.291652 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.291582 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rdv\" (UniqueName: \"kubernetes.io/projected/592dadfd-7458-4b83-82df-9796c2071bdf-kube-api-access-v6rdv\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.292783 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.292754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtng\" (UniqueName: \"kubernetes.io/projected/d962d31d-9269-4268-a2e6-b618f4f26883-kube-api-access-lqtng\") pod \"node-ca-9l98g\" (UID: \"d962d31d-9269-4268-a2e6-b618f4f26883\") " pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.293691 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.293633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjkpm\" (UniqueName: \"kubernetes.io/projected/88a4da98-5148-4c51-a7b9-d6bc71aec658-kube-api-access-jjkpm\") pod \"node-resolver-hsx8l\" (UID: \"88a4da98-5148-4c51-a7b9-d6bc71aec658\") " pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.295113 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.295063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnvc\" (UniqueName: \"kubernetes.io/projected/8bbe21df-8a4f-4528-b8a9-8dd416cfc887-kube-api-access-kjnvc\") pod \"ovnkube-node-95lxd\" (UID: \"8bbe21df-8a4f-4528-b8a9-8dd416cfc887\") " pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.345818 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.345771 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:28:58.350492 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.350397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvk9z" Jul 06 14:28:58.359751 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.359714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" Jul 06 14:28:58.362553 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.362525 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06150e0c_dfaa_4d81_9c52_8e018705f50f.slice/crio-bd5e2942cd2c7a53df387506480bc7428a7ba122b6b4afcc4e465fcbc370fbe5 WatchSource:0}: Error finding container bd5e2942cd2c7a53df387506480bc7428a7ba122b6b4afcc4e465fcbc370fbe5: Status 404 returned error can't find the container with id bd5e2942cd2c7a53df387506480bc7428a7ba122b6b4afcc4e465fcbc370fbe5 Jul 06 14:28:58.374236 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.374204 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7608de2c_e75f_4761_8d79_4fe138151872.slice/crio-b6a64ef9288bd19f76c54238d4cc4d876a986c52913344045a099e57584494d5 WatchSource:0}: Error finding container b6a64ef9288bd19f76c54238d4cc4d876a986c52913344045a099e57584494d5: Status 404 returned error can't find the container with id b6a64ef9288bd19f76c54238d4cc4d876a986c52913344045a099e57584494d5 Jul 06 14:28:58.374349 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.374259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" Jul 06 14:28:58.381520 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.381494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" Jul 06 14:28:58.385021 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.384999 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240db578_3cbf_4c1d_843f_49db38108961.slice/crio-07ee7531e7c733c8568038cb911f97bf8e2356eb05e786552d5a898079083d42 WatchSource:0}: Error finding container 07ee7531e7c733c8568038cb911f97bf8e2356eb05e786552d5a898079083d42: Status 404 returned error can't find the container with id 07ee7531e7c733c8568038cb911f97bf8e2356eb05e786552d5a898079083d42 Jul 06 14:28:58.391763 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.391726 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb8b848_6ad1_4808_b959_3f5f1bd9e1f0.slice/crio-f366b712b34d6c75d76d353c982bc3af5b8332b7ec0d3d5d107b8470014b7767 WatchSource:0}: Error finding container f366b712b34d6c75d76d353c982bc3af5b8332b7ec0d3d5d107b8470014b7767: Status 404 returned error can't find the container with id f366b712b34d6c75d76d353c982bc3af5b8332b7ec0d3d5d107b8470014b7767 Jul 06 14:28:58.391889 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.391762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vd8nz" Jul 06 14:28:58.401416 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.401389 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df0c87f_5561_432f_8dc1_51a963845932.slice/crio-bb2bf494c92d30ea72f2dcf305545162aced118c28329086e7488c4357c11337 WatchSource:0}: Error finding container bb2bf494c92d30ea72f2dcf305545162aced118c28329086e7488c4357c11337: Status 404 returned error can't find the container with id bb2bf494c92d30ea72f2dcf305545162aced118c28329086e7488c4357c11337 Jul 06 14:28:58.403612 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.403592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9l98g" Jul 06 14:28:58.412897 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.412873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:28:58.413138 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.413113 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd962d31d_9269_4268_a2e6_b618f4f26883.slice/crio-35130f38e55f6efd367500b8483e318a9f3e5bf8d0ad232febbca59f1ff71ea4 WatchSource:0}: Error finding container 35130f38e55f6efd367500b8483e318a9f3e5bf8d0ad232febbca59f1ff71ea4: Status 404 returned error can't find the container with id 35130f38e55f6efd367500b8483e318a9f3e5bf8d0ad232febbca59f1ff71ea4 Jul 06 14:28:58.423371 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.423347 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:28:58.423849 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.423822 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827bd3e9_156d_49cb_8697_fa703a1cb74b.slice/crio-42cee840e67f4285895cbee496810bb94bad5591707651068ebd2fe5389f3c35 WatchSource:0}: Error finding container 42cee840e67f4285895cbee496810bb94bad5591707651068ebd2fe5389f3c35: Status 404 returned error can't find the container with id 42cee840e67f4285895cbee496810bb94bad5591707651068ebd2fe5389f3c35 Jul 06 14:28:58.429609 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.429587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsx8l" Jul 06 14:28:58.435857 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.435816 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbe21df_8a4f_4528_b8a9_8dd416cfc887.slice/crio-16a2b6d70d1ba5fdf4b13ad01bd17646e96b99183f96dd462d026b88c4f44d17 WatchSource:0}: Error finding container 16a2b6d70d1ba5fdf4b13ad01bd17646e96b99183f96dd462d026b88c4f44d17: Status 404 returned error can't find the container with id 16a2b6d70d1ba5fdf4b13ad01bd17646e96b99183f96dd462d026b88c4f44d17 Jul 06 14:28:58.442773 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:28:58.442745 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a4da98_5148_4c51_a7b9_d6bc71aec658.slice/crio-b96a02e5ddd3ed7cfe40a328a31135e22205b435601d682362624d88de9cea15 WatchSource:0}: Error finding container b96a02e5ddd3ed7cfe40a328a31135e22205b435601d682362624d88de9cea15: Status 404 returned error can't find the container with id b96a02e5ddd3ed7cfe40a328a31135e22205b435601d682362624d88de9cea15 Jul 06 14:28:58.782848 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.782796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.782856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:58.782888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.782967 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783024 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783036 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:28:59.783015655 +0000 UTC m=+4.083203136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:58.783049 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783040 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:28:58.783303 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783058 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:58.783303 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783063 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:28:58.783303 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783097 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:28:59.783085435 +0000 UTC m=+4.083272900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:58.783303 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:58.783150 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:28:59.783130278 +0000 UTC m=+4.083317764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:28:59.136101 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.136056 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:23:58 +0000 UTC" deadline="2028-01-06 00:46:24.580665249 +0000 UTC" Jul 06 14:28:59.136101 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.136101 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13162h17m25.444570015s" Jul 06 14:28:59.230083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.230046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:59.230878 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.230190 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:28:59.243324 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.243268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" event={"ID":"240db578-3cbf-4c1d-843f-49db38108961","Type":"ContainerStarted","Data":"07ee7531e7c733c8568038cb911f97bf8e2356eb05e786552d5a898079083d42"} Jul 06 14:28:59.244877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.244840 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"16a2b6d70d1ba5fdf4b13ad01bd17646e96b99183f96dd462d026b88c4f44d17"} Jul 06 14:28:59.246481 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.246453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9l98g" event={"ID":"d962d31d-9269-4268-a2e6-b618f4f26883","Type":"ContainerStarted","Data":"35130f38e55f6efd367500b8483e318a9f3e5bf8d0ad232febbca59f1ff71ea4"} Jul 06 14:28:59.248017 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.247989 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" event={"ID":"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0","Type":"ContainerStarted","Data":"f366b712b34d6c75d76d353c982bc3af5b8332b7ec0d3d5d107b8470014b7767"} Jul 06 14:28:59.249355 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.249330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerStarted","Data":"b6a64ef9288bd19f76c54238d4cc4d876a986c52913344045a099e57584494d5"} Jul 06 14:28:59.250715 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.250686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvk9z" event={"ID":"06150e0c-dfaa-4d81-9c52-8e018705f50f","Type":"ContainerStarted","Data":"bd5e2942cd2c7a53df387506480bc7428a7ba122b6b4afcc4e465fcbc370fbe5"} Jul 06 14:28:59.252120 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.252080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsx8l" event={"ID":"88a4da98-5148-4c51-a7b9-d6bc71aec658","Type":"ContainerStarted","Data":"b96a02e5ddd3ed7cfe40a328a31135e22205b435601d682362624d88de9cea15"} Jul 06 14:28:59.253397 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.253368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4lp6t" event={"ID":"827bd3e9-156d-49cb-8697-fa703a1cb74b","Type":"ContainerStarted","Data":"42cee840e67f4285895cbee496810bb94bad5591707651068ebd2fe5389f3c35"} Jul 06 14:28:59.254788 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.254750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vd8nz" event={"ID":"7df0c87f-5561-432f-8dc1-51a963845932","Type":"ContainerStarted","Data":"bb2bf494c92d30ea72f2dcf305545162aced118c28329086e7488c4357c11337"} Jul 06 14:28:59.792453 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.792401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:28:59.792657 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.792486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:28:59.792657 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:28:59.792512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:28:59.792804 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.792676 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:28:59.792804 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.792720 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:28:59.792804 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.792734 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:59.792804 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.792800 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.79278065 +0000 UTC m=+6.092968135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:28:59.793312 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.793286 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:59.793422 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.793350 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.793333978 +0000 UTC m=+6.093521459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:28:59.793422 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.793413 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:28:59.793547 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:28:59.793448 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.793436919 +0000 UTC m=+6.093624384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:00.136804 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:00.136762 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:23:58 +0000 UTC" deadline="2027-12-29 06:19:50.71720538 +0000 UTC" Jul 06 14:29:00.136804 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:00.136803 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12975h50m50.580407754s" Jul 06 14:29:00.235783 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:00.233969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:00.235783 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:00.234186 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:00.235783 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:00.234719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:00.235783 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:00.234873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:01.230408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.229564 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:01.230408 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.230001 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:01.287206 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.286698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerStarted","Data":"de69fa18017ae70a5ed23d2cbf2a4ffef097ecc1572ee120a9f3a1b776802b8d"} Jul 06 14:29:01.293205 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.293161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"a3daa949ad2399aa2ae00a9f45c827ee","Type":"ContainerStarted","Data":"6b590330668ad0beb6294cc19aa7ffdd2fbc89a216469a50b42664b351fe9f06"} Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.813083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.813139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:01.813204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.813341 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.813405 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:29:05.813386884 +0000 UTC m=+10.113574353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.813848 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.813898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:05.813881957 +0000 UTC m=+10.114069427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.813982 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.814000 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.814013 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:01.814127 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:01.814049 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:05.814037438 +0000 UTC m=+10.114224928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:02.229613 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:02.229575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:02.229813 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:02.229575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:02.229813 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:02.229763 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:02.229956 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:02.229893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:03.229091 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:03.229055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:03.229577 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:03.229209 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:03.302052 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:03.302012 2581 generic.go:356] "Generic (PLEG): container finished" podID="2e15b28acdfde5fc6df129862ecf92ac" containerID="de69fa18017ae70a5ed23d2cbf2a4ffef097ecc1572ee120a9f3a1b776802b8d" exitCode=0 Jul 06 14:29:03.302215 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:03.302079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerDied","Data":"de69fa18017ae70a5ed23d2cbf2a4ffef097ecc1572ee120a9f3a1b776802b8d"} Jul 06 14:29:03.322028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:03.321964 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" podStartSLOduration=6.3219392150000004 podStartE2EDuration="6.321939215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:01.330287572 +0000 UTC m=+5.630475063" watchObservedRunningTime="2026-07-06 14:29:03.321939215 +0000 UTC m=+7.622126704" Jul 06 14:29:04.230273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:04.230238 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:04.230787 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:04.230378 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:04.230880 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:04.230846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:04.231031 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:04.230994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:05.229842 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:05.229320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:05.229842 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.229471 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:05.849852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:05.849919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:05.849947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850009 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850070 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:29:13.850051293 +0000 UTC m=+18.150238769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850080 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850083 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850097 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850109 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850143 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:13.85012615 +0000 UTC m=+18.150313619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:05.850158 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:05.850164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:13.85015437 +0000 UTC m=+18.150341839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:06.230764 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:06.230728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:06.230939 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:06.230841 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:06.231222 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:06.231205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:06.231341 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:06.231297 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:07.229768 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:07.229721 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:07.230228 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:07.229873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:08.230171 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:08.230131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:08.230794 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:08.230131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:08.230794 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:08.230279 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:08.230794 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:08.230304 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:09.229347 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:09.229308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:09.229540 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:09.229427 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:10.229280 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:10.229202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:10.229742 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:10.229202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:10.229742 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:10.229308 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:10.229742 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:10.229363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:11.229762 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:11.229730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:11.230180 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:11.229865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:12.229687 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:12.229634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:12.229864 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:12.229786 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:12.229864 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:12.229832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:12.230289 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:12.229952 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:13.229370 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:13.229329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:13.229603 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.229477 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:13.910894 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:13.910857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:13.910908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:13.910937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911037 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911109 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:29.911093083 +0000 UTC m=+34.211280548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911039 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911191 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:29:29.911174119 +0000 UTC m=+34.211361582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911047 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911215 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911228 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:13.911292 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:13.911260 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:29.91125294 +0000 UTC m=+34.211440403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:14.229541 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:14.229456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:14.229719 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:14.229580 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:14.229719 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:14.229456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:14.229719 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:14.229702 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:15.229860 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:15.229824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:15.230371 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:15.229992 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:16.230077 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:16.230041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:16.230668 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:16.230150 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:16.230668 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:16.230181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:16.230668 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:16.230240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:17.229372 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:17.229336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:17.229524 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:17.229471 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:18.229905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:18.229871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:18.230365 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:18.229984 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:18.230365 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:18.230042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:18.230365 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:18.230163 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:19.229758 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.229435 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:19.229928 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:19.229841 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:19.339150 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.339065 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerStarted","Data":"bf3e6fc9746ea74d78a4765d9b839b32c4fdb2f7b4482427c2f32d86ff1c91e1"} Jul 06 14:29:19.342021 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:29:19.342344 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342322 2581 generic.go:356] "Generic (PLEG): container finished" podID="8bbe21df-8a4f-4528-b8a9-8dd416cfc887" containerID="b6c56eabe9ae0edbd3e653dfdc3b6347391cdb4e506e70059513f3fd7c9cc30f" exitCode=1 Jul 06 14:29:19.342457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"14f72df8c4da64c4b08c0b8e233c43e9829ca353a4299417aae85c323b48a0c7"} Jul 06 14:29:19.342512 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342480 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"8baab96ff09164dabee96b33737dde5fb33a1f445a3e07aa7bbb6dacbaac7980"} Jul 06 14:29:19.342549 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"7a5cdfc8d189ccf0a506c3b86608b3d983f53b08f843aaac92f40805c7419945"} Jul 06 14:29:19.342594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"533cb0e426d4e3d2cf9b0780b561bd98d4288f9eb83b45903f41f10c23dfc128"} Jul 06 14:29:19.342644 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerDied","Data":"b6c56eabe9ae0edbd3e653dfdc3b6347391cdb4e506e70059513f3fd7c9cc30f"} Jul 06 14:29:19.342723 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.342708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"e08ab3080c9ded2e0ebe03df8008d88e896441d6fa0b6c297322dd7a82e7282f"} Jul 06 14:29:19.343809 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.343783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9l98g" event={"ID":"d962d31d-9269-4268-a2e6-b618f4f26883","Type":"ContainerStarted","Data":"47c333d1bb1e6cb76f83f897950b4ee757eac59ca5111c1f882d52c7aedace16"} Jul 06 14:29:19.345223 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.345200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" event={"ID":"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0","Type":"ContainerStarted","Data":"342e313733b01b43161540dc32af08351a0bf61304d5e58a9aabacc32c499ab5"} Jul 06 14:29:19.346797 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.346778 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="19c94edcc53b5e52b54ec44ab2dd67f51448adf7d8fbb600c616538be26a177a" exitCode=0 Jul 06 14:29:19.346926 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.346845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"19c94edcc53b5e52b54ec44ab2dd67f51448adf7d8fbb600c616538be26a177a"} Jul 06 14:29:19.348552 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.348442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvk9z" event={"ID":"06150e0c-dfaa-4d81-9c52-8e018705f50f","Type":"ContainerStarted","Data":"eebe583f360107821d0ed3efb8903d1377d10b02f881491adb3385fbc7dfb306"} Jul 06 14:29:19.350086 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.350015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsx8l" event={"ID":"88a4da98-5148-4c51-a7b9-d6bc71aec658","Type":"ContainerStarted","Data":"92f09d1c6c9f69d7d0493a415674d3e5219b8c33731c6d6b3105f55a9c5cad5e"} Jul 06 14:29:19.351718 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.351675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4lp6t" event={"ID":"827bd3e9-156d-49cb-8697-fa703a1cb74b","Type":"ContainerStarted","Data":"7c4f0894d94b1da07bd460035857c4faf96fc62d186f44daa6a89afe505dbad6"} Jul 06 14:29:19.354411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.354383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" event={"ID":"240db578-3cbf-4c1d-843f-49db38108961","Type":"ContainerStarted","Data":"5898b36819b146d105896f8caede2a51f8d204ab1784e412247bb83dfbda1ddc"} Jul 06 14:29:19.366645 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.366590 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" podStartSLOduration=22.366570748 podStartE2EDuration="22.366570748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.365897734 +0000 UTC m=+23.666085219" watchObservedRunningTime="2026-07-06 14:29:19.366570748 +0000 UTC m=+23.666758235" Jul 06 14:29:19.429001 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.428925 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4lp6t" podStartSLOduration=10.887736276 podStartE2EDuration="22.428903069s" totalImagesPullingTime="11.541166793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.402112994 +0000 UTC m=+23.702300479" watchObservedRunningTime="2026-07-06 14:29:19.428903069 +0000 UTC m=+23.729090555" Jul 06 14:29:19.451927 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.451874 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cvk9z" podStartSLOduration=2.968748786 podStartE2EDuration="23.451852819s" totalImagesPullingTime="20.483104033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.451436863 +0000 UTC m=+23.751624347" watchObservedRunningTime="2026-07-06 14:29:19.451852819 +0000 UTC m=+23.752040306" Jul 06 14:29:19.452199 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.452167 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hsx8l" podStartSLOduration=2.468461711 podStartE2EDuration="22.452158166s" totalImagesPullingTime="19.983696455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.428482666 +0000 UTC m=+23.728670152" watchObservedRunningTime="2026-07-06 14:29:19.452158166 +0000 UTC m=+23.752345653" Jul 06 14:29:19.503051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.502994 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8vfrz" podStartSLOduration=3.461382299 podStartE2EDuration="23.502978106s" totalImagesPullingTime="20.041595807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.502718686 +0000 UTC m=+23.802906173" watchObservedRunningTime="2026-07-06 14:29:19.502978106 +0000 UTC m=+23.803165590" Jul 06 14:29:19.524276 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:19.524228 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9l98g" podStartSLOduration=3.511250695 podStartE2EDuration="23.524207013s" totalImagesPullingTime="20.012956318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.524149716 +0000 UTC m=+23.824337201" watchObservedRunningTime="2026-07-06 14:29:19.524207013 +0000 UTC m=+23.824394499" Jul 06 14:29:20.138507 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.138486 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 14:29:20.147276 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.147180 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:29:20.138502427Z","UUID":"1c51a882-2a3b-42b9-992b-5bfab33b8b79","Handler":null,"Name":"","Endpoint":""} Jul 06 14:29:20.148788 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.148769 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 14:29:20.148899 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.148815 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 14:29:20.233374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.233344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:20.233811 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.233389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:20.233811 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:20.233474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:20.233811 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:20.233605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:20.361588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.361469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" event={"ID":"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0","Type":"ContainerStarted","Data":"96e85e11a64d72dee6b6f786e6f02f76951293b5faf0a6609ed97e677858dcd4"} Jul 06 14:29:20.362957 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:20.362899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vd8nz" event={"ID":"7df0c87f-5561-432f-8dc1-51a963845932","Type":"ContainerStarted","Data":"006ed5c6ad743a26df457efd577a1d8dbbd33215249a4d0e659605f5cef41a31"} Jul 06 14:29:21.230069 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:21.230036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:21.230326 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:21.230161 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:22.229638 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.229467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:22.230159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.229531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:22.230159 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:22.229724 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:22.230159 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:22.229801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:22.369368 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.369317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" event={"ID":"3bb8b848-6ad1-4808-b959-3f5f1bd9e1f0","Type":"ContainerStarted","Data":"93c5a9c4bc8f1bca894e6c724cbcdf9cb968ec4504b24273ad66cf399c26a069"} Jul 06 14:29:22.372155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.372135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:29:22.372477 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.372456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"70856ce6c6282b960a5504303592c39501b5d5467f5368dec77035ed1070540d"} Jul 06 14:29:22.405888 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:22.405840 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vd8nz" podStartSLOduration=6.37896659 podStartE2EDuration="26.405825012s" totalImagesPullingTime="20.026858422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:20.384624358 +0000 UTC m=+24.684811844" watchObservedRunningTime="2026-07-06 14:29:22.405825012 +0000 UTC m=+26.706012496" Jul 06 14:29:23.229832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:23.229799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:23.230416 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:23.229977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:24.230121 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.229849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:24.230782 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.229887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:24.230782 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:24.230166 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:24.230782 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:24.230212 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:24.256367 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.256338 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:29:24.256903 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.256877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:29:24.316901 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.316853 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjcrd" podStartSLOduration=5.788545472 podStartE2EDuration="28.316833113s" totalImagesPullingTime="22.528287641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:22.40595769 +0000 UTC m=+26.706145185" watchObservedRunningTime="2026-07-06 14:29:24.316833113 +0000 UTC m=+28.617020598" Jul 06 14:29:24.381201 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.381171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:29:24.381679 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.381637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"bd0326a6ff2e605ad610583e60e3cd0ba369465e5766acf55f35b7d12c96a259"} Jul 06 14:29:24.381829 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.381740 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:29:24.382175 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.382052 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:24.382175 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.382101 2581 scope.go:117] "RemoveContainer" containerID="b6c56eabe9ae0edbd3e653dfdc3b6347391cdb4e506e70059513f3fd7c9cc30f" Jul 06 14:29:24.382175 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.382123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:24.382175 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.382164 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:24.382361 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.382253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4lp6t" Jul 06 14:29:24.400902 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.400881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:24.401034 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:24.401021 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:25.229830 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:25.229791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:25.229979 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:25.229944 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:25.392472 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:25.392442 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:29:25.392968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:25.392929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" event={"ID":"8bbe21df-8a4f-4528-b8a9-8dd416cfc887","Type":"ContainerStarted","Data":"62aeee7283922e8b2ecdd4775cb84713849c3f9a98a1399ab43d85cb37f70051"} Jul 06 14:29:25.431734 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:25.431688 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" podStartSLOduration=8.380147873 podStartE2EDuration="28.431671086s" totalImagesPullingTime="20.051523213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:25.431340408 +0000 UTC m=+29.731527897" watchObservedRunningTime="2026-07-06 14:29:25.431671086 +0000 UTC m=+29.731858578" Jul 06 14:29:26.041731 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.041694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wjxvb"] Jul 06 14:29:26.041894 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.041822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:26.041954 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:26.041916 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:26.044733 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.044705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r5bn"] Jul 06 14:29:26.044863 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.044848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:26.044997 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:26.044975 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:26.045217 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.045197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vdvhc"] Jul 06 14:29:26.045316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:26.045302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:26.045425 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:26.045399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:27.229593 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:27.229416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:27.230046 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:27.229685 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:27.401667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:27.401617 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="14f6f603b9c863c47d2647f098a41458b9c1fa415639ee17c1fdd06fe8019776" exitCode=0 Jul 06 14:29:27.401809 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:27.401700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"14f6f603b9c863c47d2647f098a41458b9c1fa415639ee17c1fdd06fe8019776"} Jul 06 14:29:28.229214 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:28.229174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:28.229372 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:28.229292 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:28.229372 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:28.229341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:28.229478 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:28.229438 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:29.230022 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.229988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:29.230523 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.230093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:29.408715 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.408681 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="0b8af6037d543121a16552b2a7db3771b3d35f03765432eaf7dda6761297ae46" exitCode=0 Jul 06 14:29:29.408848 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.408739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"0b8af6037d543121a16552b2a7db3771b3d35f03765432eaf7dda6761297ae46"} Jul 06 14:29:29.937400 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.937357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:29.938287 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.938265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:29.938399 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.938309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:29.938399 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:29.938339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938421 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938440 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938455 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938465 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4mn5 for pod openshift-network-diagnostics/network-check-target-wjxvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret podName:5395e3ce-5645-456f-8298-229892d76a52 nodeName:}" failed. No retries permitted until 2026-07-06 14:30:01.938466732 +0000 UTC m=+66.238654208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret") pod "global-pull-secret-syncer-vdvhc" (UID: "5395e3ce-5645-456f-8298-229892d76a52") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938505 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5 podName:6de5ca05-99ee-40ff-aefe-9b694791adc9 nodeName:}" failed. No retries permitted until 2026-07-06 14:30:01.938490678 +0000 UTC m=+66.238678143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4mn5" (UniqueName: "kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5") pod "network-check-target-wjxvb" (UID: "6de5ca05-99ee-40ff-aefe-9b694791adc9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:29:29.938511 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938424 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:29.938796 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:29.938531 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs podName:592dadfd-7458-4b83-82df-9796c2071bdf nodeName:}" failed. No retries permitted until 2026-07-06 14:30:01.938525781 +0000 UTC m=+66.238713244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs") pod "network-metrics-daemon-8r5bn" (UID: "592dadfd-7458-4b83-82df-9796c2071bdf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:29:30.041068 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:30.041039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:30.229990 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:30.229911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:30.229990 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:30.229957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:30.230460 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:30.230047 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r5bn" podUID="592dadfd-7458-4b83-82df-9796c2071bdf" Jul 06 14:29:30.230460 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:30.230054 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdvhc" podUID="5395e3ce-5645-456f-8298-229892d76a52" Jul 06 14:29:30.413133 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:30.413095 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="c1bde20c6f9fd46b4e64fa82263d8db7b4e21ddf888cdc974241e3f57631e048" exitCode=0 Jul 06 14:29:30.413283 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:30.413160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"c1bde20c6f9fd46b4e64fa82263d8db7b4e21ddf888cdc974241e3f57631e048"} Jul 06 14:29:31.229610 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.229582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:31.229766 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:31.229729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wjxvb" podUID="6de5ca05-99ee-40ff-aefe-9b694791adc9" Jul 06 14:29:31.486748 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.486479 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeReady" Jul 06 14:29:31.487195 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.486831 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 14:29:31.540364 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.540327 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8jdjr"] Jul 06 14:29:31.542892 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.542867 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dd5tz"] Jul 06 14:29:31.543030 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.542991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.545416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.545344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 14:29:31.545641 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.545626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rs6zp\"" Jul 06 14:29:31.545763 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.545642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.545763 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.545627 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 14:29:31.548084 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.548065 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tspsl\"" Jul 06 14:29:31.548300 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.548285 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 14:29:31.548373 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.548339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 14:29:31.548426 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.548388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 14:29:31.550604 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ef23d22-448f-4291-b06e-9c22be457e5d-config-volume\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.550717 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lf8\" (UniqueName: \"kubernetes.io/projected/00ff471b-c123-4f21-85b9-8b52b3cd7c79-kube-api-access-g8lf8\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.550717 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.550717 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlj5\" (UniqueName: \"kubernetes.io/projected/0ef23d22-448f-4291-b06e-9c22be457e5d-kube-api-access-zxlj5\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.550865 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff471b-c123-4f21-85b9-8b52b3cd7c79-cert\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.550865 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.550796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef23d22-448f-4291-b06e-9c22be457e5d-tmp-dir\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.553752 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.553731 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dd5tz"] Jul 06 14:29:31.561319 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.561264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jdjr"] Jul 06 14:29:31.604694 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.604645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:31.651900 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.651864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff471b-c123-4f21-85b9-8b52b3cd7c79-cert\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.651900 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.651903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef23d22-448f-4291-b06e-9c22be457e5d-tmp-dir\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.652253 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.651971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ef23d22-448f-4291-b06e-9c22be457e5d-config-volume\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.652253 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.652037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lf8\" (UniqueName: \"kubernetes.io/projected/00ff471b-c123-4f21-85b9-8b52b3cd7c79-kube-api-access-g8lf8\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.652253 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.652062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.652253 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.652088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlj5\" (UniqueName: \"kubernetes.io/projected/0ef23d22-448f-4291-b06e-9c22be457e5d-kube-api-access-zxlj5\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.652560 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.652317 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef23d22-448f-4291-b06e-9c22be457e5d-tmp-dir\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.652560 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:31.652328 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:31.652560 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:31.652418 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:29:32.152396751 +0000 UTC m=+36.452584218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:31.652846 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.652818 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ef23d22-448f-4291-b06e-9c22be457e5d-config-volume\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.657348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.657324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff471b-c123-4f21-85b9-8b52b3cd7c79-cert\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.664503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.664481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lf8\" (UniqueName: \"kubernetes.io/projected/00ff471b-c123-4f21-85b9-8b52b3cd7c79-kube-api-access-g8lf8\") pod \"ingress-canary-dd5tz\" (UID: \"00ff471b-c123-4f21-85b9-8b52b3cd7c79\") " pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:31.664644 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.664625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlj5\" (UniqueName: \"kubernetes.io/projected/0ef23d22-448f-4291-b06e-9c22be457e5d-kube-api-access-zxlj5\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:31.706306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.706265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:31.862133 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:31.862034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dd5tz" Jul 06 14:29:32.013473 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.013445 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dd5tz"] Jul 06 14:29:32.017916 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:29:32.017878 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ff471b_c123_4f21_85b9_8b52b3cd7c79.slice/crio-d3b2ad2cf9bec99e7ad7118e457f663e4a200e7ab838c1cf44fa2c6ca459b3b1 WatchSource:0}: Error finding container d3b2ad2cf9bec99e7ad7118e457f663e4a200e7ab838c1cf44fa2c6ca459b3b1: Status 404 returned error can't find the container with id d3b2ad2cf9bec99e7ad7118e457f663e4a200e7ab838c1cf44fa2c6ca459b3b1 Jul 06 14:29:32.155078 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.155038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:32.155286 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:32.155200 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:32.155286 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:32.155271 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:29:33.155253562 +0000 UTC m=+37.455441039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:32.229967 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.229934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:29:32.230159 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.230128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:29:32.233066 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.233042 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:29:32.233222 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.233117 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s774m\"" Jul 06 14:29:32.233222 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.233182 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:29:32.423923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.423833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dd5tz" event={"ID":"00ff471b-c123-4f21-85b9-8b52b3cd7c79","Type":"ContainerStarted","Data":"d3b2ad2cf9bec99e7ad7118e457f663e4a200e7ab838c1cf44fa2c6ca459b3b1"} Jul 06 14:29:32.591852 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:32.591815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:33.161563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:33.161520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:33.161780 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:33.161705 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:33.161780 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:33.161778 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:29:35.161757382 +0000 UTC m=+39.461944857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:33.229795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:33.229763 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:29:33.232815 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:33.232588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwxdr\"" Jul 06 14:29:33.232815 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:33.232633 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:29:33.232815 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:33.232588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:29:35.174834 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:35.174796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:35.175252 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:35.174959 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:35.175252 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:35.175040 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:29:39.175020388 +0000 UTC m=+43.475207876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:36.112604 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.112576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:36.212804 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.212763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:36.435016 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.434984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dd5tz" event={"ID":"00ff471b-c123-4f21-85b9-8b52b3cd7c79","Type":"ContainerStarted","Data":"4effbd2383e026e6011f3f346492264129234b49c8cbe178e12d865018ce161a"} Jul 06 14:29:36.437708 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.437678 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="6b55f2ae31ab5cb5e38b8ecdb9b94c47826ecf07c4d73fe790ede29331579ea4" exitCode=0 Jul 06 14:29:36.437833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.437717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"6b55f2ae31ab5cb5e38b8ecdb9b94c47826ecf07c4d73fe790ede29331579ea4"} Jul 06 14:29:36.455830 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:36.455787 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dd5tz" podStartSLOduration=1.411531526 podStartE2EDuration="5.455774009s" totalImagesPullingTime="4.044242483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:36.455230916 +0000 UTC m=+40.755418392" watchObservedRunningTime="2026-07-06 14:29:36.455774009 +0000 UTC m=+40.755961493" Jul 06 14:29:37.443382 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:37.443351 2581 generic.go:356] "Generic (PLEG): container finished" podID="7608de2c-e75f-4761-8d79-4fe138151872" containerID="704ccc9ad916ccf1a01b8963bb61452753301ac9ea347ba9870cc53e026e976c" exitCode=0 Jul 06 14:29:37.443771 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:37.443434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerDied","Data":"704ccc9ad916ccf1a01b8963bb61452753301ac9ea347ba9870cc53e026e976c"} Jul 06 14:29:38.239884 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.239850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:38.449241 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.449208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" event={"ID":"7608de2c-e75f-4761-8d79-4fe138151872","Type":"ContainerStarted","Data":"d62f3c99b125cc314c5827a2e6e0193aabfce56c211e49ab50abaab431bd0079"} Jul 06 14:29:38.492636 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.492541 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwfcl" podStartSLOduration=7.909876164 podStartE2EDuration="42.492526924s" totalImagesPullingTime="34.58265076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:38.490791593 +0000 UTC m=+42.790979078" watchObservedRunningTime="2026-07-06 14:29:38.492526924 +0000 UTC m=+42.792714408" Jul 06 14:29:38.564457 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.564428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:38.713232 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.713203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:38.778677 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.778586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:38.938517 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:38.938492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.004277 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.004251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.205243 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.205211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:39.205413 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:39.205321 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:39.205413 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:39.205371 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:29:47.205359413 +0000 UTC m=+51.505546875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:39.236706 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.236677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.283628 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.283597 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw"] Jul 06 14:29:39.304038 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.304007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw"] Jul 06 14:29:39.304169 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.304111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" Jul 06 14:29:39.306602 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.306580 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 14:29:39.307893 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.307877 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 14:29:39.307972 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.307885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z8czd\"" Jul 06 14:29:39.338849 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.338814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.407192 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.407160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwsct\" (UniqueName: \"kubernetes.io/projected/c2039f98-c1ac-423b-b0dd-9be573bceedb-kube-api-access-gwsct\") pod \"migrator-d57d58cc9-csvtw\" (UID: \"c2039f98-c1ac-423b-b0dd-9be573bceedb\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" Jul 06 14:29:39.434708 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.434676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.507687 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.507584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwsct\" (UniqueName: \"kubernetes.io/projected/c2039f98-c1ac-423b-b0dd-9be573bceedb-kube-api-access-gwsct\") pod \"migrator-d57d58cc9-csvtw\" (UID: \"c2039f98-c1ac-423b-b0dd-9be573bceedb\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" Jul 06 14:29:39.518080 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.518047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwsct\" (UniqueName: \"kubernetes.io/projected/c2039f98-c1ac-423b-b0dd-9be573bceedb-kube-api-access-gwsct\") pod \"migrator-d57d58cc9-csvtw\" (UID: \"c2039f98-c1ac-423b-b0dd-9be573bceedb\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" Jul 06 14:29:39.612352 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.612320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" Jul 06 14:29:39.702672 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.702037 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.778096 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.778015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw"] Jul 06 14:29:39.782278 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:29:39.782245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2039f98_c1ac_423b_b0dd_9be573bceedb.slice/crio-13e6e31a525432a9f2eeb480da0d09ab2f2c7f2451063ea9db6655de9b92205e WatchSource:0}: Error finding container 13e6e31a525432a9f2eeb480da0d09ab2f2c7f2451063ea9db6655de9b92205e: Status 404 returned error can't find the container with id 13e6e31a525432a9f2eeb480da0d09ab2f2c7f2451063ea9db6655de9b92205e Jul 06 14:29:39.791325 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.791295 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8zdpv"] Jul 06 14:29:39.794586 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.794562 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.818235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.818204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8zdpv"] Jul 06 14:29:39.818387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.818333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.821045 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.821017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 14:29:39.821170 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.821087 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 14:29:39.821428 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.821412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 14:29:39.821505 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.821417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 14:29:39.821505 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.821416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rzjwm\"" Jul 06 14:29:39.853335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.853264 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:39.911642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.911607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ecaea-03b0-447c-8a84-e1055d1875ff-data-volume\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.911642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.911639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xm9\" (UniqueName: \"kubernetes.io/projected/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-api-access-z7xm9\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.911857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.911743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.911857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.911804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ecaea-03b0-447c-8a84-e1055d1875ff-crio-socket\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.911857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.911831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:39.947739 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:39.947708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:40.012162 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ecaea-03b0-447c-8a84-e1055d1875ff-crio-socket\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012162 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012365 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ecaea-03b0-447c-8a84-e1055d1875ff-data-volume\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012365 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xm9\" (UniqueName: \"kubernetes.io/projected/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-api-access-z7xm9\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012365 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012365 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.012339 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 14:29:40.012508 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93ecaea-03b0-447c-8a84-e1055d1875ff-crio-socket\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.012508 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.012423 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:40.012508 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.012427 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:40.512407988 +0000 UTC m=+44.812595471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : configmap "kube-rbac-proxy" not found Jul 06 14:29:40.012508 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.012466 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:40.512456044 +0000 UTC m=+44.812643518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:40.012675 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.012561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93ecaea-03b0-447c-8a84-e1055d1875ff-data-volume\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.021621 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.021600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xm9\" (UniqueName: \"kubernetes.io/projected/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-api-access-z7xm9\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.048510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.048418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:40.455236 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.455202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" event={"ID":"c2039f98-c1ac-423b-b0dd-9be573bceedb","Type":"ContainerStarted","Data":"13e6e31a525432a9f2eeb480da0d09ab2f2c7f2451063ea9db6655de9b92205e"} Jul 06 14:29:40.516263 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.516230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.516749 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:40.516297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:40.516749 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.516385 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 14:29:40.516749 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.516403 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:40.516749 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.516443 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:41.516424408 +0000 UTC m=+45.816611889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : configmap "kube-rbac-proxy" not found Jul 06 14:29:40.516749 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:40.516488 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:41.516471242 +0000 UTC m=+45.816658705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:41.425973 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.425936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:41.524336 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.524302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:41.524761 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.524355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:41.524761 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:41.524416 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 14:29:41.524761 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:41.524442 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:41.524761 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:41.524470 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:43.524455187 +0000 UTC m=+47.824642650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : configmap "kube-rbac-proxy" not found Jul 06 14:29:41.524761 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:41.524493 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:43.524479949 +0000 UTC m=+47.824667412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:41.571161 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.571128 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggrb7"] Jul 06 14:29:41.585008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.584981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.585581 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.585560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggrb7"] Jul 06 14:29:41.589005 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.588985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-j46ht\"" Jul 06 14:29:41.589113 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.589024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 14:29:41.590270 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.590250 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 14:29:41.590375 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.590296 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 14:29:41.590375 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.590331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 14:29:41.617781 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.617747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:41.624821 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.624797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhd67\" (UniqueName: \"kubernetes.io/projected/7aaae566-e53f-40d3-95c9-477d5433630a-kube-api-access-bhd67\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.624933 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.624911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7aaae566-e53f-40d3-95c9-477d5433630a-signing-key\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.624975 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.624944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7aaae566-e53f-40d3-95c9-477d5433630a-signing-cabundle\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.725592 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.725556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7aaae566-e53f-40d3-95c9-477d5433630a-signing-cabundle\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.725740 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.725617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhd67\" (UniqueName: \"kubernetes.io/projected/7aaae566-e53f-40d3-95c9-477d5433630a-kube-api-access-bhd67\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.725833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.725809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7aaae566-e53f-40d3-95c9-477d5433630a-signing-key\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.726315 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.726295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7aaae566-e53f-40d3-95c9-477d5433630a-signing-cabundle\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.728114 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.728083 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7aaae566-e53f-40d3-95c9-477d5433630a-signing-key\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.735301 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.735280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhd67\" (UniqueName: \"kubernetes.io/projected/7aaae566-e53f-40d3-95c9-477d5433630a-kube-api-access-bhd67\") pod \"service-ca-758f599c5-ggrb7\" (UID: \"7aaae566-e53f-40d3-95c9-477d5433630a\") " pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:41.894583 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:41.894562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-ggrb7" Jul 06 14:29:42.046160 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.046124 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggrb7"] Jul 06 14:29:42.048942 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:29:42.048918 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aaae566_e53f_40d3_95c9_477d5433630a.slice/crio-1fdfca718517460d5f9fb7fe5ddff655d892b279e5e31e0f42eb7409c18df7a2 WatchSource:0}: Error finding container 1fdfca718517460d5f9fb7fe5ddff655d892b279e5e31e0f42eb7409c18df7a2: Status 404 returned error can't find the container with id 1fdfca718517460d5f9fb7fe5ddff655d892b279e5e31e0f42eb7409c18df7a2 Jul 06 14:29:42.462084 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.462042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" event={"ID":"c2039f98-c1ac-423b-b0dd-9be573bceedb","Type":"ContainerStarted","Data":"1fd048a0058dc5e9b0f85fe2e4e13aa8abb9a991a373c3214ead2a324e5ec7f7"} Jul 06 14:29:42.462237 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.462120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" event={"ID":"c2039f98-c1ac-423b-b0dd-9be573bceedb","Type":"ContainerStarted","Data":"d17ad1448534cc60244359613f5f1365d6d6163da5a1d0b0a6f89db6bcbc6d2e"} Jul 06 14:29:42.463125 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.463107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-ggrb7" event={"ID":"7aaae566-e53f-40d3-95c9-477d5433630a","Type":"ContainerStarted","Data":"1fdfca718517460d5f9fb7fe5ddff655d892b279e5e31e0f42eb7409c18df7a2"} Jul 06 14:29:42.485168 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.485121 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-csvtw" podStartSLOduration=1.562796965 podStartE2EDuration="3.485106571s" totalImagesPullingTime="1.922309606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:42.484597904 +0000 UTC m=+46.784785388" watchObservedRunningTime="2026-07-06 14:29:42.485106571 +0000 UTC m=+46.785294033" Jul 06 14:29:42.535055 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.535026 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:42.568826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:42.568798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsx8l_88a4da98-5148-4c51-a7b9-d6bc71aec658/dns-node-resolver/0.log" Jul 06 14:29:43.369804 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:43.369775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9l98g_d962d31d-9269-4268-a2e6-b618f4f26883/node-ca/0.log" Jul 06 14:29:43.539150 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:43.539115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:43.539531 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:43.539174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:43.539531 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:43.539255 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 14:29:43.539531 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:43.539293 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:43.539531 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:43.539314 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:47.539301081 +0000 UTC m=+51.839488543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : configmap "kube-rbac-proxy" not found Jul 06 14:29:43.539531 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:43.539347 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:47.539334378 +0000 UTC m=+51.839521841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:43.971099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:43.971065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dd5tz_00ff471b-c123-4f21-85b9-8b52b3cd7c79/serve-healthcheck-canary/0.log" Jul 06 14:29:44.571874 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:44.571843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-csvtw_c2039f98-c1ac-423b-b0dd-9be573bceedb/migrator/0.log" Jul 06 14:29:44.769933 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:44.769862 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-csvtw_c2039f98-c1ac-423b-b0dd-9be573bceedb/graceful-termination/0.log" Jul 06 14:29:45.470765 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:45.470727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-ggrb7" event={"ID":"7aaae566-e53f-40d3-95c9-477d5433630a","Type":"ContainerStarted","Data":"45a202c4eca8b90a5ea4916ed2d2abb5e8f76d1eb4705828bd3c2f3337eeffcd"} Jul 06 14:29:45.501376 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:45.501329 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-ggrb7" podStartSLOduration=2.108720842 podStartE2EDuration="4.501313259s" totalImagesPullingTime="2.392592417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:45.500569216 +0000 UTC m=+49.800756703" watchObservedRunningTime="2026-07-06 14:29:45.501313259 +0000 UTC m=+49.801500781" Jul 06 14:29:46.237664 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.237617 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:46.347098 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.347056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:46.491306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.491222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:46.623693 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.623643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:46.782336 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.782251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:46.965960 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:46.965926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.266189 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:47.266152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:29:47.266708 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.266323 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:29:47.266708 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.266402 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls podName:0ef23d22-448f-4291-b06e-9c22be457e5d nodeName:}" failed. No retries permitted until 2026-07-06 14:30:03.266379367 +0000 UTC m=+67.566566836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls") pod "dns-default-8jdjr" (UID: "0ef23d22-448f-4291-b06e-9c22be457e5d") : secret "dns-default-metrics-tls" not found Jul 06 14:29:47.568079 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:47.567989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:47.568269 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:47.568108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:47.568269 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.568112 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 14:29:47.568269 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.568180 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:55.568165841 +0000 UTC m=+59.868353304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : configmap "kube-rbac-proxy" not found Jul 06 14:29:47.568269 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.568262 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:47.568440 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:47.568331 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:29:55.568312545 +0000 UTC m=+59.868500025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:47.857691 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:47.857584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.237394 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:48.237366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.429810 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:48.429773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.712044 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:48.712009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.982376 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:48.982290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.128473 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:49.128439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.656277 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:49.656243 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.868028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:49.867987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:50.046271 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:50.046196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:50.451803 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:50.451772 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:50.614511 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:50.614477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:50.824770 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:50.824690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:51.228117 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:51.228084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:51.349588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:51.349559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:51.632391 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:51.632363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:51.825681 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:51.825621 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:52.272585 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:52.272554 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:52.514923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:52.514889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:52.836910 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:52.836878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:53.361037 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:53.361005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:53.470857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:53.470828 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:53.743931 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:53.743895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:53.877220 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:53.877190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:54.035105 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:54.035019 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:54.158985 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:54.158949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:55.022329 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.022237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:55.447998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.447968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:55.621407 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.621362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:55.630548 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.630514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:55.630678 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.630603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:55.630742 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:55.630700 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 14:29:55.630794 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:29:55.630782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls podName:a93ecaea-03b0-447c-8a84-e1055d1875ff nodeName:}" failed. No retries permitted until 2026-07-06 14:30:11.630761663 +0000 UTC m=+75.930949144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8zdpv" (UID: "a93ecaea-03b0-447c-8a84-e1055d1875ff") : secret "insights-runtime-extractor-tls" not found Jul 06 14:29:55.631122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.631098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93ecaea-03b0-447c-8a84-e1055d1875ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:29:55.821468 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:55.821386 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:56.013279 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:56.013248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:56.410473 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:56.410447 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95lxd" Jul 06 14:29:56.611861 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:56.611830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:56.818479 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:56.818379 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:59.454735 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:29:59.454686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:01.723354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.723321 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk"] Jul 06 14:30:01.726304 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.726283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.729832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.729811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 14:30:01.731208 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.731190 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 14:30:01.731301 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.731223 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 14:30:01.731360 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.731347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 14:30:01.744430 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.744406 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk"] Jul 06 14:30:01.778811 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.778777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57b18ef3-6289-4db7-9564-121d84f5ad9f-tmp\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.778811 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.778811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jvq\" (UniqueName: \"kubernetes.io/projected/57b18ef3-6289-4db7-9564-121d84f5ad9f-kube-api-access-q9jvq\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.779020 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.778847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57b18ef3-6289-4db7-9564-121d84f5ad9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.879368 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.879323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57b18ef3-6289-4db7-9564-121d84f5ad9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.879564 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.879434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57b18ef3-6289-4db7-9564-121d84f5ad9f-tmp\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.879564 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.879458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jvq\" (UniqueName: \"kubernetes.io/projected/57b18ef3-6289-4db7-9564-121d84f5ad9f-kube-api-access-q9jvq\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.879907 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.879875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57b18ef3-6289-4db7-9564-121d84f5ad9f-tmp\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.881932 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.881906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57b18ef3-6289-4db7-9564-121d84f5ad9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.908026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.907986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jvq\" (UniqueName: \"kubernetes.io/projected/57b18ef3-6289-4db7-9564-121d84f5ad9f-kube-api-access-q9jvq\") pod \"klusterlet-addon-workmgr-5789dfc6f-mqtbk\" (UID: \"57b18ef3-6289-4db7-9564-121d84f5ad9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:01.927688 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.927635 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-566479bb5b-mgm88"] Jul 06 14:30:01.929738 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.929719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.933743 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.933712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 14:30:01.933897 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.933798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 14:30:01.933954 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.933913 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 14:30:01.934006 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.933968 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnmkm\"" Jul 06 14:30:01.940301 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.940273 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 14:30:01.958533 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.958498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-566479bb5b-mgm88"] Jul 06 14:30:01.959017 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.958978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:01.980206 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-image-registry-private-configuration\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980206 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-ca-trust-extracted\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980206 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:30:01.980408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-certificates\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-trusted-ca\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd9jl\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-kube-api-access-hd9jl\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:30:01.980514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:30:01.980514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-installation-pull-secrets\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980623 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-bound-sa-token\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.980623 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.980561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-tls\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:01.983122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.983090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:30:01.983360 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.983345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:30:01.983514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.983496 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:30:01.993165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.993132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5395e3ce-5645-456f-8298-229892d76a52-original-pull-secret\") pod \"global-pull-secret-syncer-vdvhc\" (UID: \"5395e3ce-5645-456f-8298-229892d76a52\") " pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:30:01.993275 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.993135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/592dadfd-7458-4b83-82df-9796c2071bdf-metrics-certs\") pod \"network-metrics-daemon-8r5bn\" (UID: \"592dadfd-7458-4b83-82df-9796c2071bdf\") " pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:30:01.993730 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:01.993714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:30:02.003634 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.003609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4mn5\" (UniqueName: \"kubernetes.io/projected/6de5ca05-99ee-40ff-aefe-9b694791adc9-kube-api-access-k4mn5\") pod \"network-check-target-wjxvb\" (UID: \"6de5ca05-99ee-40ff-aefe-9b694791adc9\") " pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:30:02.035667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.035610 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:02.045445 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.045258 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwxdr\"" Jul 06 14:30:02.053659 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.053616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:30:02.081743 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.081704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-certificates\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.081945 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.081755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-trusted-ca\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.081945 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.081788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd9jl\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-kube-api-access-hd9jl\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.081945 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.081853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-installation-pull-secrets\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.082102 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-bound-sa-token\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.082102 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-tls\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.082201 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-image-registry-private-configuration\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.082201 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-ca-trust-extracted\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.082795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-ca-trust-extracted\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.083033 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-certificates\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.083033 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.082994 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-trusted-ca\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.085932 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.085853 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-registry-tls\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.086577 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.086330 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-image-registry-private-configuration\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.086819 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.086584 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-installation-pull-secrets\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.097176 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.097145 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd9jl\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-kube-api-access-hd9jl\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.097585 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.097561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3-bound-sa-token\") pod \"image-registry-566479bb5b-mgm88\" (UID: \"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3\") " pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.193140 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.193103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk"] Jul 06 14:30:02.194191 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.194168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.196242 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:02.196218 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b18ef3_6289_4db7_9564_121d84f5ad9f.slice/crio-93389f9521a555bd7f34b4e1bb9e4305badfcdf996685723ca168b7afdaa474d WatchSource:0}: Error finding container 93389f9521a555bd7f34b4e1bb9e4305badfcdf996685723ca168b7afdaa474d: Status 404 returned error can't find the container with id 93389f9521a555bd7f34b4e1bb9e4305badfcdf996685723ca168b7afdaa474d Jul 06 14:30:02.202519 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.202497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wjxvb"] Jul 06 14:30:02.205378 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:02.205355 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de5ca05_99ee_40ff_aefe_9b694791adc9.slice/crio-6b311fa89a22bb5f5120b28cee013b39af24b5b6791b77347af8036f3bc357d5 WatchSource:0}: Error finding container 6b311fa89a22bb5f5120b28cee013b39af24b5b6791b77347af8036f3bc357d5: Status 404 returned error can't find the container with id 6b311fa89a22bb5f5120b28cee013b39af24b5b6791b77347af8036f3bc357d5 Jul 06 14:30:02.241780 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.241693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.242730 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.242711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdvhc" Jul 06 14:30:02.251215 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.251189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s774m\"" Jul 06 14:30:02.259601 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.259573 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r5bn" Jul 06 14:30:02.292762 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.292723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.404390 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.404361 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vdvhc"] Jul 06 14:30:02.407611 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:02.407583 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5395e3ce_5645_456f_8298_229892d76a52.slice/crio-a116241ae27ae8b5b36401604e6e904f4e76d2dfa4e55f23fb3c371f120b99be WatchSource:0}: Error finding container a116241ae27ae8b5b36401604e6e904f4e76d2dfa4e55f23fb3c371f120b99be: Status 404 returned error can't find the container with id a116241ae27ae8b5b36401604e6e904f4e76d2dfa4e55f23fb3c371f120b99be Jul 06 14:30:02.416239 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.416213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-566479bb5b-mgm88"] Jul 06 14:30:02.419802 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:02.419772 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe31bf8e_6df3_43f0_a698_7d6d1e8b9cf3.slice/crio-31ff45bf16c1b5dab8f7565fe21312ecdc91b1e0148cf4a6d870cd6cdf8bbc8b WatchSource:0}: Error finding container 31ff45bf16c1b5dab8f7565fe21312ecdc91b1e0148cf4a6d870cd6cdf8bbc8b: Status 404 returned error can't find the container with id 31ff45bf16c1b5dab8f7565fe21312ecdc91b1e0148cf4a6d870cd6cdf8bbc8b Jul 06 14:30:02.444166 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.444133 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r5bn"] Jul 06 14:30:02.447873 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:02.447850 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592dadfd_7458_4b83_82df_9796c2071bdf.slice/crio-7d908b09356b3d4fd2aa97895e78694658183d5db71f1d6ce6de5df089080d0d WatchSource:0}: Error finding container 7d908b09356b3d4fd2aa97895e78694658183d5db71f1d6ce6de5df089080d0d: Status 404 returned error can't find the container with id 7d908b09356b3d4fd2aa97895e78694658183d5db71f1d6ce6de5df089080d0d Jul 06 14:30:02.458452 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.458426 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.516592 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.516486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" event={"ID":"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3","Type":"ContainerStarted","Data":"1341465d0dc79427cae4a05eb1e6a03f6db0741eafb29d36543b58f1bbb1a6cb"} Jul 06 14:30:02.516592 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.516537 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" event={"ID":"fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3","Type":"ContainerStarted","Data":"31ff45bf16c1b5dab8f7565fe21312ecdc91b1e0148cf4a6d870cd6cdf8bbc8b"} Jul 06 14:30:02.516832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.516605 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:02.517689 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.517664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wjxvb" event={"ID":"6de5ca05-99ee-40ff-aefe-9b694791adc9","Type":"ContainerStarted","Data":"6b311fa89a22bb5f5120b28cee013b39af24b5b6791b77347af8036f3bc357d5"} Jul 06 14:30:02.518697 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.518676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" event={"ID":"57b18ef3-6289-4db7-9564-121d84f5ad9f","Type":"ContainerStarted","Data":"93389f9521a555bd7f34b4e1bb9e4305badfcdf996685723ca168b7afdaa474d"} Jul 06 14:30:02.519738 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.519721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r5bn" event={"ID":"592dadfd-7458-4b83-82df-9796c2071bdf","Type":"ContainerStarted","Data":"7d908b09356b3d4fd2aa97895e78694658183d5db71f1d6ce6de5df089080d0d"} Jul 06 14:30:02.520686 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.520665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vdvhc" event={"ID":"5395e3ce-5645-456f-8298-229892d76a52","Type":"ContainerStarted","Data":"a116241ae27ae8b5b36401604e6e904f4e76d2dfa4e55f23fb3c371f120b99be"} Jul 06 14:30:02.546644 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.546591 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" podStartSLOduration=1.5465730519999998 podStartE2EDuration="1.546573052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:02.546113774 +0000 UTC m=+66.846301260" watchObservedRunningTime="2026-07-06 14:30:02.546573052 +0000 UTC m=+66.846760537" Jul 06 14:30:02.562321 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.562290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.647898 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:02.647850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:03.292885 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:03.292848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:30:03.295782 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:03.295750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ef23d22-448f-4291-b06e-9c22be457e5d-metrics-tls\") pod \"dns-default-8jdjr\" (UID: \"0ef23d22-448f-4291-b06e-9c22be457e5d\") " pod="openshift-dns/dns-default-8jdjr" Jul 06 14:30:03.358330 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:03.358301 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rs6zp\"" Jul 06 14:30:03.366602 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:03.366534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jdjr" Jul 06 14:30:03.531964 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:03.531930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jdjr"] Jul 06 14:30:03.815484 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:03.815441 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef23d22_448f_4291_b06e_9c22be457e5d.slice/crio-263f1fc17ced18f344b9e8bb0d467982aa0162c7faec6aed21c222b0b86c5b42 WatchSource:0}: Error finding container 263f1fc17ced18f344b9e8bb0d467982aa0162c7faec6aed21c222b0b86c5b42: Status 404 returned error can't find the container with id 263f1fc17ced18f344b9e8bb0d467982aa0162c7faec6aed21c222b0b86c5b42 Jul 06 14:30:04.533165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.533030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r5bn" event={"ID":"592dadfd-7458-4b83-82df-9796c2071bdf","Type":"ContainerStarted","Data":"4978a2b0fbb77f9b482720e9592e56c65e5f37fa14344dd927a2d01049dbf18e"} Jul 06 14:30:04.533165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.533104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r5bn" event={"ID":"592dadfd-7458-4b83-82df-9796c2071bdf","Type":"ContainerStarted","Data":"4706e6cad6ed44f9b176db55e6b893645b1b5a5e6276646b2e09160d150fe576"} Jul 06 14:30:04.535267 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.535237 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jdjr" event={"ID":"0ef23d22-448f-4291-b06e-9c22be457e5d","Type":"ContainerStarted","Data":"263f1fc17ced18f344b9e8bb0d467982aa0162c7faec6aed21c222b0b86c5b42"} Jul 06 14:30:04.561833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.561770 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8r5bn" podStartSLOduration=67.147346205 podStartE2EDuration="1m8.561745825s" totalImagesPullingTime="1.41439962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:04.56036021 +0000 UTC m=+68.860547696" watchObservedRunningTime="2026-07-06 14:30:04.561745825 +0000 UTC m=+68.861933313" Jul 06 14:30:04.624387 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.624286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:04.745301 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.745224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:04.877801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:04.877698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:05.010602 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:05.010561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:05.107708 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:05.107674 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:06.055689 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.055626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:06.268248 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.268217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:06.304374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.304343 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c"] Jul 06 14:30:06.307666 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.307595 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:06.310171 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.310148 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8nx2s\"" Jul 06 14:30:06.310277 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.310153 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 14:30:06.320441 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.319612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c"] Jul 06 14:30:06.421404 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.421354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f5fda4-29a7-4aae-8181-f00f6ee37713-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lh55c\" (UID: \"66f5fda4-29a7-4aae-8181-f00f6ee37713\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:06.473001 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.472956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:06.522765 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.522662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f5fda4-29a7-4aae-8181-f00f6ee37713-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lh55c\" (UID: \"66f5fda4-29a7-4aae-8181-f00f6ee37713\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:06.525735 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.525704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f5fda4-29a7-4aae-8181-f00f6ee37713-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lh55c\" (UID: \"66f5fda4-29a7-4aae-8181-f00f6ee37713\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:06.619215 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:06.619117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:08.154011 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.153934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c"] Jul 06 14:30:08.158800 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:08.158762 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f5fda4_29a7_4aae_8181_f00f6ee37713.slice/crio-de3650c9da69400eeac55d19981fbe265c8f40f6f2e42826e61c691432202634 WatchSource:0}: Error finding container de3650c9da69400eeac55d19981fbe265c8f40f6f2e42826e61c691432202634: Status 404 returned error can't find the container with id de3650c9da69400eeac55d19981fbe265c8f40f6f2e42826e61c691432202634 Jul 06 14:30:08.550604 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.550564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vdvhc" event={"ID":"5395e3ce-5645-456f-8298-229892d76a52","Type":"ContainerStarted","Data":"965653f3e2737c3c3addb3fcd15627df263d569ea0abb2182de42dca8cdbad2c"} Jul 06 14:30:08.552303 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.552280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jdjr" event={"ID":"0ef23d22-448f-4291-b06e-9c22be457e5d","Type":"ContainerStarted","Data":"6108666c5636f41bd853315b392ad55747cf14bc2baed4d8ed40a27000e1bdae"} Jul 06 14:30:08.552436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.552319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jdjr" event={"ID":"0ef23d22-448f-4291-b06e-9c22be457e5d","Type":"ContainerStarted","Data":"2189f96436d5d2ef02e5154c73a8eed2748c8edc3533c2e91d90fa48015ac4bb"} Jul 06 14:30:08.552436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.552339 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8jdjr" Jul 06 14:30:08.553699 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.553679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wjxvb" event={"ID":"6de5ca05-99ee-40ff-aefe-9b694791adc9","Type":"ContainerStarted","Data":"92ea7cade7aa6b95cd815732773a44e300724c8e161aee0b2299a268ef7a763c"} Jul 06 14:30:08.553769 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.553735 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:30:08.554865 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.554842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" event={"ID":"66f5fda4-29a7-4aae-8181-f00f6ee37713","Type":"ContainerStarted","Data":"de3650c9da69400eeac55d19981fbe265c8f40f6f2e42826e61c691432202634"} Jul 06 14:30:08.569043 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.568999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vdvhc" podStartSLOduration=65.98212095 podStartE2EDuration="1m11.568984299s" totalImagesPullingTime="5.586863349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:08.568455157 +0000 UTC m=+72.868642642" watchObservedRunningTime="2026-07-06 14:30:08.568984299 +0000 UTC m=+72.869171763" Jul 06 14:30:08.569627 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.569607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:08.591013 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.590967 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wjxvb" podStartSLOduration=66.787919266 podStartE2EDuration="1m12.590951617s" totalImagesPullingTime="5.803032351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:08.590013675 +0000 UTC m=+72.890201161" watchObservedRunningTime="2026-07-06 14:30:08.590951617 +0000 UTC m=+72.891139102" Jul 06 14:30:08.614127 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.614064 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8jdjr" podStartSLOduration=33.434106724 podStartE2EDuration="37.614048034s" totalImagesPullingTime="4.17994131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:08.613988389 +0000 UTC m=+72.914175876" watchObservedRunningTime="2026-07-06 14:30:08.614048034 +0000 UTC m=+72.914235523" Jul 06 14:30:08.671587 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.671552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:08.769778 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:08.769747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:09.100992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:09.100956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:09.167082 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:09.167048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:10.566026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:10.565990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" event={"ID":"66f5fda4-29a7-4aae-8181-f00f6ee37713","Type":"ContainerStarted","Data":"d12282b1d0bf76accabb13bd7e24ebae1e66d6a6de45da9c089a762bbdf63557"} Jul 06 14:30:10.566421 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:10.566174 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:10.570575 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:10.570551 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" Jul 06 14:30:10.587138 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:10.587092 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lh55c" podStartSLOduration=2.761024398 podStartE2EDuration="4.587077942s" totalImagesPullingTime="1.826053544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:10.585993905 +0000 UTC m=+74.886181391" watchObservedRunningTime="2026-07-06 14:30:10.587077942 +0000 UTC m=+74.887265426" Jul 06 14:30:11.330085 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.330026 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:11.415278 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.415251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:11.621866 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.621780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:11.669493 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.669460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:30:11.671737 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.671709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93ecaea-03b0-447c-8a84-e1055d1875ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8zdpv\" (UID: \"a93ecaea-03b0-447c-8a84-e1055d1875ff\") " pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:30:11.930207 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.930179 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rzjwm\"" Jul 06 14:30:11.938384 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:11.938363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8zdpv" Jul 06 14:30:12.070373 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:12.070338 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8zdpv"] Jul 06 14:30:12.073784 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:12.073737 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93ecaea_03b0_447c_8a84_e1055d1875ff.slice/crio-63596e021fd4f8f993f091e1e476dc103ef4e6bdb3bc39fdf0549229f5bfc0bf WatchSource:0}: Error finding container 63596e021fd4f8f993f091e1e476dc103ef4e6bdb3bc39fdf0549229f5bfc0bf: Status 404 returned error can't find the container with id 63596e021fd4f8f993f091e1e476dc103ef4e6bdb3bc39fdf0549229f5bfc0bf Jul 06 14:30:12.576787 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:12.576711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zdpv" event={"ID":"a93ecaea-03b0-447c-8a84-e1055d1875ff","Type":"ContainerStarted","Data":"63596e021fd4f8f993f091e1e476dc103ef4e6bdb3bc39fdf0549229f5bfc0bf"} Jul 06 14:30:13.656514 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:13.656471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:13.758040 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:13.758003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:16.519870 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:16.519831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:16.593969 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:16.593932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zdpv" event={"ID":"a93ecaea-03b0-447c-8a84-e1055d1875ff","Type":"ContainerStarted","Data":"b517d637a46fe75e8a7e807e0f295dff7fda39edcc7d85b34bf080941bf912fc"} Jul 06 14:30:17.599219 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:17.599179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zdpv" event={"ID":"a93ecaea-03b0-447c-8a84-e1055d1875ff","Type":"ContainerStarted","Data":"81a393a22ee00ee1c94e7b27bd38f7ee85947c4bec4044dbdd174d7a98318456"} Jul 06 14:30:18.391829 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:18.391686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:18.504533 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:18.504495 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:18.562429 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:18.562400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8jdjr" Jul 06 14:30:18.626261 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:18.626221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:18.956493 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:18.956304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.063590 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.063547 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.067395 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.067369 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc"] Jul 06 14:30:19.071082 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.071060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.076348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.075987 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 14:30:19.076348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.076047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 14:30:19.076348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.076151 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 14:30:19.076348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.076235 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bs8fp\"" Jul 06 14:30:19.076348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.076347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 14:30:19.076863 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.076727 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 14:30:19.079957 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.078931 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9974g"] Jul 06 14:30:19.082502 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.082482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.085354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.085332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-949sp\"" Jul 06 14:30:19.085788 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.085769 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 14:30:19.085884 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.085769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 14:30:19.085884 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.085825 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 14:30:19.093030 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.093005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc"] Jul 06 14:30:19.189782 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.189728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.231556 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231464 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-metrics-client-ca\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231556 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-wtmp\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872ss\" (UniqueName: \"kubernetes.io/projected/9eede0d3-5762-4140-b296-3ee027e1a655-kube-api-access-872ss\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a161e8-171b-467f-96ea-036f8803475d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-accelerators-collector-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-root\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.231805 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-tls\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.232224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.232224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkqw\" (UniqueName: \"kubernetes.io/projected/28a161e8-171b-467f-96ea-036f8803475d-kube-api-access-cvkqw\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.232224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-textfile\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.232224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.231949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-sys\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.283912 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.283874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.333001 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.332963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a161e8-171b-467f-96ea-036f8803475d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-accelerators-collector-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-root\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-tls\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkqw\" (UniqueName: \"kubernetes.io/projected/28a161e8-171b-467f-96ea-036f8803475d-kube-api-access-cvkqw\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-textfile\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-sys\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-metrics-client-ca\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-wtmp\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-872ss\" (UniqueName: \"kubernetes.io/projected/9eede0d3-5762-4140-b296-3ee027e1a655-kube-api-access-872ss\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333800 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-root\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333800 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-accelerators-collector-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333800 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-sys\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.333952 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.333914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-textfile\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.334328 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.334151 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-wtmp\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.334328 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.334220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a161e8-171b-467f-96ea-036f8803475d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.334328 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.334256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eede0d3-5762-4140-b296-3ee027e1a655-metrics-client-ca\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.336347 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.336323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.336797 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.336775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9eede0d3-5762-4140-b296-3ee027e1a655-node-exporter-tls\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.337216 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.337196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.338012 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.337992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a161e8-171b-467f-96ea-036f8803475d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.344788 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.344763 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-872ss\" (UniqueName: \"kubernetes.io/projected/9eede0d3-5762-4140-b296-3ee027e1a655-kube-api-access-872ss\") pod \"node-exporter-9974g\" (UID: \"9eede0d3-5762-4140-b296-3ee027e1a655\") " pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.344935 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.344893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkqw\" (UniqueName: \"kubernetes.io/projected/28a161e8-171b-467f-96ea-036f8803475d-kube-api-access-cvkqw\") pod \"openshift-state-metrics-54cf96dfcf-5rlhc\" (UID: \"28a161e8-171b-467f-96ea-036f8803475d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.384148 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.384111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" Jul 06 14:30:19.394335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.394299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9974g" Jul 06 14:30:19.410482 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:19.410429 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eede0d3_5762_4140_b296_3ee027e1a655.slice/crio-6735c529b407443b1e86d5f05ce0f1d205c47a1c0067b12800beb3bd4e06ccc3 WatchSource:0}: Error finding container 6735c529b407443b1e86d5f05ce0f1d205c47a1c0067b12800beb3bd4e06ccc3: Status 404 returned error can't find the container with id 6735c529b407443b1e86d5f05ce0f1d205c47a1c0067b12800beb3bd4e06ccc3 Jul 06 14:30:19.568786 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.568685 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc"] Jul 06 14:30:19.572480 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:19.572438 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a161e8_171b_467f_96ea_036f8803475d.slice/crio-f2b1e7bc4f92c7520d8f58ede362ce47ea8d84958544617ccb72efee8189a629 WatchSource:0}: Error finding container f2b1e7bc4f92c7520d8f58ede362ce47ea8d84958544617ccb72efee8189a629: Status 404 returned error can't find the container with id f2b1e7bc4f92c7520d8f58ede362ce47ea8d84958544617ccb72efee8189a629 Jul 06 14:30:19.598482 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.598440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.611296 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.611258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" event={"ID":"28a161e8-171b-467f-96ea-036f8803475d","Type":"ContainerStarted","Data":"f2b1e7bc4f92c7520d8f58ede362ce47ea8d84958544617ccb72efee8189a629"} Jul 06 14:30:19.613295 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.613226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" event={"ID":"57b18ef3-6289-4db7-9564-121d84f5ad9f","Type":"ContainerStarted","Data":"9df888726d047f5546548812c41f44d85accf5cc7eaa0afed04b13991f239b70"} Jul 06 14:30:19.613621 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.613571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:19.614818 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.614793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9974g" event={"ID":"9eede0d3-5762-4140-b296-3ee027e1a655","Type":"ContainerStarted","Data":"6735c529b407443b1e86d5f05ce0f1d205c47a1c0067b12800beb3bd4e06ccc3"} Jul 06 14:30:19.615791 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.615768 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" Jul 06 14:30:19.634622 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.634542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5789dfc6f-mqtbk" podStartSLOduration=2.1964735810000002 podStartE2EDuration="18.634520946s" totalImagesPullingTime="16.438047365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:19.634228519 +0000 UTC m=+83.934415996" watchObservedRunningTime="2026-07-06 14:30:19.634520946 +0000 UTC m=+83.934708430" Jul 06 14:30:19.721921 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.721889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.891431 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:19.891398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:20.082156 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.082127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:20.227422 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.227339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:20.274763 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.274730 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:30:20.280135 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.280098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.284003 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.283976 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 14:30:20.284146 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.284013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 14:30:20.284268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.284216 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 14:30:20.284480 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.284351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 14:30:20.285397 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.285378 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 14:30:20.285867 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.285846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 14:30:20.286072 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.286053 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 14:30:20.286166 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.286136 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 14:30:20.286233 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.286192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 14:30:20.286284 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.286191 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tgpgz\"" Jul 06 14:30:20.303912 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.303880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:30:20.439971 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.439937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.439988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6v5\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440377 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.440596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.440429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.503948 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.503859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:20.541626 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.541832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.541832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.541832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.541832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.541994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6v5\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542792 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.542909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.542853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.543125 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.543099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.543801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.543773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.545999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.546205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.546380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.546395 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.546795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.546891 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.546813 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.548185 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.548167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.548288 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.548267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.548752 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.548731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.555115 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.555067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6v5\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5\") pod \"alertmanager-main-0\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.592126 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.592090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:30:20.621289 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.621259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" event={"ID":"28a161e8-171b-467f-96ea-036f8803475d","Type":"ContainerStarted","Data":"14e96e02b46c7d7812465dc7730594f3224b5d8b0968db88f7c98218f548a3c7"} Jul 06 14:30:20.621461 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:20.621324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" event={"ID":"28a161e8-171b-467f-96ea-036f8803475d","Type":"ContainerStarted","Data":"80cf4cc7a95750878ac6c83532e512411fec1790e0e204c1adba3d04b6e84345"} Jul 06 14:30:21.453171 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.453140 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:30:21.455409 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:21.455378 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3043f94_307e_4595_8522_7ddbf9c96594.slice/crio-db5e6d54499af80aaf49772fc42c4af20c661713f0270558a54ca59df8db6fa1 WatchSource:0}: Error finding container db5e6d54499af80aaf49772fc42c4af20c661713f0270558a54ca59df8db6fa1: Status 404 returned error can't find the container with id db5e6d54499af80aaf49772fc42c4af20c661713f0270558a54ca59df8db6fa1 Jul 06 14:30:21.627589 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.627551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8zdpv" event={"ID":"a93ecaea-03b0-447c-8a84-e1055d1875ff","Type":"ContainerStarted","Data":"3141db2eec2d6655df76e1e2a6e249e5e44221478c6cecda4287ea43c14e58b7"} Jul 06 14:30:21.629490 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.629458 2581 generic.go:356] "Generic (PLEG): container finished" podID="9eede0d3-5762-4140-b296-3ee027e1a655" containerID="3dca74d2bf8e620081b278fa53c5a357ae0123eb45ef0443e9209f3cd3b79537" exitCode=0 Jul 06 14:30:21.629673 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.629546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9974g" event={"ID":"9eede0d3-5762-4140-b296-3ee027e1a655","Type":"ContainerDied","Data":"3dca74d2bf8e620081b278fa53c5a357ae0123eb45ef0443e9209f3cd3b79537"} Jul 06 14:30:21.631036 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.631008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"db5e6d54499af80aaf49772fc42c4af20c661713f0270558a54ca59df8db6fa1"} Jul 06 14:30:21.652829 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:21.652765 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8zdpv" podStartSLOduration=33.594770107 podStartE2EDuration="42.652743153s" totalImagesPullingTime="9.057973046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:29:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:21.652280307 +0000 UTC m=+85.952467815" watchObservedRunningTime="2026-07-06 14:30:21.652743153 +0000 UTC m=+85.952930641" Jul 06 14:30:22.167421 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.167337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:22.201539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.201500 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v"] Jul 06 14:30:22.205694 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.205675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.208812 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.208786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-595fjg2f6oc82\"" Jul 06 14:30:22.209074 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209011 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 14:30:22.209074 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 14:30:22.209074 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209068 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 14:30:22.209297 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rqm2p\"" Jul 06 14:30:22.209297 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 14:30:22.209388 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.209352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 14:30:22.226673 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.226613 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v"] Jul 06 14:30:22.282352 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.282289 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:22.359051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06daf0d3-1a77-40cd-bbb3-986926ae8312-metrics-client-ca\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-grpc-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359391 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.359391 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.359273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wmq\" (UniqueName: \"kubernetes.io/projected/06daf0d3-1a77-40cd-bbb3-986926ae8312-kube-api-access-c4wmq\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.379886 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.379856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:22.460183 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460183 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-grpc-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460183 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wmq\" (UniqueName: \"kubernetes.io/projected/06daf0d3-1a77-40cd-bbb3-986926ae8312-kube-api-access-c4wmq\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.460862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.460393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06daf0d3-1a77-40cd-bbb3-986926ae8312-metrics-client-ca\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.461752 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.461698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06daf0d3-1a77-40cd-bbb3-986926ae8312-metrics-client-ca\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.463782 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.463728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.463887 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.463845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.463957 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.463899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-grpc-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.465122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.465090 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.465546 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.465527 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.465603 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.465544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06daf0d3-1a77-40cd-bbb3-986926ae8312-secret-thanos-querier-tls\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.470613 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.470591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wmq\" (UniqueName: \"kubernetes.io/projected/06daf0d3-1a77-40cd-bbb3-986926ae8312-kube-api-access-c4wmq\") pod \"thanos-querier-6bb6c8bcd5-9ft8v\" (UID: \"06daf0d3-1a77-40cd-bbb3-986926ae8312\") " pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.515630 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.515589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:22.638982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.638938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" event={"ID":"28a161e8-171b-467f-96ea-036f8803475d","Type":"ContainerStarted","Data":"3dc9ebfdf285ac4bcbe932781e03b117825e697c2d617e708c4745c078c113b2"} Jul 06 14:30:22.641433 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.641405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9974g" event={"ID":"9eede0d3-5762-4140-b296-3ee027e1a655","Type":"ContainerStarted","Data":"248a188af79ad9a7984c89f71b7b865cc83d540f40f4566508cd90e8ba81f417"} Jul 06 14:30:22.641581 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.641466 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9974g" event={"ID":"9eede0d3-5762-4140-b296-3ee027e1a655","Type":"ContainerStarted","Data":"7bfdc9659f37f123742a3e3908a6527dd0bfa8687992b78e1aecd3c655a3f421"} Jul 06 14:30:22.672690 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.672614 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rlhc" podStartSLOduration=1.56435781 podStartE2EDuration="3.6725938s" totalImagesPullingTime="2.10823599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:22.671600925 +0000 UTC m=+86.971788411" watchObservedRunningTime="2026-07-06 14:30:22.6725938 +0000 UTC m=+86.972781288" Jul 06 14:30:22.703953 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.703885 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9974g" podStartSLOduration=1.7555081559999999 podStartE2EDuration="3.703863505s" totalImagesPullingTime="1.868505467s" totalInitContainerRuntime="79.849882ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:22.703259366 +0000 UTC m=+87.003452292" watchObservedRunningTime="2026-07-06 14:30:22.703863505 +0000 UTC m=+87.004050991" Jul 06 14:30:22.924150 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.922257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v"] Jul 06 14:30:22.926991 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:22.926961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:22.957590 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:22.957560 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06daf0d3_1a77_40cd_bbb3_986926ae8312.slice/crio-a796a936d8e95cb8e9411368e3d73c79172e47e36c1f9b9a45497ac22c13c5bd WatchSource:0}: Error finding container a796a936d8e95cb8e9411368e3d73c79172e47e36c1f9b9a45497ac22c13c5bd: Status 404 returned error can't find the container with id a796a936d8e95cb8e9411368e3d73c79172e47e36c1f9b9a45497ac22c13c5bd Jul 06 14:30:23.034229 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.034139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.172242 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.172213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.528992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.528965 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-566479bb5b-mgm88" Jul 06 14:30:23.640739 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.640703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.647063 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.647033 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc" exitCode=0 Jul 06 14:30:23.647219 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.647142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc"} Jul 06 14:30:23.649550 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.649517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"a796a936d8e95cb8e9411368e3d73c79172e47e36c1f9b9a45497ac22c13c5bd"} Jul 06 14:30:23.727044 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.727013 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f48dbcf85-p28kt"] Jul 06 14:30:23.730446 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.730422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.734065 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 14:30:23.734198 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734114 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 14:30:23.734198 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 14:30:23.734302 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vwp4k\"" Jul 06 14:30:23.734368 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734297 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-edkbv3481h8kn\"" Jul 06 14:30:23.734368 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.734305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 14:30:23.755146 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.755119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f48dbcf85-p28kt"] Jul 06 14:30:23.811294 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.811210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.873783 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-client-certs\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.873938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-audit-log\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.873938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtj4\" (UniqueName: \"kubernetes.io/projected/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-kube-api-access-2dtj4\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.873938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.874100 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-metrics-server-audit-profiles\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.874100 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.873999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-tls\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.874100 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.874042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-client-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.965114 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.965080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.975265 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-metrics-server-audit-profiles\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975414 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-tls\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975414 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-client-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975414 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-client-certs\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975414 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-audit-log\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtj4\" (UniqueName: \"kubernetes.io/projected/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-kube-api-access-2dtj4\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.975596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.975463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.976124 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.976060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-audit-log\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.976416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.976366 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.976416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.976397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-metrics-server-audit-profiles\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.978323 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.978297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-client-ca-bundle\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.978436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.978320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-client-certs\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.978495 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.978443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-secret-metrics-server-tls\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:23.997588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:23.997564 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtj4\" (UniqueName: \"kubernetes.io/projected/5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7-kube-api-access-2dtj4\") pod \"metrics-server-6f48dbcf85-p28kt\" (UID: \"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7\") " pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:24.040737 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.040710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:24.057266 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.057238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:24.171680 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.171616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:24.181931 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.181897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f48dbcf85-p28kt"] Jul 06 14:30:24.185822 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:24.185798 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8cfaf5_1e3a_4e8c_b14a_595a9f15a3b7.slice/crio-dddd32320e2e4c1bcddcd255ab08014bf80dad87e04b76fb235a6b8e4e38c262 WatchSource:0}: Error finding container dddd32320e2e4c1bcddcd255ab08014bf80dad87e04b76fb235a6b8e4e38c262: Status 404 returned error can't find the container with id dddd32320e2e4c1bcddcd255ab08014bf80dad87e04b76fb235a6b8e4e38c262 Jul 06 14:30:24.280347 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.280316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:24.379916 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.379876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:24.655918 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:24.655840 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" event={"ID":"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7","Type":"ContainerStarted","Data":"dddd32320e2e4c1bcddcd255ab08014bf80dad87e04b76fb235a6b8e4e38c262"} Jul 06 14:30:25.608145 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.608105 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:30:25.609734 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.609703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:25.612560 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.612539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.619235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.617050 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lzwmf\"" Jul 06 14:30:25.619235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.617074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 14:30:25.619235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.618819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 14:30:25.619235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.618976 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-533hlp8de107e\"" Jul 06 14:30:25.619499 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.619325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 14:30:25.620624 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.620238 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 14:30:25.620624 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.620466 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 14:30:25.620624 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.620510 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 14:30:25.620624 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.620535 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 14:30:25.620624 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.620617 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 14:30:25.621355 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.621337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 14:30:25.621583 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.621345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 14:30:25.621728 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.621473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 14:30:25.621728 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.621560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 14:30:25.621728 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.621691 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 14:30:25.623233 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.623214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 14:30:25.631276 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.631256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:30:25.692028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.691967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqmbq\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.692563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.693340 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.693340 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.693340 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.692728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793261 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793419 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793497 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793497 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqmbq\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793778 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793778 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.793778 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.793993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794045 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794248 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.794388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.795237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.795446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.796157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.795842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.797603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.799787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.799855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.799885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.800138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800685 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.800473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800685 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.800482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.800810 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.800724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.801014 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.800985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.801083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.801015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.801137 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.801014 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.801539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.801511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.802600 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.802578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.808199 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.808172 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqmbq\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq\") pod \"prometheus-k8s-0\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:25.930382 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:25.930274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:26.127750 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.127624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:30:26.129980 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:30:26.129949 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4116af8b_7dd8_4250_a992_d8a03092ba11.slice/crio-75f9766ca0fe84da289d0c648f0167810435013955b4788ba70ce5b036a184ad WatchSource:0}: Error finding container 75f9766ca0fe84da289d0c648f0167810435013955b4788ba70ce5b036a184ad: Status 404 returned error can't find the container with id 75f9766ca0fe84da289d0c648f0167810435013955b4788ba70ce5b036a184ad Jul 06 14:30:26.323009 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.322973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:26.427547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.427505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:26.572628 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.572597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:26.668056 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.668024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3"} Jul 06 14:30:26.668221 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.668113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a"} Jul 06 14:30:26.668221 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.668152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb"} Jul 06 14:30:26.668221 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.668189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f"} Jul 06 14:30:26.668343 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.668225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2"} Jul 06 14:30:26.670128 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.670095 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"c72235e4ac4acee6b8d50f4c80bcc41f5932d06cfe4b6d25b4c769d8ab6cd845"} Jul 06 14:30:26.670256 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.670176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"67f9e6cd7c38678180c439b09cdb480411072e5021c90548bbcb6770b7c4ad3c"} Jul 06 14:30:26.670256 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.670219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"e61334635b4fe27b066a693a2979d86f711e038a814d7eeb91fd8f8e41bf878a"} Jul 06 14:30:26.671714 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.671688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" event={"ID":"5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7","Type":"ContainerStarted","Data":"2aebe9ecb387c65c2236a2377736d16b4d794b3dffed1e55249bc892ac7b019a"} Jul 06 14:30:26.673204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.673183 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" exitCode=0 Jul 06 14:30:26.673310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.673207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} Jul 06 14:30:26.673310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.673275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"75f9766ca0fe84da289d0c648f0167810435013955b4788ba70ce5b036a184ad"} Jul 06 14:30:26.694119 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.694022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" podStartSLOduration=1.284328112 podStartE2EDuration="3.694007213s" totalImagesPullingTime="2.409679101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:26.693239737 +0000 UTC m=+90.993427223" watchObservedRunningTime="2026-07-06 14:30:26.694007213 +0000 UTC m=+90.994194692" Jul 06 14:30:26.760941 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.760908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:26.860881 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:26.860846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:27.186269 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.186231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:27.289550 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.289522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:27.389299 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.389271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:27.680807 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.680767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerStarted","Data":"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c"} Jul 06 14:30:27.683629 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.683602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"a4635298ced2e3d993a7d36d77b94b5ebbbf2fe3e7817af0d5566b2a01ab5a5a"} Jul 06 14:30:27.683753 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.683672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"c336c491b2635c9b5708280b8cd86bc3c98465749a61749c3a5d419fa43ffa81"} Jul 06 14:30:27.683753 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.683701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" event={"ID":"06daf0d3-1a77-40cd-bbb3-986926ae8312","Type":"ContainerStarted","Data":"7a7ec17fa11f3cd6934edc3fe0158915bae081ee4609a30d91bc011bdb491594"} Jul 06 14:30:27.720137 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.720074 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.146732427 podStartE2EDuration="7.720054893s" totalImagesPullingTime="4.554501723s" totalInitContainerRuntime="18.820743ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:27.717894134 +0000 UTC m=+92.018081619" watchObservedRunningTime="2026-07-06 14:30:27.720054893 +0000 UTC m=+92.020242392" Jul 06 14:30:27.760610 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.760535 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" podStartSLOduration=1.7249939319999998 podStartE2EDuration="5.760511646s" totalImagesPullingTime="4.035517714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:27.75982042 +0000 UTC m=+92.060007907" watchObservedRunningTime="2026-07-06 14:30:27.760511646 +0000 UTC m=+92.060699132" Jul 06 14:30:27.780953 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.780919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:27.989027 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:27.988950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:28.083951 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:28.083908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:28.325571 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:28.325495 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:28.688666 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:28.688635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:29.800700 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:29.800666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:29.875857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:29.875820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:30.701850 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:30.701820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} Jul 06 14:30:30.701956 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:30.701924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} Jul 06 14:30:31.709337 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.709299 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} Jul 06 14:30:31.709748 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.709380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} Jul 06 14:30:31.709748 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.709420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} Jul 06 14:30:31.709748 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.709458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerStarted","Data":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} Jul 06 14:30:31.748658 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.748598 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.845424834 podStartE2EDuration="6.748580736s" totalImagesPullingTime="3.880794006s" totalInitContainerRuntime="22.361896ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:31.745400463 +0000 UTC m=+96.045587986" watchObservedRunningTime="2026-07-06 14:30:31.748580736 +0000 UTC m=+96.048768221" Jul 06 14:30:31.862359 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:31.862325 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:32.199685 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:32.199636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:32.269688 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:32.269632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:32.992968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:32.992931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:33.255917 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:33.255834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:33.357342 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:33.357314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:34.700216 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:34.700188 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bb6c8bcd5-9ft8v" Jul 06 14:30:35.930854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:35.930819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:30:39.562277 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:39.562250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wjxvb" Jul 06 14:30:40.640988 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:40.640949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:40.841914 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:40.841882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:42.517141 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:42.517113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:42.604981 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:42.604949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:44.041611 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:44.041582 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:44.042018 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:44.041680 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:30:45.979153 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:45.979122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:46.043476 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:46.043446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:53.975696 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:53.975645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:54.076354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:54.076318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:54.614925 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:54.614893 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:54.716070 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:54.716040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:55.793784 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:55.793751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:55.868588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:55.868557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:56.585521 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:56.585485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:56.690940 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:56.690906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:57.603930 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:57.603896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:57.673428 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:30:57.673396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:04.046816 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:04.046786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:31:04.050727 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:04.050703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f48dbcf85-p28kt" Jul 06 14:31:23.953309 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:23.953272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:24.044731 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:24.044687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:25.931251 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:25.931217 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:25.950195 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:25.950170 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:26.947622 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:26.947589 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:38.628566 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:38.628517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:38.886335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:38.886250 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:39.715547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.715515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:39.983264 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983163 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="alertmanager" containerID="cri-o://2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" gracePeriod=120 Jul 06 14:31:39.983264 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983222 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-metric" containerID="cri-o://6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" gracePeriod=120 Jul 06 14:31:39.983516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983249 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-web" containerID="cri-o://4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" gracePeriod=120 Jul 06 14:31:39.983516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983285 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="prom-label-proxy" containerID="cri-o://7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" gracePeriod=120 Jul 06 14:31:39.983516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983310 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="config-reloader" containerID="cri-o://d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" gracePeriod=120 Jul 06 14:31:39.983516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:39.983284 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy" containerID="cri-o://5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" gracePeriod=120 Jul 06 14:31:40.990615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990581 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" exitCode=0 Jul 06 14:31:40.990615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990609 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" exitCode=0 Jul 06 14:31:40.990615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990616 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" exitCode=0 Jul 06 14:31:40.990615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990621 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" exitCode=0 Jul 06 14:31:40.991207 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c"} Jul 06 14:31:40.991207 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a"} Jul 06 14:31:40.991207 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f"} Jul 06 14:31:40.991207 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:40.990783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2"} Jul 06 14:31:41.340008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.339984 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:41.463801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463759 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.463801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463803 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn6v5\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463826 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463857 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463889 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463949 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.463998 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464042 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464102 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464337 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464416 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464383 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web\") pod \"d3043f94-307e-4595-8522-7ddbf9c96594\" (UID: \"d3043f94-307e-4595-8522-7ddbf9c96594\") " Jul 06 14:31:41.464623 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464555 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:41.464928 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.464902 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-metrics-client-ca\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.465628 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.465280 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:31:41.465628 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.465533 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:41.467235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467044 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.467235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467050 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:31:41.467235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467193 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out" (OuterVolumeSpecName: "config-out") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:31:41.467235 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467198 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.467502 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467368 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.467502 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467427 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.468015 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.467993 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5" (OuterVolumeSpecName: "kube-api-access-kn6v5") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "kube-api-access-kn6v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:31:41.468316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.468301 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume" (OuterVolumeSpecName: "config-volume") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.472057 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.472015 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.478432 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.478405 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config" (OuterVolumeSpecName: "web-config") pod "d3043f94-307e-4595-8522-7ddbf9c96594" (UID: "d3043f94-307e-4595-8522-7ddbf9c96594"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566088 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-main-db\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566123 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566135 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566144 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6v5\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-kube-api-access-kn6v5\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566155 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-config-volume\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566163 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566174 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3043f94-307e-4595-8522-7ddbf9c96594-config-out\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566182 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-cluster-tls-config\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566190 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-web-config\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566199 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3043f94-307e-4595-8522-7ddbf9c96594-secret-alertmanager-main-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566207 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3043f94-307e-4595-8522-7ddbf9c96594-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.566469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.566215 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3043f94-307e-4595-8522-7ddbf9c96594-tls-assets\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:41.997773 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997732 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" exitCode=0 Jul 06 14:31:41.997773 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997761 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3043f94-307e-4595-8522-7ddbf9c96594" containerID="4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" exitCode=0 Jul 06 14:31:41.998273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997808 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:41.998273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3"} Jul 06 14:31:41.998273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb"} Jul 06 14:31:41.998273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3043f94-307e-4595-8522-7ddbf9c96594","Type":"ContainerDied","Data":"db5e6d54499af80aaf49772fc42c4af20c661713f0270558a54ca59df8db6fa1"} Jul 06 14:31:41.998273 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:41.997964 2581 scope.go:117] "RemoveContainer" containerID="7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" Jul 06 14:31:42.006533 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.006509 2581 scope.go:117] "RemoveContainer" containerID="6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" Jul 06 14:31:42.014036 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.014017 2581 scope.go:117] "RemoveContainer" containerID="5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" Jul 06 14:31:42.020786 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.020767 2581 scope.go:117] "RemoveContainer" containerID="4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" Jul 06 14:31:42.025524 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.025501 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:42.028073 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.028053 2581 scope.go:117] "RemoveContainer" containerID="d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" Jul 06 14:31:42.031580 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.031557 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:42.035890 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.035870 2581 scope.go:117] "RemoveContainer" containerID="2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" Jul 06 14:31:42.043129 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.043109 2581 scope.go:117] "RemoveContainer" containerID="9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc" Jul 06 14:31:42.054524 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.054497 2581 scope.go:117] "RemoveContainer" containerID="7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" Jul 06 14:31:42.054796 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.054776 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c\": container with ID starting with 7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c not found: ID does not exist" containerID="7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" Jul 06 14:31:42.054842 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.054804 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c"} err="failed to get container status \"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c\": rpc error: code = NotFound desc = could not find container \"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c\": container with ID starting with 7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c not found: ID does not exist" Jul 06 14:31:42.054842 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.054838 2581 scope.go:117] "RemoveContainer" containerID="6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" Jul 06 14:31:42.055060 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.055043 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3\": container with ID starting with 6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3 not found: ID does not exist" containerID="6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" Jul 06 14:31:42.055096 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055067 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3"} err="failed to get container status \"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3\": rpc error: code = NotFound desc = could not find container \"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3\": container with ID starting with 6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3 not found: ID does not exist" Jul 06 14:31:42.055096 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055084 2581 scope.go:117] "RemoveContainer" containerID="5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" Jul 06 14:31:42.055294 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.055277 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a\": container with ID starting with 5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a not found: ID does not exist" containerID="5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" Jul 06 14:31:42.055335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055298 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a"} err="failed to get container status \"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a\": rpc error: code = NotFound desc = could not find container \"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a\": container with ID starting with 5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a not found: ID does not exist" Jul 06 14:31:42.055335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055311 2581 scope.go:117] "RemoveContainer" containerID="4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" Jul 06 14:31:42.055538 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.055523 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb\": container with ID starting with 4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb not found: ID does not exist" containerID="4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" Jul 06 14:31:42.055587 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055540 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb"} err="failed to get container status \"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb\": rpc error: code = NotFound desc = could not find container \"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb\": container with ID starting with 4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb not found: ID does not exist" Jul 06 14:31:42.055587 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055551 2581 scope.go:117] "RemoveContainer" containerID="d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" Jul 06 14:31:42.055763 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.055749 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f\": container with ID starting with d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f not found: ID does not exist" containerID="d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" Jul 06 14:31:42.055806 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055767 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f"} err="failed to get container status \"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f\": rpc error: code = NotFound desc = could not find container \"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f\": container with ID starting with d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f not found: ID does not exist" Jul 06 14:31:42.055806 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.055779 2581 scope.go:117] "RemoveContainer" containerID="2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" Jul 06 14:31:42.056013 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.055994 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2\": container with ID starting with 2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2 not found: ID does not exist" containerID="2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" Jul 06 14:31:42.056062 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056017 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2"} err="failed to get container status \"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2\": rpc error: code = NotFound desc = could not find container \"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2\": container with ID starting with 2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2 not found: ID does not exist" Jul 06 14:31:42.056062 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056031 2581 scope.go:117] "RemoveContainer" containerID="9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc" Jul 06 14:31:42.056258 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:42.056243 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc\": container with ID starting with 9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc not found: ID does not exist" containerID="9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc" Jul 06 14:31:42.056310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056262 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc"} err="failed to get container status \"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc\": rpc error: code = NotFound desc = could not find container \"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc\": container with ID starting with 9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc not found: ID does not exist" Jul 06 14:31:42.056310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056276 2581 scope.go:117] "RemoveContainer" containerID="7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c" Jul 06 14:31:42.056491 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056475 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c"} err="failed to get container status \"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c\": rpc error: code = NotFound desc = could not find container \"7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c\": container with ID starting with 7c5e2976449ed126a609d397e4e63fa821a6aa90754cceba202934ef86a03c3c not found: ID does not exist" Jul 06 14:31:42.056540 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056490 2581 scope.go:117] "RemoveContainer" containerID="6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3" Jul 06 14:31:42.056714 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056698 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3"} err="failed to get container status \"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3\": rpc error: code = NotFound desc = could not find container \"6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3\": container with ID starting with 6d2ed5de6f8218a244fc70d4ceb8802aea16be2371883b71c5bd078742ff36f3 not found: ID does not exist" Jul 06 14:31:42.056762 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056714 2581 scope.go:117] "RemoveContainer" containerID="5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a" Jul 06 14:31:42.056883 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056868 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a"} err="failed to get container status \"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a\": rpc error: code = NotFound desc = could not find container \"5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a\": container with ID starting with 5d5c51a5620fac8da0ca670bce3c8daa5e2fcb89997ec5f62bfe890bb314503a not found: ID does not exist" Jul 06 14:31:42.056941 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.056884 2581 scope.go:117] "RemoveContainer" containerID="4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb" Jul 06 14:31:42.057105 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057090 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb"} err="failed to get container status \"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb\": rpc error: code = NotFound desc = could not find container \"4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb\": container with ID starting with 4555199ca1c9a52df1126ad8bee1b8b36b0e1ab3d343d24c2feefb3e907b22cb not found: ID does not exist" Jul 06 14:31:42.057153 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057106 2581 scope.go:117] "RemoveContainer" containerID="d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f" Jul 06 14:31:42.057310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057292 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f"} err="failed to get container status \"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f\": rpc error: code = NotFound desc = could not find container \"d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f\": container with ID starting with d1fab29e0d3ecf3e4506691e26f2a2366c2efaa16a43730e16b511983bd9226f not found: ID does not exist" Jul 06 14:31:42.057347 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057312 2581 scope.go:117] "RemoveContainer" containerID="2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2" Jul 06 14:31:42.057523 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057505 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2"} err="failed to get container status \"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2\": rpc error: code = NotFound desc = could not find container \"2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2\": container with ID starting with 2aaff1cdaf42c27383acc77f9a9e460bee8797a3ee345e7ff5a6396aab9450b2 not found: ID does not exist" Jul 06 14:31:42.057573 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057524 2581 scope.go:117] "RemoveContainer" containerID="9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc" Jul 06 14:31:42.057749 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.057734 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc"} err="failed to get container status \"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc\": rpc error: code = NotFound desc = could not find container \"9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc\": container with ID starting with 9ea19d46d3c6280b6d8a447666d458c2a266ea996b5ac5be423a3eb7cfffd1cc not found: ID does not exist" Jul 06 14:31:42.066075 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:42.066359 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066346 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="prom-label-proxy" Jul 06 14:31:42.066396 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066364 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="prom-label-proxy" Jul 06 14:31:42.066396 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066378 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="config-reloader" Jul 06 14:31:42.066396 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066384 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="config-reloader" Jul 06 14:31:42.066396 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066393 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-web" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066399 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-web" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066411 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="init-config-reloader" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066417 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="init-config-reloader" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066438 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="alertmanager" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066445 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="alertmanager" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066454 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066459 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066465 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-metric" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066470 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-metric" Jul 06 14:31:42.066513 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066515 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="alertmanager" Jul 06 14:31:42.066827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066524 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy" Jul 06 14:31:42.066827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066530 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="prom-label-proxy" Jul 06 14:31:42.066827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066535 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-metric" Jul 06 14:31:42.066827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066542 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="config-reloader" Jul 06 14:31:42.066827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.066549 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" containerName="kube-rbac-proxy-web" Jul 06 14:31:42.071591 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.071575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.074390 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 14:31:42.074506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 14:31:42.074506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 14:31:42.074506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 14:31:42.074506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074502 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 14:31:42.074770 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 14:31:42.074876 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074858 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 14:31:42.074932 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074863 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 14:31:42.074932 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.074906 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tgpgz\"" Jul 06 14:31:42.079916 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.079895 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 14:31:42.085452 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.085431 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:42.171295 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171295 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171467 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171547 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-config-out\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-web-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.171828 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.171786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mp7\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-kube-api-access-49mp7\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.234833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.234798 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3043f94-307e-4595-8522-7ddbf9c96594" path="/var/lib/kubelet/pods/d3043f94-307e-4595-8522-7ddbf9c96594/volumes" Jul 06 14:31:42.272284 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272284 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272284 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272508 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272508 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-config-out\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272508 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-web-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272773 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272687 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272829 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mp7\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-kube-api-access-49mp7\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272886 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272886 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.272998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.272964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.274173 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.273627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.274173 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.273632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e436541-d753-499e-bbbe-d46286913561-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.275294 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.275266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e436541-d753-499e-bbbe-d46286913561-config-out\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.275965 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.275938 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-web-config\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276157 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276906 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276884 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.276906 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276898 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e436541-d753-499e-bbbe-d46286913561-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.277001 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.276907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.283270 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.283243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mp7\" (UniqueName: \"kubernetes.io/projected/6e436541-d753-499e-bbbe-d46286913561-kube-api-access-49mp7\") pod \"alertmanager-main-0\" (UID: \"6e436541-d753-499e-bbbe-d46286913561\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.382382 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.382343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:31:42.526333 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:42.526303 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:31:42.528878 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:31:42.528849 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e436541_d753_499e_bbbe_d46286913561.slice/crio-ddb0244c4e82980e3adc34e902c8068884484d1fec1a2b8b5c56487f749405ec WatchSource:0}: Error finding container ddb0244c4e82980e3adc34e902c8068884484d1fec1a2b8b5c56487f749405ec: Status 404 returned error can't find the container with id ddb0244c4e82980e3adc34e902c8068884484d1fec1a2b8b5c56487f749405ec Jul 06 14:31:43.003986 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:43.003944 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e436541-d753-499e-bbbe-d46286913561" containerID="37304832fd5df5827654952a7f9e4cb71f11c3f5de0049fd7a1b62cd208210d0" exitCode=0 Jul 06 14:31:43.004394 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:43.004017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerDied","Data":"37304832fd5df5827654952a7f9e4cb71f11c3f5de0049fd7a1b62cd208210d0"} Jul 06 14:31:43.004394 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:43.004068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"ddb0244c4e82980e3adc34e902c8068884484d1fec1a2b8b5c56487f749405ec"} Jul 06 14:31:44.010888 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.010847 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"cda3b8e9fc64a52947ba34fbcf621a110c3b0da1e169df0f2a3524c5a597de00"} Jul 06 14:31:44.011353 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.010925 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"489b05765d64dabe92f74411801787eda9d9c3d81f43ec3593c7d85cb491fc3d"} Jul 06 14:31:44.011353 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.010964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"6d4f65b8577df1cf5be98877c41ae90ff30b93f93151918e494a3258424353af"} Jul 06 14:31:44.011353 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.011003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"cc9f742a28ccd3872baacb02da6ec71fe5d8181fe34a71effd7156af89fb12f8"} Jul 06 14:31:44.011353 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.011048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"dba7f682de01f78a9efc6eb74a787bd53b382ec79d3ac56126aaaeb374ec49c2"} Jul 06 14:31:44.011353 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.011092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e436541-d753-499e-bbbe-d46286913561","Type":"ContainerStarted","Data":"aac151ad8005050d57cb4f9664e3861a944461335858fb94f2876380ff922f5e"} Jul 06 14:31:44.047283 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.047236 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.030175621 podStartE2EDuration="2.047221152s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.045531ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:44.045835121 +0000 UTC m=+168.346022608" watchObservedRunningTime="2026-07-06 14:31:44.047221152 +0000 UTC m=+168.347408637" Jul 06 14:31:44.108406 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108372 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:44.108732 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108705 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="prometheus" containerID="cri-o://fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" gracePeriod=600 Jul 06 14:31:44.108905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108721 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy" containerID="cri-o://8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" gracePeriod=600 Jul 06 14:31:44.108905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108750 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-web" containerID="cri-o://bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" gracePeriod=600 Jul 06 14:31:44.108905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108754 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="config-reloader" containerID="cri-o://48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" gracePeriod=600 Jul 06 14:31:44.108905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108749 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="thanos-sidecar" containerID="cri-o://39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" gracePeriod=600 Jul 06 14:31:44.108905 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.108795 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-thanos" containerID="cri-o://285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" gracePeriod=600 Jul 06 14:31:44.361031 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.361004 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:44.494663 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494701 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494744 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494770 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494798 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.494877 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494895 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494919 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494947 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.494980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495024 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495051 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqmbq\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495053 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495082 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495121 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495264 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495297 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495325 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs\") pod \"4116af8b-7dd8-4250-a992-d8a03092ba11\" (UID: \"4116af8b-7dd8-4250-a992-d8a03092ba11\") " Jul 06 14:31:44.495684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.495627 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.496313 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.496282 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.496850 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.496822 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.497401 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497166 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.497401 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497287 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.497566 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497421 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.497566 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497439 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config" (OuterVolumeSpecName: "config") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.497566 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497483 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.497746 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497724 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.497801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497766 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.497976 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.497871 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.498171 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.498089 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.498545 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.498521 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:31:44.498626 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.498586 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:31:44.499400 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.499372 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.499494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.499426 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out" (OuterVolumeSpecName: "config-out") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:31:44.499671 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.499633 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.500055 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.500036 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:31:44.500131 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.500106 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq" (OuterVolumeSpecName: "kube-api-access-zqmbq") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "kube-api-access-zqmbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:31:44.509674 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.509642 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config" (OuterVolumeSpecName: "web-config") pod "4116af8b-7dd8-4250-a992-d8a03092ba11" (UID: "4116af8b-7dd8-4250-a992-d8a03092ba11"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596331 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-db\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596361 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596371 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596381 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-web-config\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596389 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4116af8b-7dd8-4250-a992-d8a03092ba11-config-out\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596397 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqmbq\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-kube-api-access-zqmbq\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596407 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4116af8b-7dd8-4250-a992-d8a03092ba11-tls-assets\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596416 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596425 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596433 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596443 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-kube-rbac-proxy\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596452 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-configmap-metrics-client-ca\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596461 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-metrics-client-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596470 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-grpc-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596479 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596488 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596497 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4116af8b-7dd8-4250-a992-d8a03092ba11-config\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596504 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:44.596759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:44.596513 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4116af8b-7dd8-4250-a992-d8a03092ba11-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:31:45.018167 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018129 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" exitCode=0 Jul 06 14:31:45.018167 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018162 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" exitCode=0 Jul 06 14:31:45.018167 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018172 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" exitCode=0 Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018181 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" exitCode=0 Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018189 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" exitCode=0 Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018197 2581 generic.go:356] "Generic (PLEG): container finished" podID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" exitCode=0 Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018234 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018316 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018356 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} Jul 06 14:31:45.018713 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.018427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4116af8b-7dd8-4250-a992-d8a03092ba11","Type":"ContainerDied","Data":"75f9766ca0fe84da289d0c648f0167810435013955b4788ba70ce5b036a184ad"} Jul 06 14:31:45.026564 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.026545 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.033845 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.033828 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.040191 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.040170 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.048796 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.048758 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:45.056126 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.056104 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:45.062516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.062493 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.069352 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.069338 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.076236 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.076215 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.082873 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.082858 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.083143 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.083118 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.083210 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083155 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.083210 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083180 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.083425 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.083407 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.083466 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083432 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.083466 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083448 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.083710 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.083691 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.083754 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083716 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.083754 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.083731 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.083999 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.083981 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.084040 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084005 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.084040 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084020 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.084237 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.084219 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.084278 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084240 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.084278 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084261 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.084485 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.084468 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.084522 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084491 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.084522 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084504 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.084750 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:31:45.084734 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.084786 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084756 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.084786 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084771 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.084984 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084967 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.085021 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.084985 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.085231 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085212 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.085231 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085231 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.085450 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085432 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.085491 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085452 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.085692 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085675 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.085741 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085693 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.085911 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085894 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.085949 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.085912 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.086137 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086121 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.086181 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086138 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.086329 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086310 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.086367 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086330 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.086565 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086550 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.086626 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086564 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.086832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086800 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.086832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.086824 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.087075 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087051 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.087075 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087071 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.087300 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087281 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.087300 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087300 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.087554 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087537 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.087719 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087555 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.087901 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087852 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.087901 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.087879 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.088258 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088238 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.088258 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088257 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.088491 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088471 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.088558 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088493 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.088729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088713 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.088729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088729 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.088958 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088942 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.088958 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.088957 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.089158 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089138 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.089211 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089159 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.089385 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089364 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.089385 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089385 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.089621 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089602 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:45.089715 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089618 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.089715 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089640 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.089950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089930 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.089992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089949 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="init-config-reloader" Jul 06 14:31:45.089992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089967 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="init-config-reloader" Jul 06 14:31:45.089992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089980 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="thanos-sidecar" Jul 06 14:31:45.089992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089985 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="thanos-sidecar" Jul 06 14:31:45.089992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089992 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-web" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089998 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-web" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090014 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="prometheus" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090019 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="prometheus" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.089952 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090027 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="config-reloader" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090080 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="config-reloader" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090093 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-thanos" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090099 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-thanos" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090110 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090115 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy" Jul 06 14:31:45.090203 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090203 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-web" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090214 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy-thanos" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090222 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="config-reloader" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090229 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="kube-rbac-proxy" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090235 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="thanos-sidecar" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090241 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" containerName="prometheus" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090271 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090288 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090498 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.090594 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090523 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.090934 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090767 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.090934 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.090781 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.091022 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091002 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.091063 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091023 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.091222 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091202 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.091279 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091221 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.091400 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091380 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.091455 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091401 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.091669 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091633 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.091729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091672 2581 scope.go:117] "RemoveContainer" containerID="285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52" Jul 06 14:31:45.091923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091906 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52"} err="failed to get container status \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": rpc error: code = NotFound desc = could not find container \"285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52\": container with ID starting with 285dde79f5b35ae1e3e7fe908fdcddc21ac2367dc48b84fc7604b06b87102f52 not found: ID does not exist" Jul 06 14:31:45.091965 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.091923 2581 scope.go:117] "RemoveContainer" containerID="8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea" Jul 06 14:31:45.092158 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092142 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea"} err="failed to get container status \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": rpc error: code = NotFound desc = could not find container \"8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea\": container with ID starting with 8fa09bd2e7daf769b837f87de6f1c4575fb56c8b207356ae8fb874ccc24956ea not found: ID does not exist" Jul 06 14:31:45.092195 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092158 2581 scope.go:117] "RemoveContainer" containerID="bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0" Jul 06 14:31:45.092362 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092348 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0"} err="failed to get container status \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": rpc error: code = NotFound desc = could not find container \"bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0\": container with ID starting with bee772ca978109e485af00ab8e3ec0045c01215c7d9764a0b5df5d00f90c15d0 not found: ID does not exist" Jul 06 14:31:45.092410 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092362 2581 scope.go:117] "RemoveContainer" containerID="39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3" Jul 06 14:31:45.092559 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092543 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3"} err="failed to get container status \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": rpc error: code = NotFound desc = could not find container \"39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3\": container with ID starting with 39d168dfd9ae525ef3f7603e0ee610bc8a4d9bb6ca684bcb1f5d06c6897312b3 not found: ID does not exist" Jul 06 14:31:45.092559 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092557 2581 scope.go:117] "RemoveContainer" containerID="48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196" Jul 06 14:31:45.092809 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092780 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196"} err="failed to get container status \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": rpc error: code = NotFound desc = could not find container \"48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196\": container with ID starting with 48894652acfcc9852dde0ee4eb966e304877a306d833e2c404c54426c3b3b196 not found: ID does not exist" Jul 06 14:31:45.092861 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.092810 2581 scope.go:117] "RemoveContainer" containerID="fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6" Jul 06 14:31:45.093027 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.093010 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6"} err="failed to get container status \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": rpc error: code = NotFound desc = could not find container \"fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6\": container with ID starting with fedad3042351c7d5862d442bce2475ed3afea4712b7ba6e546c08e34ca2d80b6 not found: ID does not exist" Jul 06 14:31:45.093027 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.093024 2581 scope.go:117] "RemoveContainer" containerID="6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6" Jul 06 14:31:45.093225 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.093208 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6"} err="failed to get container status \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": rpc error: code = NotFound desc = could not find container \"6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6\": container with ID starting with 6c96262193afef095fc2a6cc13586a9452c8bae49af70b9a11a65032ee02d2c6 not found: ID does not exist" Jul 06 14:31:45.095818 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.095802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.102969 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.102948 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 14:31:45.103145 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.103129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-533hlp8de107e\"" Jul 06 14:31:45.103220 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.103161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 14:31:45.103220 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.103208 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 14:31:45.103309 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.103241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 14:31:45.103958 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.103941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 14:31:45.104507 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104491 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 14:31:45.104571 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 14:31:45.104622 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 14:31:45.104696 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104618 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 14:31:45.104696 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 14:31:45.104696 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 14:31:45.104827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lzwmf\"" Jul 06 14:31:45.104827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.104733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 14:31:45.110505 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.110489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 14:31:45.117613 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.117590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:45.121319 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.121298 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 14:31:45.202559 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202559 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-config-out\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.202843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-web-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.202987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rl2\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-kube-api-access-w4rl2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.203224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.203186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.303982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.303890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rl2\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-kube-api-access-w4rl2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.303982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.303927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.303982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.303953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304259 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-config-out\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-web-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.304950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.304908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.305380 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.305356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.305537 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.305516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.306095 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.305764 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.307224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.307101 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.307311 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.307225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.307851 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.307635 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.307851 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.307731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.307947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.308148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-web-config\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.308336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.308518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.308710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309134 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.308929 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0dd016cd-0b25-454a-9e76-682403d246df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309477 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.309457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.309860 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.309842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.310190 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.310163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dd016cd-0b25-454a-9e76-682403d246df-config-out\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.310432 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.310411 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0dd016cd-0b25-454a-9e76-682403d246df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.314520 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.314499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rl2\" (UniqueName: \"kubernetes.io/projected/0dd016cd-0b25-454a-9e76-682403d246df-kube-api-access-w4rl2\") pod \"prometheus-k8s-0\" (UID: \"0dd016cd-0b25-454a-9e76-682403d246df\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.405709 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.405663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:45.552180 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:45.552142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:31:45.557711 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:31:45.557683 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd016cd_0b25_454a_9e76_682403d246df.slice/crio-9cafd99950b3629d1eaadd80a4ba91e0b8927fb08c4de784ae10520cb64968b4 WatchSource:0}: Error finding container 9cafd99950b3629d1eaadd80a4ba91e0b8927fb08c4de784ae10520cb64968b4: Status 404 returned error can't find the container with id 9cafd99950b3629d1eaadd80a4ba91e0b8927fb08c4de784ae10520cb64968b4 Jul 06 14:31:46.025361 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:46.025328 2581 generic.go:356] "Generic (PLEG): container finished" podID="0dd016cd-0b25-454a-9e76-682403d246df" containerID="5cdd3a51b1a39024642f0fbe98f119c9e9e06482f0faa627c5335436a493209f" exitCode=0 Jul 06 14:31:46.025851 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:46.025384 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerDied","Data":"5cdd3a51b1a39024642f0fbe98f119c9e9e06482f0faa627c5335436a493209f"} Jul 06 14:31:46.025851 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:46.025455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"9cafd99950b3629d1eaadd80a4ba91e0b8927fb08c4de784ae10520cb64968b4"} Jul 06 14:31:46.244862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:46.244117 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4116af8b-7dd8-4250-a992-d8a03092ba11" path="/var/lib/kubelet/pods/4116af8b-7dd8-4250-a992-d8a03092ba11/volumes" Jul 06 14:31:47.033048 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"07f481f9fe64bbd43237ef9410b7d6ac96ff2260c2e48668004fcd2275d80efa"} Jul 06 14:31:47.033503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"df6ff3777ebcd57323d20c1095d2fa9eca10952d21cefc2c7fab79ec9ed9b2c0"} Jul 06 14:31:47.033503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"fa8ffdc5657942058272426ee19b3e2036a71bbe8c1b1029f00a727ca3bfb418"} Jul 06 14:31:47.033503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"836a3db6ef7cceb52565c93431e0838fefa3854677af5fa09b987b93cddc9bed"} Jul 06 14:31:47.033503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"e971cf2a80b2dce82d482aa10aadece507e3ac5ebc934aa1d1899f46f05d74fe"} Jul 06 14:31:47.033503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.033175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0dd016cd-0b25-454a-9e76-682403d246df","Type":"ContainerStarted","Data":"21cef7b97218b04ef9b626826c7f3f669dfc718dd2ce80f5dd7a1ba02d0596ec"} Jul 06 14:31:47.071174 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:47.071118 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.050457848 podStartE2EDuration="2.071102597s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.644749ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:47.069176172 +0000 UTC m=+171.369363693" watchObservedRunningTime="2026-07-06 14:31:47.071102597 +0000 UTC m=+171.371290118" Jul 06 14:31:49.692516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:49.692430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:49.792596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:49.792559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:49.903884 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:49.903858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:50.399204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:50.399171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:50.406083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:50.406060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:31:50.505558 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:50.505528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:57.609046 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:57.608991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:57.718135 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:31:57.718103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:01.031838 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:01.031794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:01.133026 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:01.132993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:01.198519 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:01.198480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:34.825402 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:34.825359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:34.884854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:34.884824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:45.405798 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:45.405757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:32:45.421188 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:45.421162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:32:46.290019 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:46.289993 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:32:53.980542 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:53.980513 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:54.058535 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:32:54.058501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:06.144339 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:06.144301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:06.216863 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:06.216827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:08.944043 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:08.944007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:09.045269 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:09.045239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:09.145494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:09.145466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:14.691759 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:14.691720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:14.805032 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:14.804994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:14.901823 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:14.901790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:15.408408 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:15.408374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:16.378355 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:16.378320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:25.315573 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:25.315485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:25.417949 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:25.417923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:25.518620 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:25.518589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:42.882189 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:42.882150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:56.061460 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:56.061430 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:33:56.066298 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:56.066271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:33:56.068954 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:33:56.068933 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 14:34:10.568132 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:10.568096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:11.837471 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:11.837419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:13.544526 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:13.544490 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:13.615833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:13.615802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:15.328667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:15.328617 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:15.432501 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:15.432468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:42.477669 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:42.477611 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:42.764534 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:42.764444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:46.043438 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:46.043402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:46.100157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:46.100126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:47.400546 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:47.400512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:47.593381 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:47.593342 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:48.422255 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:48.422173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:48.521148 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:48.521118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:50.799208 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:50.799162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:51.024822 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:51.024792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:52.863661 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:52.863616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:52.959392 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:52.959365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:58.419310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:34:58.419272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:13.882502 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:13.882468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:13.983239 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:13.983203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:14.529944 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:14.529907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:14.631088 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:14.631060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:21.445041 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:21.445007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:21.539106 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:21.539070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:23.672702 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:23.672633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:36.073988 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.073955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:36.159869 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.159838 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt"] Jul 06 14:35:36.163189 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.163173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.219157 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.219120 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ctvhf\"" Jul 06 14:35:36.219342 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.219255 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 14:35:36.224028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.224010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 14:35:36.224556 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.224541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 14:35:36.226675 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.226646 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:35:36.233011 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.232990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 14:35:36.236801 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.236778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt"] Jul 06 14:35:36.287938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.287910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.287938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.287944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-metrics-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.288148 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.288009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjx97\" (UniqueName: \"kubernetes.io/projected/3e08054e-0caf-4664-97ad-9753832c21c0-kube-api-access-fjx97\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.288148 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.288028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e08054e-0caf-4664-97ad-9753832c21c0-manager-config\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.293824 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.293800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:36.388998 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.388975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.389182 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.389012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-metrics-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.389182 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.389070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjx97\" (UniqueName: \"kubernetes.io/projected/3e08054e-0caf-4664-97ad-9753832c21c0-kube-api-access-fjx97\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.389182 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.389092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e08054e-0caf-4664-97ad-9753832c21c0-manager-config\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.389722 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.389703 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e08054e-0caf-4664-97ad-9753832c21c0-manager-config\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.391515 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.391490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.391642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.391627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e08054e-0caf-4664-97ad-9753832c21c0-metrics-cert\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.401987 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.401960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjx97\" (UniqueName: \"kubernetes.io/projected/3e08054e-0caf-4664-97ad-9753832c21c0-kube-api-access-fjx97\") pod \"lws-controller-manager-6689bc4cf6-cm8mt\" (UID: \"3e08054e-0caf-4664-97ad-9753832c21c0\") " pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.472049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.472014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:36.620534 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.620506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt"] Jul 06 14:35:36.623412 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:35:36.623384 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e08054e_0caf_4664_97ad_9753832c21c0.slice/crio-38ed199a2cfd42d7f62839fecc6c0d6d9e34c32475db17b12f84d78ef62a644f WatchSource:0}: Error finding container 38ed199a2cfd42d7f62839fecc6c0d6d9e34c32475db17b12f84d78ef62a644f: Status 404 returned error can't find the container with id 38ed199a2cfd42d7f62839fecc6c0d6d9e34c32475db17b12f84d78ef62a644f Jul 06 14:35:36.624974 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.624958 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:35:36.937968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:36.937934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" event={"ID":"3e08054e-0caf-4664-97ad-9753832c21c0","Type":"ContainerStarted","Data":"38ed199a2cfd42d7f62839fecc6c0d6d9e34c32475db17b12f84d78ef62a644f"} Jul 06 14:35:39.895673 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:39.895620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:39.952448 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:39.952413 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" event={"ID":"3e08054e-0caf-4664-97ad-9753832c21c0","Type":"ContainerStarted","Data":"8c8f62e41a17861b1824d4e03c3229efa1daab2729c520889febbc60474ec393"} Jul 06 14:35:39.952610 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:39.952474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:39.993331 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:39.993281 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" podStartSLOduration=1.5834228160000001 podStartE2EDuration="3.993265962s" totalImagesPullingTime="2.409843146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:39.991562574 +0000 UTC m=+404.291750070" watchObservedRunningTime="2026-07-06 14:35:39.993265962 +0000 UTC m=+404.293453448" Jul 06 14:35:40.075139 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:40.075101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:40.708119 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:40.708070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.039221 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.039135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.138059 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.138030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.227352 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.227323 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl"] Jul 06 14:35:41.231003 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.230980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.234339 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.234318 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 14:35:41.235518 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.235498 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 14:35:41.235667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.235555 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 14:35:41.257264 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.257097 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 14:35:41.263225 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.263199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r5xql\"" Jul 06 14:35:41.266860 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.266832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl"] Jul 06 14:35:41.336553 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.336465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.336553 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.336505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5vlr\" (UniqueName: \"kubernetes.io/projected/bd26b0f2-a57e-4732-bd08-8652a36673a0-kube-api-access-r5vlr\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.336553 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.336523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.336832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.336718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.336832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.336823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.434319 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.434287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.437736 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.437717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.437826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.437746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.437826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.437774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.437826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.437796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5vlr\" (UniqueName: \"kubernetes.io/projected/bd26b0f2-a57e-4732-bd08-8652a36673a0-kube-api-access-r5vlr\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.437826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.437812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.438174 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.438154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.440098 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.440063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd26b0f2-a57e-4732-bd08-8652a36673a0-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.440216 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.440197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.440286 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.440269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd26b0f2-a57e-4732-bd08-8652a36673a0-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.468090 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.468053 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5vlr\" (UniqueName: \"kubernetes.io/projected/bd26b0f2-a57e-4732-bd08-8652a36673a0-kube-api-access-r5vlr\") pod \"opendatahub-operator-controller-manager-75545b5d88-zfqxl\" (UID: \"bd26b0f2-a57e-4732-bd08-8652a36673a0\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.541440 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.541402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:41.544100 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.544060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.640307 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.640278 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.687875 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.687837 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl"] Jul 06 14:35:41.692389 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:35:41.692364 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd26b0f2_a57e_4732_bd08_8652a36673a0.slice/crio-bf7327abbea5464c283ebea562c75fa88e31695555e8fe9ad407f89c482abb60 WatchSource:0}: Error finding container bf7327abbea5464c283ebea562c75fa88e31695555e8fe9ad407f89c482abb60: Status 404 returned error can't find the container with id bf7327abbea5464c283ebea562c75fa88e31695555e8fe9ad407f89c482abb60 Jul 06 14:35:41.734851 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.734820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.839006 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.838934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.936367 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.936333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:41.963202 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:41.963144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" event={"ID":"bd26b0f2-a57e-4732-bd08-8652a36673a0","Type":"ContainerStarted","Data":"bf7327abbea5464c283ebea562c75fa88e31695555e8fe9ad407f89c482abb60"} Jul 06 14:35:42.041456 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:42.041427 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:44.979979 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:44.979889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" event={"ID":"bd26b0f2-a57e-4732-bd08-8652a36673a0","Type":"ContainerStarted","Data":"6c86634dabe4a0909660b21547a80e40c73c519a8a9a8e223a6369602f5ea22f"} Jul 06 14:35:45.985606 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:45.985568 2581 generic.go:356] "Generic (PLEG): container finished" podID="bd26b0f2-a57e-4732-bd08-8652a36673a0" containerID="6c86634dabe4a0909660b21547a80e40c73c519a8a9a8e223a6369602f5ea22f" exitCode=0 Jul 06 14:35:45.986009 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:45.985622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" event={"ID":"bd26b0f2-a57e-4732-bd08-8652a36673a0","Type":"ContainerDied","Data":"6c86634dabe4a0909660b21547a80e40c73c519a8a9a8e223a6369602f5ea22f"} Jul 06 14:35:46.991378 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:46.991342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" event={"ID":"bd26b0f2-a57e-4732-bd08-8652a36673a0","Type":"ContainerStarted","Data":"c4bde76cb52d12963201fc79fa43578b016b062171083a6200e767bdcf9c7559"} Jul 06 14:35:46.991755 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:46.991469 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:35:47.041552 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:47.041496 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" podStartSLOduration=1.532753241 podStartE2EDuration="6.041480231s" totalImagesPullingTime="3.4336279s" totalInitContainerRuntime="1.07509909s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:35:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:47.040272924 +0000 UTC m=+411.340460409" watchObservedRunningTime="2026-07-06 14:35:47.041480231 +0000 UTC m=+411.341667716" Jul 06 14:35:48.811906 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:48.811846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:50.959284 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:50.959259 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6689bc4cf6-cm8mt" Jul 06 14:35:57.997743 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:35:57.997713 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-zfqxl" Jul 06 14:36:00.893669 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:00.893607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:01.076822 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:01.076787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:04.823893 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.823835 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-gpt9f"] Jul 06 14:36:04.824437 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.824052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:04.834965 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.834932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:04.853585 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.853551 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 14:36:04.853771 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.853702 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 14:36:04.853843 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.853795 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 14:36:04.862954 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.862924 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-gpt9f"] Jul 06 14:36:04.863858 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.863840 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 14:36:04.864190 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.864170 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sw6c9\"" Jul 06 14:36:04.953982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.953934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5bsx\" (UniqueName: \"kubernetes.io/projected/5355a900-9e72-47d0-9109-7f9123fdd462-kube-api-access-s5bsx\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:04.953982 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.953987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355a900-9e72-47d0-9109-7f9123fdd462-tls-certs\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:04.954243 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:04.954070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5355a900-9e72-47d0-9109-7f9123fdd462-tmp\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.010282 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.010240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:05.055172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.055125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5bsx\" (UniqueName: \"kubernetes.io/projected/5355a900-9e72-47d0-9109-7f9123fdd462-kube-api-access-s5bsx\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.055172 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.055172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355a900-9e72-47d0-9109-7f9123fdd462-tls-certs\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.055435 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.055196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5355a900-9e72-47d0-9109-7f9123fdd462-tmp\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.057560 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.057534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5355a900-9e72-47d0-9109-7f9123fdd462-tmp\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.057716 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.057608 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355a900-9e72-47d0-9109-7f9123fdd462-tls-certs\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.085474 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.085402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5bsx\" (UniqueName: \"kubernetes.io/projected/5355a900-9e72-47d0-9109-7f9123fdd462-kube-api-access-s5bsx\") pod \"kube-auth-proxy-855f944d48-gpt9f\" (UID: \"5355a900-9e72-47d0-9109-7f9123fdd462\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.146307 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.146271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" Jul 06 14:36:05.255525 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.255442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:05.314103 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.314079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-gpt9f"] Jul 06 14:36:05.316638 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:36:05.316604 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355a900_9e72_47d0_9109_7f9123fdd462.slice/crio-9a56b93f3145e1cbc742f70529d0d95026ee30f285be963ecf26bf4b7fd5de9c WatchSource:0}: Error finding container 9a56b93f3145e1cbc742f70529d0d95026ee30f285be963ecf26bf4b7fd5de9c: Status 404 returned error can't find the container with id 9a56b93f3145e1cbc742f70529d0d95026ee30f285be963ecf26bf4b7fd5de9c Jul 06 14:36:05.392435 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.392403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:05.732165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.732057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:05.931523 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:05.931488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:06.077303 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:06.077219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" event={"ID":"5355a900-9e72-47d0-9109-7f9123fdd462","Type":"ContainerStarted","Data":"9a56b93f3145e1cbc742f70529d0d95026ee30f285be963ecf26bf4b7fd5de9c"} Jul 06 14:36:06.251221 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:06.251185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:06.624668 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:06.624613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:07.918440 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:07.918402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:08.179381 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:08.179298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:09.094065 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:09.094021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" event={"ID":"5355a900-9e72-47d0-9109-7f9123fdd462","Type":"ContainerStarted","Data":"4d579349fbd9fb00c3ad82a878969d0ecf4885e7a903264469b998e64567cfc6"} Jul 06 14:36:09.129120 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:09.129064 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-855f944d48-gpt9f" podStartSLOduration=1.8853036589999999 podStartE2EDuration="5.129048054s" totalImagesPullingTime="3.243744395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:09.127255336 +0000 UTC m=+433.427442832" watchObservedRunningTime="2026-07-06 14:36:09.129048054 +0000 UTC m=+433.429235539" Jul 06 14:36:09.886441 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:09.886413 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:15.142211 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:15.142177 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:15.307043 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:15.307011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:16.878947 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:16.878902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:17.109327 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:17.109291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:17.443222 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:17.443185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:17.777051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:17.776968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:17.952407 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:17.952355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:19.021685 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:19.021644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:19.389582 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:19.389550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:39.901186 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:39.901153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:42.109246 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:42.109213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:42.211397 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:42.211357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:44.205613 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:44.205574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:44.387423 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:36:44.387392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:02.755727 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:02.755691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:02.852139 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:02.852103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:03.049548 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:03.049458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:27.405343 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:27.405306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:27.501710 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:27.501642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:31.041827 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:31.041789 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:35.243367 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:35.243336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:37.880867 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:37.880832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:38.328931 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:38.328852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:38.466616 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:38.466565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:38.675069 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:38.675036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:38.931336 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:38.931252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:40.321346 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:40.321310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:42.119407 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:42.119366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:42.749548 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:42.749516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:45.922347 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:45.922313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:47.878165 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:47.878129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:48.105150 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:48.105074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:51.001608 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:51.001574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:51.117581 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:51.117550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:54.401059 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:54.401032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:54.488777 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:54.488739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:55.499479 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.499442 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f"] Jul 06 14:37:55.503211 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.503192 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.506136 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.506109 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 14:37:55.506436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.506421 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 14:37:55.506436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.506431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 14:37:55.507493 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.507468 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 14:37:55.507493 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.507481 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t92s5\"" Jul 06 14:37:55.514590 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.514566 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f"] Jul 06 14:37:55.517733 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.517709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:55.535369 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.535341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8fd256a-ec2f-4068-9d56-2531ba59b936-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.535494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.535447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.535537 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.535508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b62x5\" (UniqueName: \"kubernetes.io/projected/b8fd256a-ec2f-4068-9d56-2531ba59b936-kube-api-access-b62x5\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.636577 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.636545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8fd256a-ec2f-4068-9d56-2531ba59b936-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.636796 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.636603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.636796 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.636631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62x5\" (UniqueName: \"kubernetes.io/projected/b8fd256a-ec2f-4068-9d56-2531ba59b936-kube-api-access-b62x5\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.636915 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:37:55.636789 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 14:37:55.636965 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:37:55.636943 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert podName:b8fd256a-ec2f-4068-9d56-2531ba59b936 nodeName:}" failed. No retries permitted until 2026-07-06 14:37:56.136919806 +0000 UTC m=+540.437107280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cpn5f" (UID: "b8fd256a-ec2f-4068-9d56-2531ba59b936") : secret "plugin-serving-cert" not found Jul 06 14:37:55.637360 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.637337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8fd256a-ec2f-4068-9d56-2531ba59b936-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.656013 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.655987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62x5\" (UniqueName: \"kubernetes.io/projected/b8fd256a-ec2f-4068-9d56-2531ba59b936-kube-api-access-b62x5\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:55.857752 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.857636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:55.983364 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:55.983328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:56.142467 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.142436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:56.145022 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.144992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fd256a-ec2f-4068-9d56-2531ba59b936-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cpn5f\" (UID: \"b8fd256a-ec2f-4068-9d56-2531ba59b936\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:56.206146 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.206111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:56.424787 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.424705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t92s5\"" Jul 06 14:37:56.429784 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.429765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" Jul 06 14:37:56.580524 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:56.580494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f"] Jul 06 14:37:56.581481 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:37:56.581453 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8fd256a_ec2f_4068_9d56_2531ba59b936.slice/crio-813fb5e30e0910344112de782e440924a893376306cf376957e02bc3bec88a51 WatchSource:0}: Error finding container 813fb5e30e0910344112de782e440924a893376306cf376957e02bc3bec88a51: Status 404 returned error can't find the container with id 813fb5e30e0910344112de782e440924a893376306cf376957e02bc3bec88a51 Jul 06 14:37:57.586354 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:57.586316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" event={"ID":"b8fd256a-ec2f-4068-9d56-2531ba59b936","Type":"ContainerStarted","Data":"813fb5e30e0910344112de782e440924a893376306cf376957e02bc3bec88a51"} Jul 06 14:37:59.573621 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:59.573586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:59.705966 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:37:59.705929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:06.315433 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.315403 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5"] Jul 06 14:38:06.324223 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.324194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:06.330781 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.330755 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gtvhs\"" Jul 06 14:38:06.344684 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.344630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5"] Jul 06 14:38:06.442928 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.442894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzt4\" (UniqueName: \"kubernetes.io/projected/59d9fd06-1634-4c92-b574-b482bca28310-kube-api-access-nqzt4\") pod \"limitador-operator-controller-manager-859d7b78bd-68cn5\" (UID: \"59d9fd06-1634-4c92-b574-b482bca28310\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:06.544389 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.544347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzt4\" (UniqueName: \"kubernetes.io/projected/59d9fd06-1634-4c92-b574-b482bca28310-kube-api-access-nqzt4\") pod \"limitador-operator-controller-manager-859d7b78bd-68cn5\" (UID: \"59d9fd06-1634-4c92-b574-b482bca28310\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:06.549580 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.549538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:06.557192 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.557166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzt4\" (UniqueName: \"kubernetes.io/projected/59d9fd06-1634-4c92-b574-b482bca28310-kube-api-access-nqzt4\") pod \"limitador-operator-controller-manager-859d7b78bd-68cn5\" (UID: \"59d9fd06-1634-4c92-b574-b482bca28310\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:06.638667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.638616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:06.917736 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:06.917637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:09.100178 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:09.100140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:09.210257 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:09.210218 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:14.004498 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:14.004455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:14.118331 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:14.118288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:14.293314 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:14.293226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:18.618923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:18.618890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:18.717035 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:18.716998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:20.002916 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:20.002892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5"] Jul 06 14:38:20.004174 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:38:20.004153 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d9fd06_1634_4c92_b574_b482bca28310.slice/crio-78b6dd7e03ee006cf26c662c8a6cd73e1396ba8329f43eceaa684dfb198696e8 WatchSource:0}: Error finding container 78b6dd7e03ee006cf26c662c8a6cd73e1396ba8329f43eceaa684dfb198696e8: Status 404 returned error can't find the container with id 78b6dd7e03ee006cf26c662c8a6cd73e1396ba8329f43eceaa684dfb198696e8 Jul 06 14:38:20.712669 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:20.712617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" event={"ID":"b8fd256a-ec2f-4068-9d56-2531ba59b936","Type":"ContainerStarted","Data":"24594156bcdcd09b2276aacc27ca817538c2edafdc907354f5dd6409218f6805"} Jul 06 14:38:20.713861 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:20.713837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" event={"ID":"59d9fd06-1634-4c92-b574-b482bca28310","Type":"ContainerStarted","Data":"78b6dd7e03ee006cf26c662c8a6cd73e1396ba8329f43eceaa684dfb198696e8"} Jul 06 14:38:20.735192 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:20.735131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cpn5f" podStartSLOduration=2.385884433 podStartE2EDuration="25.735115286s" totalImagesPullingTime="23.349230853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:20.733779287 +0000 UTC m=+565.033966772" watchObservedRunningTime="2026-07-06 14:38:20.735115286 +0000 UTC m=+565.035302771" Jul 06 14:38:22.730108 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:22.730070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" event={"ID":"59d9fd06-1634-4c92-b574-b482bca28310","Type":"ContainerStarted","Data":"85297d23b36f28206361ee62339f6f2bd4146dd9d6f1063dc5898498dc4f6156"} Jul 06 14:38:22.730506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:22.730195 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:26.300605 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:26.300575 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:26.394146 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:26.394117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:33.737389 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:33.737359 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" Jul 06 14:38:33.770621 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:33.770566 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68cn5" podStartSLOduration=25.911668088 podStartE2EDuration="27.770549332s" totalImagesPullingTime="1.858881244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:22.779984998 +0000 UTC m=+567.080172486" watchObservedRunningTime="2026-07-06 14:38:33.770549332 +0000 UTC m=+578.070737062" Jul 06 14:38:35.238220 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:35.238187 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:35.437442 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:35.437407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:52.610756 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:52.610677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:52.714660 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:52.714607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:53.576056 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.576023 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:38:53.590479 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.590407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:53.612189 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.612156 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:38:53.612548 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.612251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:38:53.615224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.615200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qz6zs\"" Jul 06 14:38:53.679371 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.679336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph5dd\" (UniqueName: \"kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd\") pod \"authorino-75d556bd77-nh6sn\" (UID: \"a82586e1-f049-4faf-a741-1a256a617e94\") " pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:38:53.756020 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.755975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:53.780164 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.780132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph5dd\" (UniqueName: \"kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd\") pod \"authorino-75d556bd77-nh6sn\" (UID: \"a82586e1-f049-4faf-a741-1a256a617e94\") " pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:38:53.793271 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.793238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph5dd\" (UniqueName: \"kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd\") pod \"authorino-75d556bd77-nh6sn\" (UID: \"a82586e1-f049-4faf-a741-1a256a617e94\") " pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:38:53.921402 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.921356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:38:53.925217 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.925125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:53.995563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:53.995536 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:54.054689 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:54.054643 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:38:54.057871 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:38:54.057847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda82586e1_f049_4faf_a741_1a256a617e94.slice/crio-f6fbf9e272f309648ee12ee3e15327340ca04420e12526b61be5090797e429d9 WatchSource:0}: Error finding container f6fbf9e272f309648ee12ee3e15327340ca04420e12526b61be5090797e429d9: Status 404 returned error can't find the container with id f6fbf9e272f309648ee12ee3e15327340ca04420e12526b61be5090797e429d9 Jul 06 14:38:54.882736 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:54.882671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh6sn" event={"ID":"a82586e1-f049-4faf-a741-1a256a617e94","Type":"ContainerStarted","Data":"f6fbf9e272f309648ee12ee3e15327340ca04420e12526b61be5090797e429d9"} Jul 06 14:38:57.435193 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:57.435155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:38:57.435890 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:57.435866 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:38:57.898607 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:57.898574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh6sn" event={"ID":"a82586e1-f049-4faf-a741-1a256a617e94","Type":"ContainerStarted","Data":"03b29b290659c5159b685b13619a957168d024542d9157632d03f22e8fa65d0e"} Jul 06 14:38:57.917725 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:38:57.917682 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nh6sn" podStartSLOduration=1.505325351 podStartE2EDuration="4.917645155s" totalImagesPullingTime="3.412319804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:57.917296114 +0000 UTC m=+602.217483600" watchObservedRunningTime="2026-07-06 14:38:57.917645155 +0000 UTC m=+602.217832640" Jul 06 14:39:09.916132 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:09.916096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:18.582240 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:18.582165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:20.379862 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:20.379827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:22.156419 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:22.156387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:22.842202 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:22.842165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:24.899437 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:24.899405 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:39:24.899959 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:24.899593 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nh6sn" podUID="a82586e1-f049-4faf-a741-1a256a617e94" containerName="authorino" containerID="cri-o://03b29b290659c5159b685b13619a957168d024542d9157632d03f22e8fa65d0e" gracePeriod=30 Jul 06 14:39:25.025838 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.025803 2581 generic.go:356] "Generic (PLEG): container finished" podID="a82586e1-f049-4faf-a741-1a256a617e94" containerID="03b29b290659c5159b685b13619a957168d024542d9157632d03f22e8fa65d0e" exitCode=0 Jul 06 14:39:25.025967 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.025870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh6sn" event={"ID":"a82586e1-f049-4faf-a741-1a256a617e94","Type":"ContainerDied","Data":"03b29b290659c5159b685b13619a957168d024542d9157632d03f22e8fa65d0e"} Jul 06 14:39:25.152168 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.152112 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:39:25.257634 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.257603 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph5dd\" (UniqueName: \"kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd\") pod \"a82586e1-f049-4faf-a741-1a256a617e94\" (UID: \"a82586e1-f049-4faf-a741-1a256a617e94\") " Jul 06 14:39:25.259849 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.259813 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd" (OuterVolumeSpecName: "kube-api-access-ph5dd") pod "a82586e1-f049-4faf-a741-1a256a617e94" (UID: "a82586e1-f049-4faf-a741-1a256a617e94"). InnerVolumeSpecName "kube-api-access-ph5dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:39:25.358763 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:25.358721 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph5dd\" (UniqueName: \"kubernetes.io/projected/a82586e1-f049-4faf-a741-1a256a617e94-kube-api-access-ph5dd\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:39:26.032128 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.032100 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh6sn" Jul 06 14:39:26.032581 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.032127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh6sn" event={"ID":"a82586e1-f049-4faf-a741-1a256a617e94","Type":"ContainerDied","Data":"f6fbf9e272f309648ee12ee3e15327340ca04420e12526b61be5090797e429d9"} Jul 06 14:39:26.032581 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.032178 2581 scope.go:117] "RemoveContainer" containerID="03b29b290659c5159b685b13619a957168d024542d9157632d03f22e8fa65d0e" Jul 06 14:39:26.056968 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.056949 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:39:26.061882 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.061862 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh6sn"] Jul 06 14:39:26.234962 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:26.234934 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82586e1-f049-4faf-a741-1a256a617e94" path="/var/lib/kubelet/pods/a82586e1-f049-4faf-a741-1a256a617e94/volumes" Jul 06 14:39:29.753579 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.753539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:29.779774 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.779740 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:29.780296 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.780274 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82586e1-f049-4faf-a741-1a256a617e94" containerName="authorino" Jul 06 14:39:29.780296 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.780292 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82586e1-f049-4faf-a741-1a256a617e94" containerName="authorino" Jul 06 14:39:29.780496 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.780368 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a82586e1-f049-4faf-a741-1a256a617e94" containerName="authorino" Jul 06 14:39:29.784765 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.784748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:29.789183 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.789162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 14:39:29.789583 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.789381 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6sg57\"" Jul 06 14:39:29.790019 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.789899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 14:39:29.797459 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.797436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:29.881433 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.881400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:29.903770 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.903741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x276d\" (UniqueName: \"kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:29.903911 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.903778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:29.988010 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.987978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:29.997268 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:29.997242 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:39:30.000598 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.000582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.004320 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.004271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x276d\" (UniqueName: \"kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:30.004320 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.004301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:30.006785 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.006764 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:30.013472 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.013446 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:39:30.026412 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.026389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x276d\" (UniqueName: \"kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d\") pod \"maas-controller-5656fff466-j5h8g\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:30.097257 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.097219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:30.105401 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.105376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf92l\" (UniqueName: \"kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.105507 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.105479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.206271 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.206239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.206440 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.206289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf92l\" (UniqueName: \"kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.209122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.209091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.217610 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.217589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf92l\" (UniqueName: \"kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l\") pod \"maas-controller-5495664d98-jd9z7\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.236000 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.235980 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:30.238122 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:39:30.238096 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8621bc6_30c4_449a_95bf_6c09704bae49.slice/crio-abf8740d82678f0a59a901c136bdbf2ddf7ee0b922bfb503f014ee0e58ee18f4 WatchSource:0}: Error finding container abf8740d82678f0a59a901c136bdbf2ddf7ee0b922bfb503f014ee0e58ee18f4: Status 404 returned error can't find the container with id abf8740d82678f0a59a901c136bdbf2ddf7ee0b922bfb503f014ee0e58ee18f4 Jul 06 14:39:30.319872 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.319791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:30.460396 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:30.460369 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:39:30.462299 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:39:30.462270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47304307_db0e_4074_bdfe_1f4fa568002e.slice/crio-879a66ee7d234751ced0bfc983aeed65acce7d9e92cd4e2b093a0a2d1d8d5564 WatchSource:0}: Error finding container 879a66ee7d234751ced0bfc983aeed65acce7d9e92cd4e2b093a0a2d1d8d5564: Status 404 returned error can't find the container with id 879a66ee7d234751ced0bfc983aeed65acce7d9e92cd4e2b093a0a2d1d8d5564 Jul 06 14:39:31.066615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:31.066527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-jd9z7" event={"ID":"47304307-db0e-4074-bdfe-1f4fa568002e","Type":"ContainerStarted","Data":"879a66ee7d234751ced0bfc983aeed65acce7d9e92cd4e2b093a0a2d1d8d5564"} Jul 06 14:39:31.068474 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:31.068441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656fff466-j5h8g" event={"ID":"b8621bc6-30c4-449a-95bf-6c09704bae49","Type":"ContainerStarted","Data":"abf8740d82678f0a59a901c136bdbf2ddf7ee0b922bfb503f014ee0e58ee18f4"} Jul 06 14:39:33.080054 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.080017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-jd9z7" event={"ID":"47304307-db0e-4074-bdfe-1f4fa568002e","Type":"ContainerStarted","Data":"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f"} Jul 06 14:39:33.080503 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.080131 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:33.081688 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.081641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656fff466-j5h8g" event={"ID":"b8621bc6-30c4-449a-95bf-6c09704bae49","Type":"ContainerStarted","Data":"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5"} Jul 06 14:39:33.081830 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.081711 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:33.103283 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.103237 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5495664d98-jd9z7" podStartSLOduration=1.564701385 podStartE2EDuration="4.10322297s" totalImagesPullingTime="2.538521585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:33.102638359 +0000 UTC m=+637.402825846" watchObservedRunningTime="2026-07-06 14:39:33.10322297 +0000 UTC m=+637.403410454" Jul 06 14:39:33.125546 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.125502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5656fff466-j5h8g" podStartSLOduration=1.372671629 podStartE2EDuration="4.125487759s" totalImagesPullingTime="2.75281613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:33.124748728 +0000 UTC m=+637.424936213" watchObservedRunningTime="2026-07-06 14:39:33.125487759 +0000 UTC m=+637.425675244" Jul 06 14:39:33.239118 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.239031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:33.330316 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:33.330281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:34.504804 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:34.504769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:35.767889 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:35.767805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:39:44.092261 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.092229 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:39:44.092750 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.092450 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:44.155433 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.155400 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:44.155619 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.155594 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5656fff466-j5h8g" podUID="b8621bc6-30c4-449a-95bf-6c09704bae49" containerName="manager" containerID="cri-o://88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5" gracePeriod=30 Jul 06 14:39:44.401034 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.401010 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:44.543370 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.543334 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x276d\" (UniqueName: \"kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d\") pod \"b8621bc6-30c4-449a-95bf-6c09704bae49\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " Jul 06 14:39:44.543539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.543422 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert\") pod \"b8621bc6-30c4-449a-95bf-6c09704bae49\" (UID: \"b8621bc6-30c4-449a-95bf-6c09704bae49\") " Jul 06 14:39:44.545626 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.545599 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b8621bc6-30c4-449a-95bf-6c09704bae49" (UID: "b8621bc6-30c4-449a-95bf-6c09704bae49"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:39:44.545724 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.545642 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d" (OuterVolumeSpecName: "kube-api-access-x276d") pod "b8621bc6-30c4-449a-95bf-6c09704bae49" (UID: "b8621bc6-30c4-449a-95bf-6c09704bae49"). InnerVolumeSpecName "kube-api-access-x276d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:39:44.644332 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.644248 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8621bc6-30c4-449a-95bf-6c09704bae49-webhook-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:39:44.644332 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:44.644276 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x276d\" (UniqueName: \"kubernetes.io/projected/b8621bc6-30c4-449a-95bf-6c09704bae49-kube-api-access-x276d\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:39:45.136005 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.135976 2581 generic.go:356] "Generic (PLEG): container finished" podID="b8621bc6-30c4-449a-95bf-6c09704bae49" containerID="88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5" exitCode=0 Jul 06 14:39:45.136494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.136037 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656fff466-j5h8g" Jul 06 14:39:45.136494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.136045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656fff466-j5h8g" event={"ID":"b8621bc6-30c4-449a-95bf-6c09704bae49","Type":"ContainerDied","Data":"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5"} Jul 06 14:39:45.136494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.136097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656fff466-j5h8g" event={"ID":"b8621bc6-30c4-449a-95bf-6c09704bae49","Type":"ContainerDied","Data":"abf8740d82678f0a59a901c136bdbf2ddf7ee0b922bfb503f014ee0e58ee18f4"} Jul 06 14:39:45.136494 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.136118 2581 scope.go:117] "RemoveContainer" containerID="88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5" Jul 06 14:39:45.145020 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.145003 2581 scope.go:117] "RemoveContainer" containerID="88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5" Jul 06 14:39:45.145283 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:39:45.145262 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5\": container with ID starting with 88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5 not found: ID does not exist" containerID="88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5" Jul 06 14:39:45.145332 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.145293 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5"} err="failed to get container status \"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5\": rpc error: code = NotFound desc = could not find container \"88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5\": container with ID starting with 88862cf9e15bc7a941717376456b8f5fcfeccbc0d4e94e2900f1c87fc65664f5 not found: ID does not exist" Jul 06 14:39:45.165046 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.165027 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:45.168373 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:45.168351 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5656fff466-j5h8g"] Jul 06 14:39:46.239929 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:39:46.239894 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8621bc6-30c4-449a-95bf-6c09704bae49" path="/var/lib/kubelet/pods/b8621bc6-30c4-449a-95bf-6c09704bae49/volumes" Jul 06 14:40:01.742667 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:01.742609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:02.185887 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.185854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:02.791620 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.791589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:02.898686 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.898629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:02.924374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.924335 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mt677"] Jul 06 14:40:02.924823 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.924794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8621bc6-30c4-449a-95bf-6c09704bae49" containerName="manager" Jul 06 14:40:02.924823 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.924814 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8621bc6-30c4-449a-95bf-6c09704bae49" containerName="manager" Jul 06 14:40:02.924995 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.924915 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8621bc6-30c4-449a-95bf-6c09704bae49" containerName="manager" Jul 06 14:40:02.973017 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.972986 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mt677"] Jul 06 14:40:02.973189 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.973081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:02.977182 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.977157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8d6z5\"" Jul 06 14:40:02.977320 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.977157 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 14:40:02.998397 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:02.998361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:03.008825 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.008797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvns\" (UniqueName: \"kubernetes.io/projected/0168301e-bbc8-412a-8655-93a7b50d46ec-kube-api-access-ttvns\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.008981 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.008858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0168301e-bbc8-412a-8655-93a7b50d46ec-plugins-config-volume\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.109993 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.109906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0168301e-bbc8-412a-8655-93a7b50d46ec-plugins-config-volume\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.110164 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.110009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvns\" (UniqueName: \"kubernetes.io/projected/0168301e-bbc8-412a-8655-93a7b50d46ec-kube-api-access-ttvns\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.110639 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.110615 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0168301e-bbc8-412a-8655-93a7b50d46ec-plugins-config-volume\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.130406 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.130365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvns\" (UniqueName: \"kubernetes.io/projected/0168301e-bbc8-412a-8655-93a7b50d46ec-kube-api-access-ttvns\") pod \"payload-processing-58f86c7798-mt677\" (UID: \"0168301e-bbc8-412a-8655-93a7b50d46ec\") " pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.284213 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.284171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:03.429424 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:03.429392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mt677"] Jul 06 14:40:03.432105 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:40:03.432061 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0168301e_bbc8_412a_8655_93a7b50d46ec.slice/crio-a4952a8c613be835e95edf91d0dc8837d3013c6a132ab340a349dbd94293c11d WatchSource:0}: Error finding container a4952a8c613be835e95edf91d0dc8837d3013c6a132ab340a349dbd94293c11d: Status 404 returned error can't find the container with id a4952a8c613be835e95edf91d0dc8837d3013c6a132ab340a349dbd94293c11d Jul 06 14:40:04.235555 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:04.235502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mt677" event={"ID":"0168301e-bbc8-412a-8655-93a7b50d46ec","Type":"ContainerStarted","Data":"a4952a8c613be835e95edf91d0dc8837d3013c6a132ab340a349dbd94293c11d"} Jul 06 14:40:05.236711 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:05.236627 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mt677" event={"ID":"0168301e-bbc8-412a-8655-93a7b50d46ec","Type":"ContainerStarted","Data":"f1508fb6689ea49b84afc566f8cc3dd64e9a180ee39a233a31e56a0cd4681dbc"} Jul 06 14:40:05.237079 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:05.236773 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:05.260254 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:05.260200 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mt677" podStartSLOduration=1.759192032 podStartE2EDuration="3.260185476s" totalImagesPullingTime="1.500993444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:05.259478183 +0000 UTC m=+669.559665668" watchObservedRunningTime="2026-07-06 14:40:05.260185476 +0000 UTC m=+669.560372960" Jul 06 14:40:15.165904 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:15.165866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:15.263293 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:15.263247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:16.242614 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:16.242589 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mt677" Jul 06 14:40:22.449792 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:22.449757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:44.632096 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.632063 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7md64"] Jul 06 14:40:44.636844 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.636823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.640576 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.640554 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 14:40:44.641845 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.641823 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 14:40:44.641989 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.641913 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q94n4\"" Jul 06 14:40:44.641989 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.641944 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 14:40:44.652835 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.652816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7md64"] Jul 06 14:40:44.673622 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.673795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.673795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.673795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knxq\" (UniqueName: \"kubernetes.io/projected/9c91f421-105f-488c-8397-fd56efb28fa8-kube-api-access-9knxq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.673795 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.673950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.673819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c91f421-105f-488c-8397-fd56efb28fa8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.682099 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.682074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:44.775087 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775087 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c91f421-105f-488c-8397-fd56efb28fa8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775341 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775399 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775399 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knxq\" (UniqueName: \"kubernetes.io/projected/9c91f421-105f-488c-8397-fd56efb28fa8-kube-api-access-9knxq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775512 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.775751 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.775729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.777478 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.777455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c91f421-105f-488c-8397-fd56efb28fa8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.777881 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.777862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c91f421-105f-488c-8397-fd56efb28fa8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.786098 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.786079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knxq\" (UniqueName: \"kubernetes.io/projected/9c91f421-105f-488c-8397-fd56efb28fa8-kube-api-access-9knxq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7md64\" (UID: \"9c91f421-105f-488c-8397-fd56efb28fa8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:44.947716 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:44.947602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:45.087435 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:45.087404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7md64"] Jul 06 14:40:45.090785 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:40:45.090755 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c91f421_105f_488c_8397_fd56efb28fa8.slice/crio-94f0593aafd9663ecb84f285c4c9a86d713772824eec600d984564dc68deca6f WatchSource:0}: Error finding container 94f0593aafd9663ecb84f285c4c9a86d713772824eec600d984564dc68deca6f: Status 404 returned error can't find the container with id 94f0593aafd9663ecb84f285c4c9a86d713772824eec600d984564dc68deca6f Jul 06 14:40:45.092094 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:45.092079 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:40:45.420087 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:45.420042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" event={"ID":"9c91f421-105f-488c-8397-fd56efb28fa8","Type":"ContainerStarted","Data":"94f0593aafd9663ecb84f285c4c9a86d713772824eec600d984564dc68deca6f"} Jul 06 14:40:46.427361 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:46.427315 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" event={"ID":"9c91f421-105f-488c-8397-fd56efb28fa8","Type":"ContainerStarted","Data":"1c7ddd6b96ca771fd45d4ee1556300be9bb067a5d4fe5ccd444c9ba2f949ef50"} Jul 06 14:40:46.448966 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:46.448917 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" podStartSLOduration=1.333335049 podStartE2EDuration="2.448901673s" totalImagesPullingTime="1.115566624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:46.447294879 +0000 UTC m=+710.747482374" watchObservedRunningTime="2026-07-06 14:40:46.448901673 +0000 UTC m=+710.749089158" Jul 06 14:40:50.620539 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:50.620463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:54.948225 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:54.948186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:54.948632 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:54.948242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:54.960549 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:54.960524 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:40:55.480771 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:40:55.480744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7md64" Jul 06 14:41:05.042506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.042472 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q"] Jul 06 14:41:05.046122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.046099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.049032 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.049010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 14:41:05.058951 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.058927 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q"] Jul 06 14:41:05.094119 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.094083 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:05.159130 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.159130 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.159348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.159348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.159348 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.159443 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.159385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzdw\" (UniqueName: \"kubernetes.io/projected/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-kube-api-access-thzdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260133 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzdw\" (UniqueName: \"kubernetes.io/projected/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-kube-api-access-thzdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260306 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260678 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260766 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.260819 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.260773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.262441 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.262416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.262797 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.262781 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.274511 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.274481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzdw\" (UniqueName: \"kubernetes.io/projected/2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f-kube-api-access-thzdw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q\" (UID: \"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.356401 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.356302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:05.493105 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.493079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q"] Jul 06 14:41:05.495034 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:41:05.495006 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d45e0e7_7f68_4c2e_99cb_d00e4f1ea48f.slice/crio-c1d0044bae2d24958ccfd93e88b7f65d357cd0314739917bcfd5759823f59ef6 WatchSource:0}: Error finding container c1d0044bae2d24958ccfd93e88b7f65d357cd0314739917bcfd5759823f59ef6: Status 404 returned error can't find the container with id c1d0044bae2d24958ccfd93e88b7f65d357cd0314739917bcfd5759823f59ef6 Jul 06 14:41:05.522920 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:05.522889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" event={"ID":"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f","Type":"ContainerStarted","Data":"c1d0044bae2d24958ccfd93e88b7f65d357cd0314739917bcfd5759823f59ef6"} Jul 06 14:41:06.529374 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:06.529342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" event={"ID":"2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f","Type":"ContainerStarted","Data":"2a74fc3699e78359175d64d54f440f53132ccd2d174fd3717d854f9570cb3a2c"} Jul 06 14:41:06.553664 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:06.553607 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" podStartSLOduration=1.353651026 podStartE2EDuration="1.553590657s" totalImagesPullingTime="199.939631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:41:06.5512933 +0000 UTC m=+730.851480785" watchObservedRunningTime="2026-07-06 14:41:06.553590657 +0000 UTC m=+730.853778163" Jul 06 14:41:14.058143 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:14.058108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:15.356787 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:15.356742 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:15.357288 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:15.356810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:15.369117 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:15.369089 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:15.583782 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:15.583749 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q" Jul 06 14:41:21.287135 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:21.287100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:34.092153 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:34.092116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:58.826086 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.826050 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54f848dd94-z2xcw"] Jul 06 14:41:58.829510 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.829487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:58.838832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.838813 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qz6zs\"" Jul 06 14:41:58.838933 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.838815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 14:41:58.846415 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.846392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f848dd94-z2xcw"] Jul 06 14:41:58.954936 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.954902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-tls-cert\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:58.955129 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:58.954976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjt26\" (UniqueName: \"kubernetes.io/projected/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-kube-api-access-xjt26\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.038028 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.037991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:59.056409 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.056378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-tls-cert\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.056543 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.056442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjt26\" (UniqueName: \"kubernetes.io/projected/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-kube-api-access-xjt26\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.058995 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.058976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-tls-cert\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.066815 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.066795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjt26\" (UniqueName: \"kubernetes.io/projected/dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6-kube-api-access-xjt26\") pod \"authorino-54f848dd94-z2xcw\" (UID: \"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6\") " pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.138509 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.138477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f848dd94-z2xcw" Jul 06 14:41:59.141926 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.141558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:59.275150 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.275088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f848dd94-z2xcw"] Jul 06 14:41:59.277459 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:41:59.277430 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd4d1a7a_cb3e_48b7_8e10_9d7883e445d6.slice/crio-74766f865b9100573c1a57b840fd2817f583e0873571b384ac254a7cffdc985d WatchSource:0}: Error finding container 74766f865b9100573c1a57b840fd2817f583e0873571b384ac254a7cffdc985d: Status 404 returned error can't find the container with id 74766f865b9100573c1a57b840fd2817f583e0873571b384ac254a7cffdc985d Jul 06 14:41:59.778768 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:41:59.778736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f848dd94-z2xcw" event={"ID":"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6","Type":"ContainerStarted","Data":"74766f865b9100573c1a57b840fd2817f583e0873571b384ac254a7cffdc985d"} Jul 06 14:42:00.350838 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:42:00.350804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:00.646903 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:42:00.646868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:00.788032 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:42:00.787984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f848dd94-z2xcw" event={"ID":"dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6","Type":"ContainerStarted","Data":"cb2ac33e1271deeaa3cb30e6551b7ecb913ff86b86e4fa21fab1a79eabfb308a"} Jul 06 14:42:00.816711 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:42:00.816644 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54f848dd94-z2xcw" podStartSLOduration=2.312572633 podStartE2EDuration="2.816619042s" totalImagesPullingTime="504.046409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:42:00.814271986 +0000 UTC m=+785.114459472" watchObservedRunningTime="2026-07-06 14:42:00.816619042 +0000 UTC m=+785.116806558" Jul 06 14:43:20.664615 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:20.664572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:43:20.745406 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:20.745363 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:43:20.745729 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:20.745699 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5495664d98-jd9z7" podUID="47304307-db0e-4074-bdfe-1f4fa568002e" containerName="manager" containerID="cri-o://8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f" gracePeriod=30 Jul 06 14:43:20.997149 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:20.997127 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:43:21.124923 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.124887 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert\") pod \"47304307-db0e-4074-bdfe-1f4fa568002e\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " Jul 06 14:43:21.125109 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.124991 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf92l\" (UniqueName: \"kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l\") pod \"47304307-db0e-4074-bdfe-1f4fa568002e\" (UID: \"47304307-db0e-4074-bdfe-1f4fa568002e\") " Jul 06 14:43:21.126950 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.126923 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "47304307-db0e-4074-bdfe-1f4fa568002e" (UID: "47304307-db0e-4074-bdfe-1f4fa568002e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:43:21.127070 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.127055 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l" (OuterVolumeSpecName: "kube-api-access-gf92l") pod "47304307-db0e-4074-bdfe-1f4fa568002e" (UID: "47304307-db0e-4074-bdfe-1f4fa568002e"). InnerVolumeSpecName "kube-api-access-gf92l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:43:21.172596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.172502 2581 generic.go:356] "Generic (PLEG): container finished" podID="47304307-db0e-4074-bdfe-1f4fa568002e" containerID="8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f" exitCode=0 Jul 06 14:43:21.172596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.172547 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-jd9z7" Jul 06 14:43:21.172596 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.172582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-jd9z7" event={"ID":"47304307-db0e-4074-bdfe-1f4fa568002e","Type":"ContainerDied","Data":"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f"} Jul 06 14:43:21.172854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.172635 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-jd9z7" event={"ID":"47304307-db0e-4074-bdfe-1f4fa568002e","Type":"ContainerDied","Data":"879a66ee7d234751ced0bfc983aeed65acce7d9e92cd4e2b093a0a2d1d8d5564"} Jul 06 14:43:21.172854 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.172684 2581 scope.go:117] "RemoveContainer" containerID="8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f" Jul 06 14:43:21.181384 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.181358 2581 scope.go:117] "RemoveContainer" containerID="8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f" Jul 06 14:43:21.181625 ip-10-0-137-144 kubenswrapper[2581]: E0706 14:43:21.181610 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f\": container with ID starting with 8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f not found: ID does not exist" containerID="8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f" Jul 06 14:43:21.181693 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.181633 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f"} err="failed to get container status \"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f\": rpc error: code = NotFound desc = could not find container \"8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f\": container with ID starting with 8db26a52bacd89b70e852e91bc70cf51b977a53fa64bef24cdcc98c0f2e0b07f not found: ID does not exist" Jul 06 14:43:21.205171 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.205149 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:43:21.224552 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.224528 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5495664d98-jd9z7"] Jul 06 14:43:21.226479 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.226459 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf92l\" (UniqueName: \"kubernetes.io/projected/47304307-db0e-4074-bdfe-1f4fa568002e-kube-api-access-gf92l\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:43:21.226563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.226499 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47304307-db0e-4074-bdfe-1f4fa568002e-webhook-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 14:43:21.956155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:21.956125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:43:22.051774 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.051742 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5495664d98-sv7l8"] Jul 06 14:43:22.052138 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.052126 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47304307-db0e-4074-bdfe-1f4fa568002e" containerName="manager" Jul 06 14:43:22.052204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.052140 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47304307-db0e-4074-bdfe-1f4fa568002e" containerName="manager" Jul 06 14:43:22.052204 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.052192 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47304307-db0e-4074-bdfe-1f4fa568002e" containerName="manager" Jul 06 14:43:22.055215 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.055200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.058271 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.058252 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 14:43:22.059638 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.059621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6sg57\"" Jul 06 14:43:22.059756 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.059642 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 14:43:22.067086 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.067064 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5495664d98-sv7l8"] Jul 06 14:43:22.136436 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.136402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8t4\" (UniqueName: \"kubernetes.io/projected/bbc0c8c0-1457-4b09-959d-f68535f6a338-kube-api-access-mg8t4\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.136595 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.136498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc0c8c0-1457-4b09-959d-f68535f6a338-webhook-cert\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.234846 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.234764 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47304307-db0e-4074-bdfe-1f4fa568002e" path="/var/lib/kubelet/pods/47304307-db0e-4074-bdfe-1f4fa568002e/volumes" Jul 06 14:43:22.237139 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.237119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc0c8c0-1457-4b09-959d-f68535f6a338-webhook-cert\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.237224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.237186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8t4\" (UniqueName: \"kubernetes.io/projected/bbc0c8c0-1457-4b09-959d-f68535f6a338-kube-api-access-mg8t4\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.239542 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.239496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc0c8c0-1457-4b09-959d-f68535f6a338-webhook-cert\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.251012 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.250990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8t4\" (UniqueName: \"kubernetes.io/projected/bbc0c8c0-1457-4b09-959d-f68535f6a338-kube-api-access-mg8t4\") pod \"maas-controller-5495664d98-sv7l8\" (UID: \"bbc0c8c0-1457-4b09-959d-f68535f6a338\") " pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.365864 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.365825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:22.713934 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:22.713909 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5495664d98-sv7l8"] Jul 06 14:43:22.715577 ip-10-0-137-144 kubenswrapper[2581]: W0706 14:43:22.715548 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc0c8c0_1457_4b09_959d_f68535f6a338.slice/crio-93f26f7a6428ea94be2575a73ba69b44acd513a647e2edd775b7de97d1d53e1a WatchSource:0}: Error finding container 93f26f7a6428ea94be2575a73ba69b44acd513a647e2edd775b7de97d1d53e1a: Status 404 returned error can't find the container with id 93f26f7a6428ea94be2575a73ba69b44acd513a647e2edd775b7de97d1d53e1a Jul 06 14:43:23.183806 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:23.183773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-sv7l8" event={"ID":"bbc0c8c0-1457-4b09-959d-f68535f6a338","Type":"ContainerStarted","Data":"93f26f7a6428ea94be2575a73ba69b44acd513a647e2edd775b7de97d1d53e1a"} Jul 06 14:43:24.190313 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:24.190277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5495664d98-sv7l8" event={"ID":"bbc0c8c0-1457-4b09-959d-f68535f6a338","Type":"ContainerStarted","Data":"a1a1c617a27b65a128748c97604ed53089e50cbe4a173e270d72022374a98f84"} Jul 06 14:43:24.190736 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:24.190392 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:35.201488 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:35.201459 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5495664d98-sv7l8" Jul 06 14:43:35.226185 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:35.226136 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5495664d98-sv7l8" podStartSLOduration=12.655720772 podStartE2EDuration="13.226121237s" totalImagesPullingTime="570.400465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:43:24.223893941 +0000 UTC m=+868.524081426" watchObservedRunningTime="2026-07-06 14:43:35.226121237 +0000 UTC m=+879.526308722" Jul 06 14:43:50.634797 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:50.634712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:43:57.466136 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:57.466104 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:43:57.466640 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:43:57.466104 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:44:02.225399 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:02.225364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:02.346760 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:02.346724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:02.446132 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:02.446088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:09.698145 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:09.698107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:09.811450 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:09.811417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:09.911506 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:09.911471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:10.011501 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:10.011414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:17.373008 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:17.372968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:17.464142 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:17.464111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:46.262049 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:46.262013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:47.534928 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:44:47.534897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:07.926563 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:45:07.926528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:08.022642 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:45:08.022608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:19.916545 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:45:19.916460 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:20.019593 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:45:20.019544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:11.303094 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:46:11.303055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:09.578770 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:09.578737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:24.634693 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:24.634578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:25.391837 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:25.391801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:40.978734 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:40.978694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:42.824237 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:42.824204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:57.495053 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:57.495020 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:48:57.496562 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:48:57.496534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:51:26.993681 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:51:26.993585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:28.745231 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:51:28.745193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:33.527758 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:53:33.527707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:33.613351 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:53:33.613302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.523897 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:53:57.523865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:53:57.526909 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:53:57.526886 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:54:25.951296 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:54:25.951205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:58.545952 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:54:58.545906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:06.096329 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:06.096298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:14.354813 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:14.354763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:19.449852 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:19.449803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.373988 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:22.373955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.474994 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:22.474960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.992454 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:22.992421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.090052 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:30.090007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.154103 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:30.154073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.320067 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:30.320023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.418125 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:30.418093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.510182 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:31.510151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.613812 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:31.613778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.709597 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:31.709560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:32.059258 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:32.059226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:32.160433 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:32.160404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:32.260861 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:32.260809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:33.857981 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:33.857944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:36.718553 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:36.718516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:36.824610 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:36.824556 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:37.010499 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:37.010409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:37.106516 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:37.106472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:37.289123 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:37.289039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:38.749588 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:38.749553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:43.816409 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:43.816373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:43.919830 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:43.919797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:44.046459 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:44.046414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:44.113428 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:44.113344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:45.234077 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:45.234036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:45.331783 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:45.331714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:45.415106 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:45.415076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:45.739013 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:45.738984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:46.069375 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:46.069277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:46.167143 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:46.167086 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:47.209975 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:47.209944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:50.490130 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:50.490050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:50.891911 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:50.891880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:56.872383 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:56.872343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:56.976035 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:56.976002 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:58.317224 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:55:58.317164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:03.287776 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:03.287741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:03.356938 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:03.356906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:03.545055 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:03.544974 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:03.657672 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:03.657619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:04.748979 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:04.748945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:04.837119 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:04.837084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:04.915614 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:04.915583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:05.090308 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:05.090219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:05.453131 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:05.453101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:05.579178 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:05.579144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:06.507919 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:06.507884 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:09.323007 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:09.322965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:09.502046 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:09.502006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:09.615956 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:09.615870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:09.772411 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:09.772371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:11.098814 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:11.098761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:16.416882 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:16.416850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:16.517412 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:16.517378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:16.977452 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:16.977418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:17.078793 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:17.078759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:17.264155 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:17.264046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:18.857956 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:18.857922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:25.898216 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:25.898181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:26.000261 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:26.000232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:26.137110 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:26.137067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:26.283447 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:26.283361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:26.363977 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:26.363950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:27.014819 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:27.014718 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:53.055161 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:53.055124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:59.859857 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:59.859822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:59.964384 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:56:59.964353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:00.060469 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:00.060432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:16.095080 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:16.095033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:23.724561 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:23.724481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:23.951044 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:23.951010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:24.099378 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:24.099292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:34.513421 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:34.513391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:35.407062 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:35.407031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:42.466690 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:42.466631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:42.569466 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:42.569433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:42.672646 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:42.672609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:42.770718 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:42.770628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:43.603966 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:43.603928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:43.700290 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:43.700261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:43.803265 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:43.803231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:45.500824 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:45.500787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:53.240201 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:53.240170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:53.358775 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:53.358740 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:54.190871 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:57:54.190835 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.739397 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:01.739364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.865355 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:01.865325 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.994754 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:01.994663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:02.339826 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:02.339742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:02.443552 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:02.443521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:05.318108 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:05.318075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:05.422051 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:05.422018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:05.523202 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:05.523168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:05.621083 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:05.620998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:05.964394 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:05.964355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:06.087340 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:06.087308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:09.713939 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:09.713905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:10.380960 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:10.380924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:10.485681 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:10.485620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:10.833440 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:10.833343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:17.984993 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:17.984956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.100277 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:18.100239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.355992 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:18.355914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.747535 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:18.747502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.845722 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:18.845688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:25.294631 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:25.294592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:25.394310 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:25.394277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:25.561407 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:25.561295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:25.828294 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:25.828209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:26.018201 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:26.018167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:26.167062 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:26.167031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:26.303239 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:26.303197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:32.908509 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:32.908476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:32.980774 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:32.980742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:33.057885 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:33.057851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:33.158930 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:33.158833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:33.258597 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:33.258563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:39.983057 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:39.983024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.082300 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:40.082262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.397983 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:40.397947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.497410 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:40.497379 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:45.631832 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:45.631787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:45.733183 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:45.733143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:46.866769 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:46.866735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.255995 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:47.255953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.521884 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:47.521806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:50.190560 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:50.190477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:50.370833 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:50.370802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:50.532442 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:50.532357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:50.945122 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:50.945093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:51.045522 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:51.045492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:54.653767 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:54.653727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:57.552863 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:57.552829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:58:57.563747 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:57.563717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 14:58:59.684552 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:58:59.684502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:21.762205 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:59:21.762150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:22.073812 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:59:22.073718 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:22.399373 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:59:22.399328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:28.142871 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:59:28.142809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:33.226335 ip-10-0-137-144 kubenswrapper[2581]: I0706 14:59:33.226298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:08.303744 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:08.303709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:08.569022 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:08.568919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:15.094742 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:15.094705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:31.040408 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:31.040290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:31.160108 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:31.160066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:31.382137 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:31.382103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:31.604471 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:31.604437 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:32.747260 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:32.747228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:32.847015 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:32.846978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:33.649192 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:33.649157 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:33.747179 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:33.747138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:33.846951 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:33.846914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:35.402666 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:35.402622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:43.912602 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:43.912565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:44.153297 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:44.153257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:44.360794 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:44.360707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:51.503189 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:51.503156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:51.613776 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:51.613735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:51.724969 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:00:51.724935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:02.278439 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:02.278395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:03.142206 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:03.142171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:23.646775 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:23.646738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:30.331721 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:30.331681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:30.428484 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:30.428453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:30.700996 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:30.700958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:31.030598 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:31.030505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:31.354396 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:31.354292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:34.204285 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:34.204241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:34.320827 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:34.320787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:34.428451 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:34.428418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:34.517766 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:34.517646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:35.242510 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:35.242471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:35.341855 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:35.341806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:38.677552 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:38.677521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:38.990025 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:38.989917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:39.321417 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:39.321332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:40.154273 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:40.154235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.155946 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.155914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.277901 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.277851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.381820 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.381785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.482873 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.482780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.783997 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.783909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:42.877912 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:42.877866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:46.678325 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:46.678292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:53.874411 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:53.874328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:55.821523 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:55.821472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:57.806782 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:01:57.806736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:03.931928 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:03.931885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:04.059348 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:04.059309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:19.266069 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:19.266025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:40.354987 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:40.354942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:41.335279 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:41.335247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:41.541510 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:41.541473 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:41.954322 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:41.954291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:42.113799 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:42.113769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:42.238299 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:42.238210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:42.439340 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:42.439305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:46.994334 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:46.994301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:53.931207 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:02:53.931168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:24.849238 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:24.849133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:25.150834 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:25.150802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:25.398183 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:25.398151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:25.617943 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:25.617838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:26.049340 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:26.049302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:26.144232 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:26.144200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:26.407962 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:26.407930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:32.595072 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:32.595036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:32.696511 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:32.696474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:32.913433 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:32.913406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:33.125752 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:33.125719 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:33.477503 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:33.477470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:33.804807 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:33.804724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:34.362288 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:34.362257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:36.801050 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:36.801016 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:36.987804 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:36.987769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:37.129840 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:37.129793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:37.489024 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:37.488936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:37.587550 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:37.587511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:40.245009 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:40.244976 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:41.370321 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:41.370285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:41.812273 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:41.812238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:42.191261 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:42.191224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:42.364560 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:42.364518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.026863 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.026798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.125101 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.125072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.222623 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.222595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.323161 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.323086 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.752273 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.752237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:45.866195 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:45.866160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:46.624200 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:46.624171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:46.725992 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:46.725898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:47.493664 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:47.493625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:47.593986 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:47.593949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:49.453712 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:49.453678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:57.599555 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:57.599520 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 15:03:57.603331 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:57.603309 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 15:03:57.807053 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:57.807021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:58.193923 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:58.193887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:58.488311 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:58.488205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:58.589673 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:58.589628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:58.713636 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:03:58.713531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:04.796641 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:04.796600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:04.897574 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:04.897532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:05.113886 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:05.113778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:05.301452 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:05.301409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:05.475588 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:05.475544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:05.850272 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:05.850171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:05.954380 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:05.954320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:06.054865 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:06.054819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:06.352786 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:06.352751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:12.213970 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:12.213931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:12.314386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:12.314349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:12.484031 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:12.483937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:12.738692 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:12.738567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:13.061350 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:13.061257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:13.367575 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:13.367480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:13.888890 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:13.888857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:16.157248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:16.157216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:16.275371 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:16.275331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:16.397889 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:16.397852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:16.520626 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:16.520540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:16.998785 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:16.998736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:17.202620 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:17.202582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:20.570081 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:20.570029 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:20.914292 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:20.914264 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:21.298182 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:21.298089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:21.457833 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:21.457797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.095039 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.094990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.219489 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.219460 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.314446 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.314406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.487866 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.487833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.796398 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.796309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:24.899394 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:24.899365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:28.613237 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:28.613206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:38.059437 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:38.059402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:38.190857 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:38.190825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:45.665571 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:45.665538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:46.414135 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:46.414105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:46.517025 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:46.516993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:54.325065 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:04:54.324986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:05.533690 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.533436 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:05:05.538821 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.538794 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.542702 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.542677 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"default-dockercfg-bhdgz\"" Jul 06 15:05:05.543934 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.543908 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"openshift-service-ca.crt\"" Jul 06 15:05:05.544074 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.543916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"kube-root-ca.crt\"" Jul 06 15:05:05.544280 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.544264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"auth-test-model-c7737a-kserve-self-signed-certs\"" Jul 06 15:05:05.549283 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.549257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:05:05.583978 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.583943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:05.671642 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.671828 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.671828 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.671828 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr78k\" (UniqueName: \"kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.671828 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.671967 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.671844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772603 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772816 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772816 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772816 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr78k\" (UniqueName: \"kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772816 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.772816 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.772763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.773081 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.773058 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.773144 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.773110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.773200 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.773160 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.774879 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.774853 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.775233 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.775214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.782518 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.782493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr78k\" (UniqueName: \"kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k\") pod \"auth-test-model-c7737a-kserve-5cfc78994c-xvn6j\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.850677 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.850555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:05.988372 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:05.988346 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:05:05.990780 ip-10-0-137-144 kubenswrapper[2581]: W0706 15:05:05.990710 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod402951f6_9452_4301_bdf4_887e6b9cd67c.slice/crio-6944d50d94ab3879ef178806e077ccd863c5776dfe87a728d6f15fd9ceac3516 WatchSource:0}: Error finding container 6944d50d94ab3879ef178806e077ccd863c5776dfe87a728d6f15fd9ceac3516: Status 404 returned error can't find the container with id 6944d50d94ab3879ef178806e077ccd863c5776dfe87a728d6f15fd9ceac3516 Jul 06 15:05:06.433430 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:06.433393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" event={"ID":"402951f6-9452-4301-bdf4-887e6b9cd67c","Type":"ContainerStarted","Data":"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d"} Jul 06 15:05:06.433430 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:06.433438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" event={"ID":"402951f6-9452-4301-bdf4-887e6b9cd67c","Type":"ContainerStarted","Data":"6944d50d94ab3879ef178806e077ccd863c5776dfe87a728d6f15fd9ceac3516"} Jul 06 15:05:06.454505 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:06.454444 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" podStartSLOduration=1.454427186 podStartE2EDuration="1.454427186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:05:06.454407257 +0000 UTC m=+2170.754594742" watchObservedRunningTime="2026-07-06 15:05:06.454427186 +0000 UTC m=+2170.754614671" Jul 06 15:05:15.851232 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:15.851192 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:15.851808 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:15.851263 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:15.863957 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:15.863929 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:05:16.491670 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:05:16.491634 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:06:53.268055 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:06:53.268021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:06:53.344857 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:06:53.344823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:03.134331 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:03.134286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:04.102560 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:04.102523 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:07:04.287778 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:04.287742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:15.843164 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:15.843131 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:19.125979 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.125904 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" podUID="402951f6-9452-4301-bdf4-887e6b9cd67c" containerName="main" containerID="cri-o://4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d" gracePeriod=45 Jul 06 15:07:19.381661 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.381583 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:07:19.532504 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532467 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr78k\" (UniqueName: \"kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.532504 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532508 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.532788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532526 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.532788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532614 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.532788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532636 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.532788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532708 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache\") pod \"402951f6-9452-4301-bdf4-887e6b9cd67c\" (UID: \"402951f6-9452-4301-bdf4-887e6b9cd67c\") " Jul 06 15:07:19.533011 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532813 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home" (OuterVolumeSpecName: "home") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:07:19.533011 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.532968 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache" (OuterVolumeSpecName: "model-cache") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:07:19.533122 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.533074 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-model-cache\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:19.533122 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.533089 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-home\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:19.533224 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.533161 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:07:19.534897 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.534867 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm" (OuterVolumeSpecName: "dshm") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:07:19.534897 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.534874 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:07:19.535041 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.534916 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k" (OuterVolumeSpecName: "kube-api-access-gr78k") pod "402951f6-9452-4301-bdf4-887e6b9cd67c" (UID: "402951f6-9452-4301-bdf4-887e6b9cd67c"). InnerVolumeSpecName "kube-api-access-gr78k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:07:19.633819 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.633731 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr78k\" (UniqueName: \"kubernetes.io/projected/402951f6-9452-4301-bdf4-887e6b9cd67c-kube-api-access-gr78k\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:19.633819 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.633760 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-tmp-dir\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:19.633819 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.633771 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/402951f6-9452-4301-bdf4-887e6b9cd67c-tls-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:19.633819 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:19.633778 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/402951f6-9452-4301-bdf4-887e6b9cd67c-dshm\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:07:20.071027 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.070940 2581 generic.go:356] "Generic (PLEG): container finished" podID="402951f6-9452-4301-bdf4-887e6b9cd67c" containerID="4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d" exitCode=0 Jul 06 15:07:20.071027 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.070984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" event={"ID":"402951f6-9452-4301-bdf4-887e6b9cd67c","Type":"ContainerDied","Data":"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d"} Jul 06 15:07:20.071027 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.070992 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" Jul 06 15:07:20.071027 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.071020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j" event={"ID":"402951f6-9452-4301-bdf4-887e6b9cd67c","Type":"ContainerDied","Data":"6944d50d94ab3879ef178806e077ccd863c5776dfe87a728d6f15fd9ceac3516"} Jul 06 15:07:20.071313 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.071042 2581 scope.go:117] "RemoveContainer" containerID="4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d" Jul 06 15:07:20.079971 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.079949 2581 scope.go:117] "RemoveContainer" containerID="4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d" Jul 06 15:07:20.080219 ip-10-0-137-144 kubenswrapper[2581]: E0706 15:07:20.080192 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d\": container with ID starting with 4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d not found: ID does not exist" containerID="4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d" Jul 06 15:07:20.080303 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.080225 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d"} err="failed to get container status \"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d\": rpc error: code = NotFound desc = could not find container \"4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d\": container with ID starting with 4266d12efb0acc4569fa3bc90dcc9b0cbdf0befb0802b4d2abc0add5d68ff57d not found: ID does not exist" Jul 06 15:07:20.095096 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.095066 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:07:20.102226 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.102200 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/auth-test-model-c7737a-kserve-5cfc78994c-xvn6j"] Jul 06 15:07:20.235167 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.235136 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402951f6-9452-4301-bdf4-887e6b9cd67c" path="/var/lib/kubelet/pods/402951f6-9452-4301-bdf4-887e6b9cd67c/volumes" Jul 06 15:07:20.831641 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.831608 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:07:20.832040 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.832025 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402951f6-9452-4301-bdf4-887e6b9cd67c" containerName="main" Jul 06 15:07:20.832108 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.832044 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="402951f6-9452-4301-bdf4-887e6b9cd67c" containerName="main" Jul 06 15:07:20.832145 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.832132 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="402951f6-9452-4301-bdf4-887e6b9cd67c" containerName="main" Jul 06 15:07:20.836721 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.836704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.839682 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.839642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-296ba3\"/\"openshift-service-ca.crt\"" Jul 06 15:07:20.839977 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.839959 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-296ba3\"/\"default-dockercfg-jgmdp\"" Jul 06 15:07:20.841278 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.841261 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-296ba3\"/\"kube-root-ca.crt\"" Jul 06 15:07:20.841336 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.841261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-296ba3\"/\"sub-test-model-296ba3-kserve-self-signed-certs\"" Jul 06 15:07:20.851843 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.851820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:07:20.873670 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.873620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:20.944690 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.944690 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.944949 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshl4\" (UniqueName: \"kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.944949 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.944949 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:20.944949 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:20.944931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.045767 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.045767 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046031 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046031 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046031 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sshl4\" (UniqueName: \"kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046031 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.045935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046258 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.046207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046343 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.046322 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.046407 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.046362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.048300 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.048277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.048543 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.048528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.059933 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.059910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshl4\" (UniqueName: \"kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4\") pod \"sub-test-model-296ba3-kserve-6c7f586845-g5jlv\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.145826 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.145795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:21.285918 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:21.285887 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:07:22.083471 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:22.083430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" event={"ID":"cc6cd6d5-8e87-45bb-895d-addade7564b5","Type":"ContainerStarted","Data":"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd"} Jul 06 15:07:22.083668 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:22.083481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" event={"ID":"cc6cd6d5-8e87-45bb-895d-addade7564b5","Type":"ContainerStarted","Data":"b58ad0e0b1133c8edbd71dfe4ecf41f267e70a38884ac2a45e670246fefa0f3c"} Jul 06 15:07:22.112995 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:22.112940 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" podStartSLOduration=2.112926628 podStartE2EDuration="2.112926628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:07:22.112888381 +0000 UTC m=+2306.413075889" watchObservedRunningTime="2026-07-06 15:07:22.112926628 +0000 UTC m=+2306.413114112" Jul 06 15:07:31.146482 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:31.146448 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:31.147089 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:31.146498 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:31.159094 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:31.159069 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:32.140887 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:32.140850 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:07:58.225436 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.225398 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:07:58.231049 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.231022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.235570 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.235523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"openshift-service-ca.crt\"" Jul 06 15:07:58.235570 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.235525 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"default-dockercfg-bhdgz\"" Jul 06 15:07:58.235570 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.235523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"sub-test-model-c7737a-kserve-self-signed-certs\"" Jul 06 15:07:58.235875 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.235523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"kube-root-ca.crt\"" Jul 06 15:07:58.239109 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.239083 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:07:58.260706 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.260641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:07:58.395524 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.395739 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.395739 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsmt\" (UniqueName: \"kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.395739 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.395847 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.395885 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.395847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496560 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496560 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496560 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496893 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496893 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsmt\" (UniqueName: \"kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.496893 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.497120 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.497120 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.496992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.497120 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.497062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.498881 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.498864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.499143 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.499125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.506535 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.506508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsmt\" (UniqueName: \"kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt\") pod \"sub-test-model-c7737a-kserve-5749df9459-dkgr7\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.542716 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.542681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:07:58.692168 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:58.692136 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:07:58.695851 ip-10-0-137-144 kubenswrapper[2581]: W0706 15:07:58.695821 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddba3972b_5f5d_4599_b62b_88a6fe920f4d.slice/crio-eaba438642d4d685d6ddabe0a8f68f45add8430dc9f3d93815bacc2a90c030e5 WatchSource:0}: Error finding container eaba438642d4d685d6ddabe0a8f68f45add8430dc9f3d93815bacc2a90c030e5: Status 404 returned error can't find the container with id eaba438642d4d685d6ddabe0a8f68f45add8430dc9f3d93815bacc2a90c030e5 Jul 06 15:07:59.275849 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:59.275815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" event={"ID":"dba3972b-5f5d-4599-b62b-88a6fe920f4d","Type":"ContainerStarted","Data":"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220"} Jul 06 15:07:59.276262 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:59.275860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" event={"ID":"dba3972b-5f5d-4599-b62b-88a6fe920f4d","Type":"ContainerStarted","Data":"eaba438642d4d685d6ddabe0a8f68f45add8430dc9f3d93815bacc2a90c030e5"} Jul 06 15:07:59.298694 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:07:59.298614 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" podStartSLOduration=1.298594984 podStartE2EDuration="1.298594984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:07:59.297153353 +0000 UTC m=+2343.597340839" watchObservedRunningTime="2026-07-06 15:07:59.298594984 +0000 UTC m=+2343.598782469" Jul 06 15:08:08.543474 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:08.543432 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:08.544010 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:08.543495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:08.556170 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:08.556144 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:09.334433 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:09.334401 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:41.051014 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:41.050978 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:08:41.085921 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:41.085882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:08:42.019290 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:42.019258 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:08:42.057297 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:42.057266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:08:47.598889 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:47.598856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:08:47.699561 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:47.699508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:08:50.653477 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:50.653055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:08:56.070889 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.070848 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" podUID="cc6cd6d5-8e87-45bb-895d-addade7564b5" containerName="main" containerID="cri-o://d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd" gracePeriod=45 Jul 06 15:08:56.331594 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.331532 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:08:56.424405 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424374 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424583 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424421 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424583 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424441 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424583 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424462 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sshl4\" (UniqueName: \"kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424583 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424511 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424583 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home\") pod \"cc6cd6d5-8e87-45bb-895d-addade7564b5\" (UID: \"cc6cd6d5-8e87-45bb-895d-addade7564b5\") " Jul 06 15:08:56.424883 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424629 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:56.424883 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424769 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:56.424883 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424867 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home" (OuterVolumeSpecName: "home") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:56.425030 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424928 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-model-cache\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.425030 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.424943 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-tmp-dir\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.426604 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.426579 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:08:56.426715 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.426620 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm" (OuterVolumeSpecName: "dshm") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:56.426715 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.426703 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4" (OuterVolumeSpecName: "kube-api-access-sshl4") pod "cc6cd6d5-8e87-45bb-895d-addade7564b5" (UID: "cc6cd6d5-8e87-45bb-895d-addade7564b5"). InnerVolumeSpecName "kube-api-access-sshl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:08:56.526013 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.525977 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-home\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.526013 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.526002 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6cd6d5-8e87-45bb-895d-addade7564b5-tls-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.526013 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.526015 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sshl4\" (UniqueName: \"kubernetes.io/projected/cc6cd6d5-8e87-45bb-895d-addade7564b5-kube-api-access-sshl4\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.526013 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.526023 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6cd6d5-8e87-45bb-895d-addade7564b5-dshm\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:56.553934 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.553891 2581 generic.go:356] "Generic (PLEG): container finished" podID="cc6cd6d5-8e87-45bb-895d-addade7564b5" containerID="d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd" exitCode=0 Jul 06 15:08:56.553934 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.553935 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" Jul 06 15:08:56.554134 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.553971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" event={"ID":"cc6cd6d5-8e87-45bb-895d-addade7564b5","Type":"ContainerDied","Data":"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd"} Jul 06 15:08:56.554134 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.554007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv" event={"ID":"cc6cd6d5-8e87-45bb-895d-addade7564b5","Type":"ContainerDied","Data":"b58ad0e0b1133c8edbd71dfe4ecf41f267e70a38884ac2a45e670246fefa0f3c"} Jul 06 15:08:56.554134 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.554027 2581 scope.go:117] "RemoveContainer" containerID="d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd" Jul 06 15:08:56.563382 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.563365 2581 scope.go:117] "RemoveContainer" containerID="d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd" Jul 06 15:08:56.563641 ip-10-0-137-144 kubenswrapper[2581]: E0706 15:08:56.563622 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd\": container with ID starting with d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd not found: ID does not exist" containerID="d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd" Jul 06 15:08:56.563717 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.563665 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd"} err="failed to get container status \"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd\": rpc error: code = NotFound desc = could not find container \"d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd\": container with ID starting with d8ae351be2e4f98a9a39c50ad2e0781197a56b749cf0ebd249cf53f558b5f9bd not found: ID does not exist" Jul 06 15:08:56.577841 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.577817 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:08:56.586277 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:56.585947 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-296ba3/sub-test-model-296ba3-kserve-6c7f586845-g5jlv"] Jul 06 15:08:57.039048 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.038979 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" podUID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" containerName="main" containerID="cri-o://a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220" gracePeriod=45 Jul 06 15:08:57.297396 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.297340 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:57.332207 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332173 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332228 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332260 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332320 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332343 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332386 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332373 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdsmt\" (UniqueName: \"kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt\") pod \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\" (UID: \"dba3972b-5f5d-4599-b62b-88a6fe920f4d\") " Jul 06 15:08:57.332692 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332526 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home" (OuterVolumeSpecName: "home") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:57.332692 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332607 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:57.332692 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332572 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:57.332928 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332897 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tmp-dir\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.332928 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332928 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-model-cache\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.333116 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.332941 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-home\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.334436 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.334411 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm" (OuterVolumeSpecName: "dshm") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:08:57.334523 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.334433 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:08:57.334586 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.334565 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt" (OuterVolumeSpecName: "kube-api-access-kdsmt") pod "dba3972b-5f5d-4599-b62b-88a6fe920f4d" (UID: "dba3972b-5f5d-4599-b62b-88a6fe920f4d"). InnerVolumeSpecName "kube-api-access-kdsmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:08:57.433572 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.433533 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3972b-5f5d-4599-b62b-88a6fe920f4d-dshm\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.433572 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.433566 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3972b-5f5d-4599-b62b-88a6fe920f4d-tls-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.433874 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.433583 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdsmt\" (UniqueName: \"kubernetes.io/projected/dba3972b-5f5d-4599-b62b-88a6fe920f4d-kube-api-access-kdsmt\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:08:57.560238 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.560137 2581 generic.go:356] "Generic (PLEG): container finished" podID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" containerID="a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220" exitCode=0 Jul 06 15:08:57.560238 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.560172 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" Jul 06 15:08:57.560238 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.560217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" event={"ID":"dba3972b-5f5d-4599-b62b-88a6fe920f4d","Type":"ContainerDied","Data":"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220"} Jul 06 15:08:57.560531 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.560262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7" event={"ID":"dba3972b-5f5d-4599-b62b-88a6fe920f4d","Type":"ContainerDied","Data":"eaba438642d4d685d6ddabe0a8f68f45add8430dc9f3d93815bacc2a90c030e5"} Jul 06 15:08:57.560531 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.560287 2581 scope.go:117] "RemoveContainer" containerID="a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220" Jul 06 15:08:57.569561 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.569538 2581 scope.go:117] "RemoveContainer" containerID="a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220" Jul 06 15:08:57.569841 ip-10-0-137-144 kubenswrapper[2581]: E0706 15:08:57.569822 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220\": container with ID starting with a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220 not found: ID does not exist" containerID="a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220" Jul 06 15:08:57.569903 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.569852 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220"} err="failed to get container status \"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220\": rpc error: code = NotFound desc = could not find container \"a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220\": container with ID starting with a608ac78fca4ae36114dd9ff4a28f7a06dfc6ecdbd505a90e801729d1b406220 not found: ID does not exist" Jul 06 15:08:57.585409 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.585381 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:08:57.598847 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.598825 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/sub-test-model-c7737a-kserve-5749df9459-dkgr7"] Jul 06 15:08:57.628615 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.628594 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 15:08:57.633730 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:57.633708 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95lxd_8bbe21df-8a4f-4528-b8a9-8dd416cfc887/ovn-acl-logging/0.log" Jul 06 15:08:58.235817 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:58.235785 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6cd6d5-8e87-45bb-895d-addade7564b5" path="/var/lib/kubelet/pods/cc6cd6d5-8e87-45bb-895d-addade7564b5/volumes" Jul 06 15:08:58.236202 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:08:58.236189 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" path="/var/lib/kubelet/pods/dba3972b-5f5d-4599-b62b-88a6fe920f4d/volumes" Jul 06 15:09:20.783579 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:20.783498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:39.275152 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:39.275114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:39.475318 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:39.475262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:46.490407 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:46.490349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:47.557095 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:47.557044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:47.674893 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:47.674854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:48.136491 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136461 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:09:48.136882 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136867 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" containerName="main" Jul 06 15:09:48.136882 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136883 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" containerName="main" Jul 06 15:09:48.136983 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136900 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6cd6d5-8e87-45bb-895d-addade7564b5" containerName="main" Jul 06 15:09:48.136983 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136906 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6cd6d5-8e87-45bb-895d-addade7564b5" containerName="main" Jul 06 15:09:48.136983 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136960 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6cd6d5-8e87-45bb-895d-addade7564b5" containerName="main" Jul 06 15:09:48.136983 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.136971 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dba3972b-5f5d-4599-b62b-88a6fe920f4d" containerName="main" Jul 06 15:09:48.139997 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.139981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.144148 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.144120 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"rate-test-model-c7737a-kserve-self-signed-certs\"" Jul 06 15:09:48.144292 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.144150 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"default-dockercfg-bhdgz\"" Jul 06 15:09:48.144292 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.144161 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"openshift-service-ca.crt\"" Jul 06 15:09:48.144292 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.144166 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7737a\"/\"kube-root-ca.crt\"" Jul 06 15:09:48.150975 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.150953 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:09:48.210050 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.210248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.210248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.210248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.210248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4mn\" (UniqueName: \"kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.210248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.210215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.290304 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.290270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:48.310923 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.310900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311076 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.310941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311076 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.310965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311076 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.310982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311076 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.311020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4mn\" (UniqueName: \"kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311308 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.311085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311380 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.311356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311380 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.311375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.311643 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.311624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.313363 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.313342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.313590 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.313573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.322638 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.322614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4mn\" (UniqueName: \"kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn\") pod \"rate-test-model-c7737a-kserve-79b6845b7f-2tgxp\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.449707 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.449587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:48.594107 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.594081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:09:48.596698 ip-10-0-137-144 kubenswrapper[2581]: W0706 15:09:48.596668 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34cd69f3_6996_40a3_b05a_1eb86bddd6a2.slice/crio-06bc4ce334865c0e32f63be4b7519f3219a64a4a01cca9f4a5231b1c0d3f4c02 WatchSource:0}: Error finding container 06bc4ce334865c0e32f63be4b7519f3219a64a4a01cca9f4a5231b1c0d3f4c02: Status 404 returned error can't find the container with id 06bc4ce334865c0e32f63be4b7519f3219a64a4a01cca9f4a5231b1c0d3f4c02 Jul 06 15:09:48.822736 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.822626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" event={"ID":"34cd69f3-6996-40a3-b05a-1eb86bddd6a2","Type":"ContainerStarted","Data":"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35"} Jul 06 15:09:48.822736 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.822694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" event={"ID":"34cd69f3-6996-40a3-b05a-1eb86bddd6a2","Type":"ContainerStarted","Data":"06bc4ce334865c0e32f63be4b7519f3219a64a4a01cca9f4a5231b1c0d3f4c02"} Jul 06 15:09:48.847325 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:48.847264 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" podStartSLOduration=0.847248316 podStartE2EDuration="847.248316ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:09:48.84677629 +0000 UTC m=+2453.146963789" watchObservedRunningTime="2026-07-06 15:09:48.847248316 +0000 UTC m=+2453.147435800" Jul 06 15:09:50.446856 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:50.446823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:09:58.450715 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:58.450674 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:58.451121 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:58.450738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:58.463451 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:58.463415 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:09:58.881932 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:09:58.881904 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:10:27.757758 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:27.757698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:28.643476 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:28.643439 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:10:28.687910 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:28.687876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:29.914402 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:29.914366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:30.314967 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:30.314880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:30.501539 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:30.501510 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:30.607589 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:30.607502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:30.922399 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:30.922363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:35.371271 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:35.371239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:10:43.663138 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:43.663089 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" podUID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" containerName="main" containerID="cri-o://3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35" gracePeriod=45 Jul 06 15:10:43.910382 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:43.910357 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:10:44.052429 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052354 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052429 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052388 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052429 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052417 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052727 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052440 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z4mn\" (UniqueName: \"kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052727 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052466 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052727 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052578 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache\") pod \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\" (UID: \"34cd69f3-6996-40a3-b05a-1eb86bddd6a2\") " Jul 06 15:10:44.052727 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052690 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:10:44.052727 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home" (OuterVolumeSpecName: "home") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:10:44.052969 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052835 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:10:44.052969 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052948 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tmp-dir\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.053058 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052969 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-model-cache\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.053058 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.052983 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-home\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.054617 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.054588 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm" (OuterVolumeSpecName: "dshm") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:10:44.054617 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.054586 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:10:44.054788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.054719 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn" (OuterVolumeSpecName: "kube-api-access-6z4mn") pod "34cd69f3-6996-40a3-b05a-1eb86bddd6a2" (UID: "34cd69f3-6996-40a3-b05a-1eb86bddd6a2"). InnerVolumeSpecName "kube-api-access-6z4mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:10:44.091375 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.091337 2581 generic.go:356] "Generic (PLEG): container finished" podID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" containerID="3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35" exitCode=0 Jul 06 15:10:44.091565 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.091382 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" Jul 06 15:10:44.091565 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.091424 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" event={"ID":"34cd69f3-6996-40a3-b05a-1eb86bddd6a2","Type":"ContainerDied","Data":"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35"} Jul 06 15:10:44.091565 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.091463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp" event={"ID":"34cd69f3-6996-40a3-b05a-1eb86bddd6a2","Type":"ContainerDied","Data":"06bc4ce334865c0e32f63be4b7519f3219a64a4a01cca9f4a5231b1c0d3f4c02"} Jul 06 15:10:44.091565 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.091481 2581 scope.go:117] "RemoveContainer" containerID="3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35" Jul 06 15:10:44.100059 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.100043 2581 scope.go:117] "RemoveContainer" containerID="3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35" Jul 06 15:10:44.100329 ip-10-0-137-144 kubenswrapper[2581]: E0706 15:10:44.100311 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35\": container with ID starting with 3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35 not found: ID does not exist" containerID="3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35" Jul 06 15:10:44.100394 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.100341 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35"} err="failed to get container status \"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35\": rpc error: code = NotFound desc = could not find container \"3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35\": container with ID starting with 3dd23be267698c07a621fe9d75568a1edfb61e6acfb03eb75a6746a32e01af35 not found: ID does not exist" Jul 06 15:10:44.121444 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.121420 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:10:44.136267 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.136241 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7737a/rate-test-model-c7737a-kserve-79b6845b7f-2tgxp"] Jul 06 15:10:44.153780 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.153759 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-dshm\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.153780 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.153782 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z4mn\" (UniqueName: \"kubernetes.io/projected/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-kube-api-access-6z4mn\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.153927 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.153792 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34cd69f3-6996-40a3-b05a-1eb86bddd6a2-tls-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 06 15:10:44.235918 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:10:44.235890 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" path="/var/lib/kubelet/pods/34cd69f3-6996-40a3-b05a-1eb86bddd6a2/volumes" Jul 06 15:11:14.708169 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:14.708109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:15.122204 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:15.122119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:15.415703 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:15.415644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:15.701671 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:15.701580 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:16.139394 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:16.139350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:16.359788 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:16.359759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:16.464876 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:16.464788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:16.693209 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:16.693175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:24.882954 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:24.882922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:25.013381 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:25.013344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:25.172449 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:25.172355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:25.439929 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:25.439836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:25.915471 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:25.915437 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f848dd94-z2xcw_dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6/authorino/0.log" Jul 06 15:11:31.765891 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:31.765857 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5495664d98-sv7l8_bbc0c8c0-1457-4b09-959d-f68535f6a338/manager/0.log" Jul 06 15:11:32.417990 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:32.417959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-zfqxl_bd26b0f2-a57e-4732-bd08-8652a36673a0/copy-manifests/0.log" Jul 06 15:11:32.435115 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:32.435082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-zfqxl_bd26b0f2-a57e-4732-bd08-8652a36673a0/manager/0.log" Jul 06 15:11:33.941587 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:33.941560 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f848dd94-z2xcw_dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6/authorino/0.log" Jul 06 15:11:34.303618 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:34.303539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cpn5f_b8fd256a-ec2f-4068-9d56-2531ba59b936/kuadrant-console-plugin/0.log" Jul 06 15:11:34.849071 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:34.849044 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68cn5_59d9fd06-1634-4c92-b574-b482bca28310/manager/0.log" Jul 06 15:11:35.654050 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:35.654007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-gpt9f_5355a900-9e72-47d0-9109-7f9123fdd462/kube-auth-proxy/0.log" Jul 06 15:11:36.109970 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:36.109885 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mt677_0168301e-bbc8-412a-8655-93a7b50d46ec/payload-processing/0.log" Jul 06 15:11:36.802485 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:36.802458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7md64_9c91f421-105f-488c-8397-fd56efb28fa8/main/0.log" Jul 06 15:11:37.069927 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:37.069846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzbs9q_2d45e0e7-7f68-4c2e-99cb-d00e4f1ea48f/main/0.log" Jul 06 15:11:41.813757 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.813718 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2bspv/must-gather-r7fcr"] Jul 06 15:11:41.814163 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.814146 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" containerName="main" Jul 06 15:11:41.814212 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.814165 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" containerName="main" Jul 06 15:11:41.814247 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.814225 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cd69f3-6996-40a3-b05a-1eb86bddd6a2" containerName="main" Jul 06 15:11:41.817507 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.817490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.819832 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.819799 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:41.820528 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.820510 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2bspv\"/\"default-dockercfg-gn9kj\"" Jul 06 15:11:41.820983 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.820967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bspv\"/\"kube-root-ca.crt\"" Jul 06 15:11:41.821129 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.821107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bspv\"/\"openshift-service-ca.crt\"" Jul 06 15:11:41.838634 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.838604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/must-gather-r7fcr"] Jul 06 15:11:41.884582 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.884538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9302868c-ad47-4792-9909-4eb871e51fd0-must-gather-output\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.884582 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.884581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4986p\" (UniqueName: \"kubernetes.io/projected/9302868c-ad47-4792-9909-4eb871e51fd0-kube-api-access-4986p\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.937963 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.937929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" limit=1024 Jul 06 15:11:41.985268 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.985233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9302868c-ad47-4792-9909-4eb871e51fd0-must-gather-output\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.985268 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.985267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4986p\" (UniqueName: \"kubernetes.io/projected/9302868c-ad47-4792-9909-4eb871e51fd0-kube-api-access-4986p\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.985587 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.985567 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9302868c-ad47-4792-9909-4eb871e51fd0-must-gather-output\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:41.999267 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:41.999240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4986p\" (UniqueName: \"kubernetes.io/projected/9302868c-ad47-4792-9909-4eb871e51fd0-kube-api-access-4986p\") pod \"must-gather-r7fcr\" (UID: \"9302868c-ad47-4792-9909-4eb871e51fd0\") " pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:42.126845 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:42.126819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/must-gather-r7fcr" Jul 06 15:11:42.265251 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:42.265228 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/must-gather-r7fcr"] Jul 06 15:11:42.267124 ip-10-0-137-144 kubenswrapper[2581]: W0706 15:11:42.267098 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9302868c_ad47_4792_9909_4eb871e51fd0.slice/crio-bbd23923c8aff0c268ed7c5852b2a86381f4e727789afc1868f6335505065ed6 WatchSource:0}: Error finding container bbd23923c8aff0c268ed7c5852b2a86381f4e727789afc1868f6335505065ed6: Status 404 returned error can't find the container with id bbd23923c8aff0c268ed7c5852b2a86381f4e727789afc1868f6335505065ed6 Jul 06 15:11:42.269081 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:42.269060 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:11:42.360482 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:42.360442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/must-gather-r7fcr" event={"ID":"9302868c-ad47-4792-9909-4eb871e51fd0","Type":"ContainerStarted","Data":"bbd23923c8aff0c268ed7c5852b2a86381f4e727789afc1868f6335505065ed6"} Jul 06 15:11:43.370519 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:43.370415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/must-gather-r7fcr" event={"ID":"9302868c-ad47-4792-9909-4eb871e51fd0","Type":"ContainerStarted","Data":"c342c93e4556611083cccaef8c7094d2b309d4f70c84d22bcaba467b86032163"} Jul 06 15:11:43.370519 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:43.370475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/must-gather-r7fcr" event={"ID":"9302868c-ad47-4792-9909-4eb871e51fd0","Type":"ContainerStarted","Data":"6cdae66ddf8dd42d4cbf03a5ae25db3d9d16dd6424a8f78230eecfe19b5731ba"} Jul 06 15:11:43.391821 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:43.391768 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2bspv/must-gather-r7fcr" podStartSLOduration=1.6473983639999998 podStartE2EDuration="2.391749706s" totalImagesPullingTime="744.351342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:11:43.391472541 +0000 UTC m=+2567.691660027" watchObservedRunningTime="2026-07-06 15:11:43.391749706 +0000 UTC m=+2567.691937191" Jul 06 15:11:45.214264 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:45.214234 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vdvhc_5395e3ce-5645-456f-8298-229892d76a52/global-pull-secret-syncer/0.log" Jul 06 15:11:45.296839 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:45.296800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4lp6t_827bd3e9-156d-49cb-8697-fa703a1cb74b/konnectivity-agent/0.log" Jul 06 15:11:45.542129 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:45.542026 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-144.ec2.internal_a3daa949ad2399aa2ae00a9f45c827ee/haproxy/0.log" Jul 06 15:11:50.083723 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:50.082635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f848dd94-z2xcw_dd4d1a7a-cb3e-48b7-8e10-9d7883e445d6/authorino/0.log" Jul 06 15:11:50.264813 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:50.264776 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cpn5f_b8fd256a-ec2f-4068-9d56-2531ba59b936/kuadrant-console-plugin/0.log" Jul 06 15:11:50.724354 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:50.724287 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68cn5_59d9fd06-1634-4c92-b574-b482bca28310/manager/0.log" Jul 06 15:11:52.571412 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.571346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/alertmanager/0.log" Jul 06 15:11:52.604772 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.604713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/config-reloader/0.log" Jul 06 15:11:52.640264 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.640227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/kube-rbac-proxy-web/0.log" Jul 06 15:11:52.674687 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.674619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/kube-rbac-proxy/0.log" Jul 06 15:11:52.712702 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.712637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/kube-rbac-proxy-metric/0.log" Jul 06 15:11:52.749523 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.749491 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/prom-label-proxy/0.log" Jul 06 15:11:52.803157 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:52.803016 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e436541-d753-499e-bbbe-d46286913561/init-config-reloader/0.log" Jul 06 15:11:53.159158 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.159114 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f48dbcf85-p28kt_5c8cfaf5-1e3a-4e8c-b14a-595a9f15a3b7/metrics-server/0.log" Jul 06 15:11:53.610081 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.610008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9974g_9eede0d3-5762-4140-b296-3ee027e1a655/node-exporter/0.log" Jul 06 15:11:53.642254 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.642215 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9974g_9eede0d3-5762-4140-b296-3ee027e1a655/kube-rbac-proxy/0.log" Jul 06 15:11:53.678998 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.678964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9974g_9eede0d3-5762-4140-b296-3ee027e1a655/init-textfile/0.log" Jul 06 15:11:53.725036 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.725011 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rlhc_28a161e8-171b-467f-96ea-036f8803475d/kube-rbac-proxy-main/0.log" Jul 06 15:11:53.761113 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.761087 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rlhc_28a161e8-171b-467f-96ea-036f8803475d/kube-rbac-proxy-self/0.log" Jul 06 15:11:53.803136 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.803100 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rlhc_28a161e8-171b-467f-96ea-036f8803475d/openshift-state-metrics/0.log" Jul 06 15:11:53.844758 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.844727 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/prometheus/0.log" Jul 06 15:11:53.892063 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.892033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/config-reloader/0.log" Jul 06 15:11:53.925287 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.925259 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/thanos-sidecar/0.log" Jul 06 15:11:53.955821 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.955783 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/kube-rbac-proxy-web/0.log" Jul 06 15:11:53.985729 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:53.985700 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/kube-rbac-proxy/0.log" Jul 06 15:11:54.018423 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.018396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/kube-rbac-proxy-thanos/0.log" Jul 06 15:11:54.060897 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.060866 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0dd016cd-0b25-454a-9e76-682403d246df/init-config-reloader/0.log" Jul 06 15:11:54.252758 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.252677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lh55c_66f5fda4-29a7-4aae-8181-f00f6ee37713/prometheus-operator-admission-webhook/0.log" Jul 06 15:11:54.426943 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.426910 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/thanos-query/0.log" Jul 06 15:11:54.457057 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.457029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/kube-rbac-proxy-web/0.log" Jul 06 15:11:54.483940 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.483904 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/kube-rbac-proxy/0.log" Jul 06 15:11:54.516209 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.516133 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/prom-label-proxy/0.log" Jul 06 15:11:54.551130 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.551103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/kube-rbac-proxy-rules/0.log" Jul 06 15:11:54.583366 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.583341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb6c8bcd5-9ft8v_06daf0d3-1a77-40cd-bbb3-986926ae8312/kube-rbac-proxy-metrics/0.log" Jul 06 15:11:54.957281 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.957247 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb"] Jul 06 15:11:54.961847 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.961820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:54.975786 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:54.975759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb"] Jul 06 15:11:55.030165 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.030126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-lib-modules\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.030552 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.030529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-podres\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.030738 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.030718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfsw\" (UniqueName: \"kubernetes.io/projected/248410da-919e-492b-b29a-4ef5434fd04b-kube-api-access-2pfsw\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.030876 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.030862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-sys\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.031010 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.030995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-proc\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131697 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-lib-modules\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131904 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-podres\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131904 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfsw\" (UniqueName: \"kubernetes.io/projected/248410da-919e-492b-b29a-4ef5434fd04b-kube-api-access-2pfsw\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131904 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-lib-modules\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131904 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-sys\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.131904 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131889 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-sys\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.132267 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-proc\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.132267 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.131951 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-podres\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.132267 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.132006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248410da-919e-492b-b29a-4ef5434fd04b-proc\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.143248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.143217 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfsw\" (UniqueName: \"kubernetes.io/projected/248410da-919e-492b-b29a-4ef5434fd04b-kube-api-access-2pfsw\") pod \"perf-node-gather-daemonset-6qvlb\" (UID: \"248410da-919e-492b-b29a-4ef5434fd04b\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.274926 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.274831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:55.448293 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:55.448263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb"] Jul 06 15:11:55.450111 ip-10-0-137-144 kubenswrapper[2581]: W0706 15:11:55.450083 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod248410da_919e_492b_b29a_4ef5434fd04b.slice/crio-b49bdfc869e20759e9dd5eb40c17c0b80462722bcd25f5079d84b543e694c176 WatchSource:0}: Error finding container b49bdfc869e20759e9dd5eb40c17c0b80462722bcd25f5079d84b543e694c176: Status 404 returned error can't find the container with id b49bdfc869e20759e9dd5eb40c17c0b80462722bcd25f5079d84b543e694c176 Jul 06 15:11:56.464118 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:56.464069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" event={"ID":"248410da-919e-492b-b29a-4ef5434fd04b","Type":"ContainerStarted","Data":"f9d6f43531ac856a5002de95ecabde1ce2cd27f7ca6d72aebfa8381e2538c24b"} Jul 06 15:11:56.464614 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:56.464145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" event={"ID":"248410da-919e-492b-b29a-4ef5434fd04b","Type":"ContainerStarted","Data":"b49bdfc869e20759e9dd5eb40c17c0b80462722bcd25f5079d84b543e694c176"} Jul 06 15:11:56.464614 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:56.464206 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:11:56.491226 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:56.491151 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" podStartSLOduration=2.491129596 podStartE2EDuration="2.491129596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:11:56.488427296 +0000 UTC m=+2580.788614781" watchObservedRunningTime="2026-07-06 15:11:56.491129596 +0000 UTC m=+2580.791317082" Jul 06 15:11:59.303013 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:59.302977 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jdjr_0ef23d22-448f-4291-b06e-9c22be457e5d/dns/0.log" Jul 06 15:11:59.343902 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:59.343870 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jdjr_0ef23d22-448f-4291-b06e-9c22be457e5d/kube-rbac-proxy/0.log" Jul 06 15:11:59.565741 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:11:59.565641 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsx8l_88a4da98-5148-4c51-a7b9-d6bc71aec658/dns-node-resolver/0.log" Jul 06 15:12:00.269111 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:00.269061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-566479bb5b-mgm88_fe31bf8e-6df3-43f0-a698-7d6d1e8b9cf3/registry/0.log" Jul 06 15:12:00.331248 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:00.331223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9l98g_d962d31d-9269-4268-a2e6-b618f4f26883/node-ca/0.log" Jul 06 15:12:01.793895 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:01.793862 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-gpt9f_5355a900-9e72-47d0-9109-7f9123fdd462/kube-auth-proxy/0.log" Jul 06 15:12:02.008568 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:02.008526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mt677_0168301e-bbc8-412a-8655-93a7b50d46ec/payload-processing/0.log" Jul 06 15:12:02.481896 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:02.481866 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-6qvlb" Jul 06 15:12:02.861855 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:02.861769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dd5tz_00ff471b-c123-4f21-85b9-8b52b3cd7c79/serve-healthcheck-canary/0.log" Jul 06 15:12:03.676845 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:03.676818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zdpv_a93ecaea-03b0-447c-8a84-e1055d1875ff/kube-rbac-proxy/0.log" Jul 06 15:12:03.712632 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:03.712606 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zdpv_a93ecaea-03b0-447c-8a84-e1055d1875ff/exporter/0.log" Jul 06 15:12:03.742340 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:03.742299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8zdpv_a93ecaea-03b0-447c-8a84-e1055d1875ff/extractor/0.log" Jul 06 15:12:05.235059 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:05.235031 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-gpt9f_5355a900-9e72-47d0-9109-7f9123fdd462/kube-auth-proxy/0.log" Jul 06 15:12:05.402515 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:05.402484 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mt677_0168301e-bbc8-412a-8655-93a7b50d46ec/payload-processing/0.log" Jul 06 15:12:06.887378 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:06.887344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-gpt9f_5355a900-9e72-47d0-9109-7f9123fdd462/kube-auth-proxy/0.log" Jul 06 15:12:07.223335 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:07.223254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mt677_0168301e-bbc8-412a-8655-93a7b50d46ec/payload-processing/0.log" Jul 06 15:12:07.467239 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:07.467211 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5495664d98-sv7l8_bbc0c8c0-1457-4b09-959d-f68535f6a338/manager/0.log" Jul 06 15:12:07.894634 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:07.894595 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-zfqxl_bd26b0f2-a57e-4732-bd08-8652a36673a0/manager/0.log" Jul 06 15:12:07.921347 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:07.921320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-zfqxl_bd26b0f2-a57e-4732-bd08-8652a36673a0/copy-manifests/0.log" Jul 06 15:12:09.331414 ip-10-0-137-144 kubenswrapper[2581]: I0706 15:12:09.331387 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6689bc4cf6-cm8mt_3e08054e-0caf-4664-97ad-9753832c21c0/manager/0.log"