Sep 09 22:57:14.596118 ip-10-0-142-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 22:57:14.596133 ip-10-0-142-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 22:57:14.596142 ip-10-0-142-25 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 22:57:14.596329 ip-10-0-142-25 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 22:57:24.798121 ip-10-0-142-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 22:57:24.798143 ip-10-0-142-25 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cc4638fd3fb742fabcddacf498ebab00 -- Sep 09 22:59:18.899647 ip-10-0-142-25 systemd[1]: Starting Kubernetes Kubelet... Sep 09 22:59:19.252546 ip-10-0-142-25 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 22:59:19.252546 ip-10-0-142-25 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 22:59:19.252546 ip-10-0-142-25 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 22:59:19.252546 ip-10-0-142-25 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 22:59:19.252546 ip-10-0-142-25 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 22:59:19.253390 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.253294 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 22:59:19.256700 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256684 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.256700 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256700 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256705 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256708 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256711 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256714 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256717 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256719 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256722 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256725 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256727 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256730 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256732 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256735 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256738 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256740 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256743 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256746 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256748 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256751 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256753 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.256765 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256756 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256758 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256761 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256764 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256766 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256769 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256774 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256778 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256781 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256784 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256786 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256789 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256792 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256794 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256798 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256801 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256804 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256807 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256810 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.257235 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256812 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256815 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256818 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256821 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256823 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256826 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256828 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256831 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256834 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256836 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256839 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256841 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256844 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256846 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256849 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256852 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256855 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256857 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256860 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256862 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.257704 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256865 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256867 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256871 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256875 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256877 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256880 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256882 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256885 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256887 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256890 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256892 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256896 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256899 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256901 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256903 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256912 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256915 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256918 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256920 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256923 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.258194 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256925 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256927 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256930 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256932 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256935 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256938 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256941 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256944 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256947 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256950 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256952 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256955 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256957 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256960 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256963 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256965 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256968 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256971 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.256973 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257658 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.258733 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257664 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257667 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257670 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257672 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257675 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257678 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257680 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257683 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257686 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257689 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257691 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257694 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257696 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257698 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257701 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257703 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257706 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257710 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257712 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257715 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.259213 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257720 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257724 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257727 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257731 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257735 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257738 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257742 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257752 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257756 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257759 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257761 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257764 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257767 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257770 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257772 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257775 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257778 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257781 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257784 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.259724 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257786 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257789 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257792 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257795 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257797 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257800 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257802 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257804 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257808 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257810 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257813 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257816 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257818 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257821 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257823 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257826 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257828 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257831 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257833 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257836 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.260296 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257838 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257840 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257843 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257846 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257848 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257851 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257853 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257856 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257858 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257860 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257863 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257865 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257868 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257870 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257873 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257875 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257878 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257880 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257883 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257885 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.260802 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257887 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257890 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257893 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257896 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257899 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257901 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257904 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257906 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257909 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257911 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257914 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257916 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257918 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257921 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257923 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257926 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257928 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257931 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.257933 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258297 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.261301 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258302 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258304 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258308 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258310 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258313 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258315 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258318 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258328 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258330 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258348 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258351 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258354 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258356 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258359 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258363 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258365 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258368 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258371 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258374 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258376 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.261806 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258379 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258382 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258385 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258387 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258390 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258392 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258395 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258397 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258400 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258403 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258405 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258408 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258410 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258413 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258415 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258418 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258420 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258423 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258425 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.262300 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258427 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258430 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258433 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258435 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258438 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258442 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258447 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258451 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258455 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258458 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258461 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258464 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258466 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258469 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258471 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258474 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258476 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258479 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258481 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.262780 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258484 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258486 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258488 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258491 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258493 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258495 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258498 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258501 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258503 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258506 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258508 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258510 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258513 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258515 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258518 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258521 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258524 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258526 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258529 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258531 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.263299 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258534 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258537 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258541 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258545 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258547 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258550 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258552 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258555 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258558 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258560 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258563 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258565 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258567 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258570 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258572 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258575 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258577 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258580 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258582 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.258585 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.263807 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258662 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258694 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258702 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258709 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258713 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258717 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258721 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258725 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258728 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258731 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258735 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258739 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258742 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258745 2561 flags.go:64] FLAG: --cgroup-root="" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258748 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258751 2561 flags.go:64] FLAG: --client-ca-file="" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258754 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258757 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258761 2561 flags.go:64] FLAG: --cluster-domain="" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258764 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258767 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258770 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258773 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258777 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 22:59:19.264279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258779 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258782 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258785 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258788 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258791 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258794 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258797 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258800 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258804 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258807 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258810 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258814 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258817 2561 flags.go:64] FLAG: --enable-server="true" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258820 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258825 2561 flags.go:64] FLAG: --event-burst="100" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258828 2561 flags.go:64] FLAG: --event-qps="50" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258831 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258834 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258837 2561 flags.go:64] FLAG: --eviction-hard="" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258840 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258845 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258848 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258851 2561 flags.go:64] FLAG: --eviction-soft="" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258854 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258857 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 22:59:19.264867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258860 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258863 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258865 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258868 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258871 2561 flags.go:64] FLAG: --feature-gates="" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258874 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258877 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258880 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258884 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258887 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258889 2561 flags.go:64] FLAG: --help="false" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258892 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258895 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258898 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258900 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258904 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258907 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258910 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258913 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258916 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258919 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258922 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258925 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258927 2561 flags.go:64] FLAG: --kube-reserved="" Sep 09 22:59:19.265512 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258930 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258935 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258938 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258942 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258945 2561 flags.go:64] FLAG: --lock-file="" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258947 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258950 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258953 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258958 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258961 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258964 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258967 2561 flags.go:64] FLAG: --logging-format="text" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258969 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258972 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258975 2561 flags.go:64] FLAG: --manifest-url="" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258978 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258982 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258986 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258989 2561 flags.go:64] FLAG: --max-pods="110" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258992 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258995 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.258998 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259001 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259004 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259007 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 22:59:19.266109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259009 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259018 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259021 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259024 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259027 2561 flags.go:64] FLAG: --pod-cidr="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259029 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259035 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259038 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259041 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259045 2561 flags.go:64] FLAG: --port="10250" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259049 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259052 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d95712879023eaab" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259055 2561 flags.go:64] FLAG: --qos-reserved="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259058 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259060 2561 flags.go:64] FLAG: --register-node="true" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259063 2561 flags.go:64] FLAG: --register-with-taints="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259067 2561 flags.go:64] FLAG: --registry-burst="10" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259070 2561 flags.go:64] FLAG: --registry-qps="5" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259072 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259075 2561 flags.go:64] FLAG: --reserved-memory="" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259081 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259084 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259087 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259089 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259092 2561 flags.go:64] FLAG: --runonce="false" Sep 09 22:59:19.266740 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259095 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259098 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259101 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259103 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259106 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259109 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259112 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259115 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259118 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259122 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259125 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259127 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259131 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259133 2561 flags.go:64] FLAG: --system-cgroups="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259136 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259142 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259144 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259149 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259153 2561 flags.go:64] FLAG: --tls-min-version="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259156 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259158 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259161 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259164 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259167 2561 flags.go:64] FLAG: --v="2" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259171 2561 flags.go:64] FLAG: --version="false" Sep 09 22:59:19.267383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259174 2561 flags.go:64] FLAG: --vmodule="" Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259178 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.259181 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259319 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259325 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259328 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259331 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259347 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259350 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259353 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259356 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259359 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259362 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259364 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259367 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259369 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259373 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259375 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259378 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259380 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.268009 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259383 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259386 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259388 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259390 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259395 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259398 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259401 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259403 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259406 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259408 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259411 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259413 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259416 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259419 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259421 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259424 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259426 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259428 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259431 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259433 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.268524 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259435 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259438 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259440 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259444 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259447 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259450 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259453 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259455 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259458 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259461 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259463 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259466 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259468 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259471 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259473 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259476 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259479 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259482 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259485 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.269012 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259487 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259490 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259492 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259495 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259497 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259499 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259502 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259504 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259507 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259509 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259512 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259514 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259516 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259519 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259521 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259523 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259526 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259529 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259531 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.269504 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259534 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259536 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259539 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259541 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259543 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259546 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259548 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259552 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259555 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259558 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259563 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259565 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259568 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259571 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259574 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259577 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259579 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259582 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259585 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.269984 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259588 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259590 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259593 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259595 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.259598 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.260093 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.267041 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.267055 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.267656 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.267664 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267728 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267734 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267737 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267739 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267742 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.270526 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267745 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267748 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267751 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267754 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267756 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267759 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267761 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267764 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267767 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267769 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267773 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267783 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267786 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267790 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267793 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267796 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267799 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267802 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267804 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.270909 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267807 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267810 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267812 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267815 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267817 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267820 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267823 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267826 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267828 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267831 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267834 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267836 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267839 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267841 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267844 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267846 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267849 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267852 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267854 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267857 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.271392 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267859 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267862 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267879 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267882 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267885 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267896 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267900 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267902 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267905 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267907 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267910 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267912 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267914 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267917 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267919 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267922 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267924 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267927 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267930 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.271891 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267932 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267935 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267937 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267940 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267942 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267945 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267947 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267950 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267952 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267955 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267957 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267959 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267962 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267964 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267967 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267969 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267972 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267974 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267976 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267984 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267987 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.272363 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267989 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267992 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267994 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267997 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.267999 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268001 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268004 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268006 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268009 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268012 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268014 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268017 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268020 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268022 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268025 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.272873 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.268030 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268178 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268182 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268185 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268188 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268191 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268193 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268196 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268198 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268201 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268203 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268207 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268210 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268213 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268216 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268218 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268226 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268229 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268232 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268234 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 22:59:19.273246 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268237 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268240 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268242 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268245 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268247 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268249 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268252 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268255 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268257 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268259 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268262 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268264 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268267 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268269 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268272 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268274 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268277 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268279 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268281 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 22:59:19.273756 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268284 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268286 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268288 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268291 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268293 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268295 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268298 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268300 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268303 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268306 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268315 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268319 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268323 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268326 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268328 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268331 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268351 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268355 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268358 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 22:59:19.274227 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268360 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268363 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268365 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268368 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268370 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268373 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268375 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268378 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268381 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268383 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268385 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268388 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268390 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268393 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268395 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268397 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268400 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268402 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268404 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268407 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 22:59:19.274701 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268409 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268412 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268414 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268416 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268425 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268428 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268430 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268433 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268435 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268437 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268440 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268442 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268445 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268447 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268450 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268452 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268455 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268457 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268460 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 22:59:19.275176 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268462 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268465 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:19.268467 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.268472 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.268581 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.270486 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.271279 2561 server.go:1019] "Starting client certificate rotation" Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.271395 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.271439 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 22:59:19.275652 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.273870 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 22:59:19.280600 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.280579 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 22:59:19.290694 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.290671 2561 log.go:25] "Validated CRI v1 runtime API" Sep 09 22:59:19.293323 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.293304 2561 log.go:25] "Validated CRI v1 image API" Sep 09 22:59:19.294210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.294189 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 22:59:19.296425 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.296406 2561 fs.go:135] Filesystem UUIDs: map[4b030bda-731a-4161-80af-346c49aed9ab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8542d69e-3306-4f8c-9f46-1b50873a1888:/dev/nvme0n1p3] Sep 09 22:59:19.296486 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.296425 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 22:59:19.301709 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.301596 2561 manager.go:216] Machine: {Timestamp:2026-09-09 22:59:19.300528178 +0000 UTC m=+0.293919902 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100187 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29b61782c4f0d30367153f80ac08ab SystemUUID:ec29b617-82c4-f0d3-0367-153f80ac08ab BootID:cc4638fd-3fb7-42fa-bcdd-acf498ebab00 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:fd:18:84:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:fd:18:84:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:29:06:af:ac:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 22:59:19.301709 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.301707 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 22:59:19.301836 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.301824 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 22:59:19.302553 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.302536 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 22:59:19.304418 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.304396 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 22:59:19.304564 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.304422 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 22:59:19.305013 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.305003 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 22:59:19.305042 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.305016 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 22:59:19.305042 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.305023 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 22:59:19.305710 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.305700 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 22:59:19.306332 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.306322 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 22:59:19.308657 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308647 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 22:59:19.308771 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308762 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 22:59:19.308804 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308792 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 09 22:59:19.308804 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308803 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 22:59:19.308854 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308813 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 22:59:19.308854 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308823 2561 kubelet.go:398] "Adding apiserver pod source" Sep 09 22:59:19.308854 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.308831 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 22:59:19.309208 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.309196 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 22:59:19.309263 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.309220 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 22:59:19.311030 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.311014 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 22:59:19.313451 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.313427 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 22:59:19.313550 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.313476 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 22:59:19.315260 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315245 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315269 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315278 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315286 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315298 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315307 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 22:59:19.315327 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315325 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 22:59:19.315519 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315348 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 22:59:19.315519 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315359 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 22:59:19.315519 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315366 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 22:59:19.315519 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315374 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 22:59:19.315519 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315379 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 22:59:19.315934 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315925 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 22:59:19.315965 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.315935 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 22:59:19.318728 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.318711 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 22:59:19.319000 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.318978 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 22:59:19.319048 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.319000 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 22:59:19.320020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.320008 2561 server.go:1268] "Started kubelet" Sep 09 22:59:19.320088 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.320059 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 22:59:19.320135 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.320076 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 22:59:19.320187 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.320172 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 22:59:19.320847 ip-10-0-142-25 systemd[1]: Started Kubernetes Kubelet. Sep 09 22:59:19.321206 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.321135 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 09 22:59:19.324017 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.324001 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 22:59:19.324690 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.324672 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 22:59:19.325608 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.324583 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-25.ec2.internal.18d3c9414e4d8c6c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-25.ec2.internal,UID:ip-10-0-142-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-25.ec2.internal,},FirstTimestamp:2026-09-09 22:59:19.319981164 +0000 UTC m=+0.313372897,LastTimestamp:2026-09-09 22:59:19.319981164 +0000 UTC m=+0.313372897,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-25.ec2.internal,}" Sep 09 22:59:19.327065 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.327051 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 22:59:19.327490 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.327461 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 22:59:19.327590 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.327563 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.328054 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328039 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 22:59:19.328054 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328039 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 22:59:19.328201 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328064 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 22:59:19.328201 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328133 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 09 22:59:19.328201 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328143 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 09 22:59:19.328419 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328400 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-td6qf" Sep 09 22:59:19.328521 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328504 2561 factory.go:55] Registering systemd factory Sep 09 22:59:19.328521 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328521 2561 factory.go:223] Registration of the systemd container factory successfully Sep 09 22:59:19.328736 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328726 2561 factory.go:153] Registering CRI-O factory Sep 09 22:59:19.328736 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328737 2561 factory.go:223] Registration of the crio container factory successfully Sep 09 22:59:19.328809 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328777 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 22:59:19.328809 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328789 2561 factory.go:103] Registering Raw factory Sep 09 22:59:19.328809 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.328802 2561 manager.go:1196] Started watching for new ooms in manager Sep 09 22:59:19.329153 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.329140 2561 manager.go:349] Starting recovery of all containers Sep 09 22:59:19.329850 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.329830 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 22:59:19.329956 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.329940 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 22:59:19.338837 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.338130 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-td6qf" Sep 09 22:59:19.343932 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.343913 2561 manager.go:354] Recovery completed Sep 09 22:59:19.345239 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.345213 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 09 22:59:19.348151 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.348139 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.351690 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.351670 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.351771 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.351704 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.351771 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.351721 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.352312 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.352291 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 22:59:19.352312 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.352307 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 22:59:19.352439 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.352322 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 22:59:19.352439 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.352348 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.353033 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353018 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.353071 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353048 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.353071 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353063 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.353535 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353523 2561 policy_none.go:49] "None policy: Start" Sep 09 22:59:19.353579 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353540 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 22:59:19.353579 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.353549 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 22:59:19.354424 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.354413 2561 policy_none.go:47] "Start" Sep 09 22:59:19.403962 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.403944 2561 manager.go:337] "Starting Device Plugin manager" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.403984 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.403998 2561 server.go:87] "Starting device plugin registration server" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.404303 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.404317 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.404452 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.404524 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.404533 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.405029 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 22:59:19.414524 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.405081 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.484819 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.484780 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 22:59:19.486170 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.486150 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 22:59:19.486281 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.486216 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 22:59:19.486281 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.486245 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 22:59:19.486384 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.486296 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 22:59:19.488097 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.488078 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 22:59:19.505459 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.505375 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.506302 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.506286 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.506388 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.506315 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.506388 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.506325 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.506388 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.506362 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.513744 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.513722 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.513841 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.513749 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-25.ec2.internal\": node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.522547 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.522526 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.586777 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.586727 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal"] Sep 09 22:59:19.586896 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.586843 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.587892 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.587875 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.588001 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.587906 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.588001 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.587915 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.590197 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590185 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.590320 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.590379 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590352 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.590925 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590906 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.591050 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590935 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.591050 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.590946 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.591050 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.591016 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.591050 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.591051 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.591184 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.591061 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.593146 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.593132 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.593210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.593167 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 22:59:19.593944 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.593927 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientMemory" Sep 09 22:59:19.594024 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.593953 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 22:59:19.594024 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.593965 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeHasSufficientPID" Sep 09 22:59:19.613947 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.613922 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-25.ec2.internal\" not found" node="ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.619259 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.619241 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-25.ec2.internal\" not found" node="ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.623447 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.623431 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.630860 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.630841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.630951 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.630871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa185125bed916a8592295deab1ac091-config\") pod \"kube-apiserver-proxy-ip-10-0-142-25.ec2.internal\" (UID: \"fa185125bed916a8592295deab1ac091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.630951 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.630893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.723718 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.723669 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.731031 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.731150 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.731150 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa185125bed916a8592295deab1ac091-config\") pod \"kube-apiserver-proxy-ip-10-0-142-25.ec2.internal\" (UID: \"fa185125bed916a8592295deab1ac091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.731150 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa185125bed916a8592295deab1ac091-config\") pod \"kube-apiserver-proxy-ip-10-0-142-25.ec2.internal\" (UID: \"fa185125bed916a8592295deab1ac091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.731150 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731130 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.731286 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.731135 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b72c9e094581ed7edd63ec499ba83450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal\" (UID: \"b72c9e094581ed7edd63ec499ba83450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.824564 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.824482 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:19.915993 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.915957 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.922158 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:19.921913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:19.925024 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:19.925006 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.025330 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:20.025291 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.125835 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:20.125763 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.226429 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:20.226397 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.270794 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.270766 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 22:59:20.271261 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.270931 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 22:59:20.326579 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:20.326555 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.345738 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.345707 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 22:54:20 +0000 UTC" deadline="2028-02-22 11:05:23.703350077 +0000 UTC" Sep 09 22:59:20.345738 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.345733 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12732h6m3.357619587s" Sep 09 22:59:20.427231 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:20.427023 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-25.ec2.internal\" not found" Sep 09 22:59:20.440550 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.440526 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 22:59:20.490486 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:20.490440 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa185125bed916a8592295deab1ac091.slice/crio-849dbf3819a2be737f2979812bd669841e3c5f42dce1ceb0b9d025ac7ec6888c WatchSource:0}: Error finding container 849dbf3819a2be737f2979812bd669841e3c5f42dce1ceb0b9d025ac7ec6888c: Status 404 returned error can't find the container with id 849dbf3819a2be737f2979812bd669841e3c5f42dce1ceb0b9d025ac7ec6888c Sep 09 22:59:20.491298 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:20.491266 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72c9e094581ed7edd63ec499ba83450.slice/crio-ea3c31834b887eb87683fb74b621ea84a394efdba6fbe2a88f9ca9edb17a0bee WatchSource:0}: Error finding container ea3c31834b887eb87683fb74b621ea84a394efdba6fbe2a88f9ca9edb17a0bee: Status 404 returned error can't find the container with id ea3c31834b887eb87683fb74b621ea84a394efdba6fbe2a88f9ca9edb17a0bee Sep 09 22:59:20.495390 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.495373 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 22:59:20.528202 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.528168 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" Sep 09 22:59:20.538720 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.538698 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 22:59:20.539995 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.539975 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" Sep 09 22:59:20.546565 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.546551 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 22:59:20.553111 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:20.553089 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 22:59:22.317746 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.317719 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 22:59:22.745100 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.745013 2561 apiserver.go:52] "Watching apiserver" Sep 09 22:59:22.754813 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.754790 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 22:59:22.755688 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.755664 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx","openshift-image-registry/node-ca-nzkxv","openshift-multus/multus-additional-cni-plugins-zbx29","openshift-network-diagnostics/network-check-target-j65hg","openshift-network-operator/iptables-alerter-lmzzv","openshift-ovn-kubernetes/ovnkube-node-ftz28","kube-system/global-pull-secret-syncer-dmv9g","kube-system/konnectivity-agent-6q5q8","kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal","openshift-cluster-node-tuning-operator/tuned-p9s55","openshift-dns/node-resolver-lpmns","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal","openshift-multus/multus-8c244","openshift-multus/network-metrics-daemon-n6mk7"] Sep 09 22:59:22.758147 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.758127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.760236 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.760218 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.761011 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.760796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.761011 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.760844 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.761011 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.760928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h25jx\"" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.762930 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.762946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.763027 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.763337 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.763372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7gnqk\"" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.763596 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.763960 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.763670 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 22:59:22.765120 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.765100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:22.765196 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.765168 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:22.767142 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.766988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.769459 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.769427 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.769739 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.769720 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 22:59:22.769819 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.769788 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5w6nn\"" Sep 09 22:59:22.769819 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.769801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.769923 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.769895 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.772034 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.772016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8c244" Sep 09 22:59:22.773691 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 22:59:22.773768 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-run\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.773768 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wnj\" (UniqueName: \"kubernetes.io/projected/372ef220-706c-4c53-8249-ee2943d587ac-kube-api-access-t8wnj\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.773838 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4dcg\" (UniqueName: \"kubernetes.io/projected/f7353398-c9d2-4d2a-9af8-ed0922fd0449-kube-api-access-m4dcg\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.773838 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-modprobe-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.773899 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-var-lib-kubelet\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.773899 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773855 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zrrrc\"" Sep 09 22:59:22.773953 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-host\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.773985 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-tmp\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774030 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:22.774030 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysconfig\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774030 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-systemd\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774161 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-sys\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774161 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-lib-modules\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774257 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-tuned\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774257 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf58c\" (UniqueName: \"kubernetes.io/projected/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-kube-api-access-cf58c\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774257 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/372ef220-706c-4c53-8249-ee2943d587ac-serviceca\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.774257 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-kubernetes\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774440 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774440 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.774440 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.773855 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 22:59:22.774440 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-conf\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.774643 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/372ef220-706c-4c53-8249-ee2943d587ac-host\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.774643 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.774832 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774813 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 22:59:22.774923 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.774905 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.775226 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.775209 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 22:59:22.775276 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.775257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.775374 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.775329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:22.776306 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.776286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 22:59:22.776563 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.776546 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.776675 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.776655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 22:59:22.776810 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.776793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.778015 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.777277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.778170 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.778151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l7h7r\"" Sep 09 22:59:22.779555 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.779534 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 22:59:22.780298 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.780279 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.780978 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.780954 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nb5rh\"" Sep 09 22:59:22.781122 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.781108 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.781247 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.781232 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 22:59:22.781543 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.781527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.782889 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.782861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.783868 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.783851 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 22:59:22.784076 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.784060 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 22:59:22.784281 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.784266 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dt8l4\"" Sep 09 22:59:22.785290 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.785273 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 22:59:22.785766 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.785467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.785766 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.785603 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lp6zf\"" Sep 09 22:59:22.785893 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.785837 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 22:59:22.787793 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.787774 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vpwzc\"" Sep 09 22:59:22.787982 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.787963 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 22:59:22.788092 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.788074 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 22:59:22.798702 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.798686 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xhndd" Sep 09 22:59:22.805462 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.805432 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xhndd" Sep 09 22:59:22.864644 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.864620 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 22:59:22.874742 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-config\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.874851 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-socket-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.874851 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.874851 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-tmp\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-env-overrides\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-etc-selinux\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysconfig\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf58c\" (UniqueName: \"kubernetes.io/projected/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-kube-api-access-cf58c\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-systemd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875020 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.874996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-conf-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b6921d2-7735-4dd7-b586-048fcbeae660-ovn-node-metrics-cert\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-kubelet-config\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r7ff\" (UniqueName: \"kubernetes.io/projected/851add08-645a-45b9-9553-b36fd38c8f54-kube-api-access-4r7ff\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hqc\" (UniqueName: \"kubernetes.io/projected/a6c36a55-39eb-44b1-be70-e5b0772f2af0-kube-api-access-n2hqc\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-etc-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-node-log\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5gf\" (UniqueName: \"kubernetes.io/projected/6f689789-a67d-469f-adf1-7acb21823a55-kube-api-access-xb5gf\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875301 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-sys-fs\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-multus\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-etc-kubernetes\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7ff2\" (UniqueName: \"kubernetes.io/projected/5ecffe0f-bc84-4287-aec4-92c4992e1f14-kube-api-access-l7ff2\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-sys\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-netns\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-log-socket\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-cnibin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-registration-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjft\" (UniqueName: \"kubernetes.io/projected/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kube-api-access-wgjft\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851add08-645a-45b9-9553-b36fd38c8f54-host-slash\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-kubernetes\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.875816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-var-lib-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e02aebf-0377-49f8-a453-643ea03b59bd-konnectivity-ca\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.875966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-run\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wnj\" (UniqueName: \"kubernetes.io/projected/372ef220-706c-4c53-8249-ee2943d587ac-kube-api-access-t8wnj\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-ovn\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-system-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-sys\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-socket-dir-parent\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-modprobe-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-var-lib-kubelet\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-systemd\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/372ef220-706c-4c53-8249-ee2943d587ac-serviceca\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-script-lib\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-bin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876331 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-kubernetes\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.876498 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e02aebf-0377-49f8-a453-643ea03b59bd-agent-certs\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-system-cni-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-conf\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876428 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/372ef220-706c-4c53-8249-ee2943d587ac-host\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-dbus\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ecffe0f-bc84-4287-aec4-92c4992e1f14-tmp-dir\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4dcg\" (UniqueName: \"kubernetes.io/projected/f7353398-c9d2-4d2a-9af8-ed0922fd0449-kube-api-access-m4dcg\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-device-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851add08-645a-45b9-9553-b36fd38c8f54-iptables-alerter-script\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ecffe0f-bc84-4287-aec4-92c4992e1f14-hosts-file\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-host\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-multus-certs\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-lib-modules\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-tuned\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.877367 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876888 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysconfig\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877013 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-run\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877143 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.876884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-bin\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-netd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cmjm\" (UniqueName: \"kubernetes.io/projected/7b6921d2-7735-4dd7-b586-048fcbeae660-kube-api-access-5cmjm\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-cni-binary-copy\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-k8s-cni-cncf-io\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-hostroot\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-multus-daemon-config\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.877617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-netns\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-kubelet\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/372ef220-706c-4c53-8249-ee2943d587ac-host\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cnibin\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.878210 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-host\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878239 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-systemd\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-kubelet\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878191 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-var-lib-kubelet\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878260 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-modprobe-d\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-lib-modules\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878330 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-sysctl-conf\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-systemd-units\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-slash\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.878505 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.878622 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:23.378594117 +0000 UTC m=+2.936752088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:22.878933 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.878776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/372ef220-706c-4c53-8249-ee2943d587ac-serviceca\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.882850 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.882808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-tmp\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.883056 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.883026 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-etc-tuned\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.883542 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.883522 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:22.883658 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.883618 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:22.883658 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.883635 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:22.883778 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.883737 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:23.383721733 +0000 UTC m=+2.941879711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:22.885596 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.885559 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf58c\" (UniqueName: \"kubernetes.io/projected/c846f30b-97d9-44e4-9cfc-14dd80eb3e7d-kube-api-access-cf58c\") pod \"tuned-p9s55\" (UID: \"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d\") " pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:22.885688 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.885659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wnj\" (UniqueName: \"kubernetes.io/projected/372ef220-706c-4c53-8249-ee2943d587ac-kube-api-access-t8wnj\") pod \"node-ca-nzkxv\" (UID: \"372ef220-706c-4c53-8249-ee2943d587ac\") " pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:22.887168 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.887146 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4dcg\" (UniqueName: \"kubernetes.io/projected/f7353398-c9d2-4d2a-9af8-ed0922fd0449-kube-api-access-m4dcg\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:22.891134 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.889622 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 22:59:22.926554 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.926512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" event={"ID":"b72c9e094581ed7edd63ec499ba83450","Type":"ContainerStarted","Data":"ea3c31834b887eb87683fb74b621ea84a394efdba6fbe2a88f9ca9edb17a0bee"} Sep 09 22:59:22.927856 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.927823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" event={"ID":"fa185125bed916a8592295deab1ac091","Type":"ContainerStarted","Data":"849dbf3819a2be737f2979812bd669841e3c5f42dce1ceb0b9d025ac7ec6888c"} Sep 09 22:59:22.979109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-device-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.979109 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851add08-645a-45b9-9553-b36fd38c8f54-iptables-alerter-script\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ecffe0f-bc84-4287-aec4-92c4992e1f14-hosts-file\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-multus-certs\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-bin\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-netd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979212 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ecffe0f-bc84-4287-aec4-92c4992e1f14-hosts-file\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cmjm\" (UniqueName: \"kubernetes.io/projected/7b6921d2-7735-4dd7-b586-048fcbeae660-kube-api-access-5cmjm\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-cni-binary-copy\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-multus-certs\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-k8s-cni-cncf-io\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-bin\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979282 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979212 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-device-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979341 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-k8s-cni-cncf-io\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-cni-netd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-hostroot\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-multus-daemon-config\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-netns\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-kubelet\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cnibin\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979515 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cnibin\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979539 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-run-netns\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-kubelet\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-hostroot\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.979629 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-kubelet\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-systemd-units\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979656 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851add08-645a-45b9-9553-b36fd38c8f54-iptables-alerter-script\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-slash\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-slash\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-kubelet\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979721 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-config\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-systemd-units\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-socket-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-env-overrides\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979842 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-cni-binary-copy\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-etc-selinux\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-systemd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-conf-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979929 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f689789-a67d-469f-adf1-7acb21823a55-multus-daemon-config\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.980305 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b6921d2-7735-4dd7-b586-048fcbeae660-ovn-node-metrics-cert\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-kubelet-config\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7ff\" (UniqueName: \"kubernetes.io/projected/851add08-645a-45b9-9553-b36fd38c8f54-kube-api-access-4r7ff\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hqc\" (UniqueName: \"kubernetes.io/projected/a6c36a55-39eb-44b1-be70-e5b0772f2af0-kube-api-access-n2hqc\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-etc-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-node-log\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5gf\" (UniqueName: \"kubernetes.io/projected/6f689789-a67d-469f-adf1-7acb21823a55-kube-api-access-xb5gf\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-sys-fs\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980249 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-config\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-multus\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980285 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-multus\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-etc-kubernetes\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980327 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-systemd\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7ff2\" (UniqueName: \"kubernetes.io/projected/5ecffe0f-bc84-4287-aec4-92c4992e1f14-kube-api-access-l7ff2\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.981006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-etc-kubernetes\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-netns\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980425 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-log-socket\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-cnibin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-registration-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjft\" (UniqueName: \"kubernetes.io/projected/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kube-api-access-wgjft\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851add08-645a-45b9-9553-b36fd38c8f54-host-slash\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-var-lib-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e02aebf-0377-49f8-a453-643ea03b59bd-konnectivity-ca\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-socket-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-ovn\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980719 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-kubelet-config\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.979953 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-etc-selinux\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-system-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.981603 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980313 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-env-overrides\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.980890 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.980944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:22.980958 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:23.480927516 +0000 UTC m=+3.039085474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981013 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c36a55-39eb-44b1-be70-e5b0772f2af0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981063 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-etc-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981095 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-var-lib-openvswitch\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981097 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-node-log\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-conf-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981161 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981202 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-run-ovn\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-sys-fs\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-log-socket\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981344 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-cnibin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851add08-645a-45b9-9553-b36fd38c8f54-host-slash\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:22.982287 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-system-cni-dir\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981405 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-run-netns\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-socket-dir-parent\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981536 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-multus-socket-dir-parent\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-script-lib\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-bin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-registration-dir\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e02aebf-0377-49f8-a453-643ea03b59bd-agent-certs\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-system-cni-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981752 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e02aebf-0377-49f8-a453-643ea03b59bd-konnectivity-ca\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-system-cni-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-dbus\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981895 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b6921d2-7735-4dd7-b586-048fcbeae660-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f689789-a67d-469f-adf1-7acb21823a55-host-var-lib-cni-bin\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ecffe0f-bc84-4287-aec4-92c4992e1f14-tmp-dir\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.981984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.982875 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.982066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4e04167-625c-4d9c-b46e-34812688cf51-dbus\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:22.983599 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.982163 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c36a55-39eb-44b1-be70-e5b0772f2af0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.983599 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.982260 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ecffe0f-bc84-4287-aec4-92c4992e1f14-tmp-dir\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.983599 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.982826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b6921d2-7735-4dd7-b586-048fcbeae660-ovnkube-script-lib\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.983599 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.983343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b6921d2-7735-4dd7-b586-048fcbeae660-ovn-node-metrics-cert\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.984500 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.984475 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e02aebf-0377-49f8-a453-643ea03b59bd-agent-certs\") pod \"konnectivity-agent-6q5q8\" (UID: \"4e02aebf-0377-49f8-a453-643ea03b59bd\") " pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:22.991196 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.991174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cmjm\" (UniqueName: \"kubernetes.io/projected/7b6921d2-7735-4dd7-b586-048fcbeae660-kube-api-access-5cmjm\") pod \"ovnkube-node-ftz28\" (UID: \"7b6921d2-7735-4dd7-b586-048fcbeae660\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:22.991641 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.991620 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjft\" (UniqueName: \"kubernetes.io/projected/0c91596c-475b-4187-ae7e-7eb5a8e2f6de-kube-api-access-wgjft\") pod \"aws-ebs-csi-driver-node-4kzvx\" (UID: \"0c91596c-475b-4187-ae7e-7eb5a8e2f6de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:22.994909 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.994886 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7ff2\" (UniqueName: \"kubernetes.io/projected/5ecffe0f-bc84-4287-aec4-92c4992e1f14-kube-api-access-l7ff2\") pod \"node-resolver-lpmns\" (UID: \"5ecffe0f-bc84-4287-aec4-92c4992e1f14\") " pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:22.995225 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.995154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hqc\" (UniqueName: \"kubernetes.io/projected/a6c36a55-39eb-44b1-be70-e5b0772f2af0-kube-api-access-n2hqc\") pod \"multus-additional-cni-plugins-zbx29\" (UID: \"a6c36a55-39eb-44b1-be70-e5b0772f2af0\") " pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:22.995317 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.995279 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5gf\" (UniqueName: \"kubernetes.io/projected/6f689789-a67d-469f-adf1-7acb21823a55-kube-api-access-xb5gf\") pod \"multus-8c244\" (UID: \"6f689789-a67d-469f-adf1-7acb21823a55\") " pod="openshift-multus/multus-8c244" Sep 09 22:59:22.995531 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:22.995513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7ff\" (UniqueName: \"kubernetes.io/projected/851add08-645a-45b9-9553-b36fd38c8f54-kube-api-access-4r7ff\") pod \"iptables-alerter-lmzzv\" (UID: \"851add08-645a-45b9-9553-b36fd38c8f54\") " pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:23.071664 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.071624 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9s55" Sep 09 22:59:23.079975 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.079950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzkxv" Sep 09 22:59:23.091388 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.091365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmzzv" Sep 09 22:59:23.096404 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.096379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:23.104333 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.104305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8c244" Sep 09 22:59:23.111929 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.111907 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" Sep 09 22:59:23.118714 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.118692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpmns" Sep 09 22:59:23.126392 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.126373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:23.132067 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.132046 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbx29" Sep 09 22:59:23.384404 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.384330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:23.384404 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.384389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384494 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384520 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384538 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384552 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384587 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:24.384553843 +0000 UTC m=+3.942711820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:23.384638 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.384612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:24.384599581 +0000 UTC m=+3.942757535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:23.485444 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.485402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:23.485646 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.485595 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:23.485692 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.485657 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:24.485641437 +0000 UTC m=+4.043799393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:23.808788 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.808711 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:54:22 +0000 UTC" deadline="2028-05-29 13:18:53.435307796 +0000 UTC" Sep 09 22:59:23.808788 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.808740 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15062h19m29.626570673s" Sep 09 22:59:23.863253 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:23.863218 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f689789_a67d_469f_adf1_7acb21823a55.slice/crio-3f205587abe2846c6c2f8b99ab4756acd86f228f8f1eb8d72c3b6ce737373d66 WatchSource:0}: Error finding container 3f205587abe2846c6c2f8b99ab4756acd86f228f8f1eb8d72c3b6ce737373d66: Status 404 returned error can't find the container with id 3f205587abe2846c6c2f8b99ab4756acd86f228f8f1eb8d72c3b6ce737373d66 Sep 09 22:59:23.864796 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:23.864712 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6921d2_7735_4dd7_b586_048fcbeae660.slice/crio-1fc1b88b51ad6c6de53ecab0fdd26e50f3b8f47cebf31fc459a0e0ea734c0922 WatchSource:0}: Error finding container 1fc1b88b51ad6c6de53ecab0fdd26e50f3b8f47cebf31fc459a0e0ea734c0922: Status 404 returned error can't find the container with id 1fc1b88b51ad6c6de53ecab0fdd26e50f3b8f47cebf31fc459a0e0ea734c0922 Sep 09 22:59:23.867328 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:23.867285 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc846f30b_97d9_44e4_9cfc_14dd80eb3e7d.slice/crio-6d2300d6b0d8097761dfd0624d55ce227791a3a332a467a194ee8683eda09423 WatchSource:0}: Error finding container 6d2300d6b0d8097761dfd0624d55ce227791a3a332a467a194ee8683eda09423: Status 404 returned error can't find the container with id 6d2300d6b0d8097761dfd0624d55ce227791a3a332a467a194ee8683eda09423 Sep 09 22:59:23.869916 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:23.869825 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851add08_645a_45b9_9553_b36fd38c8f54.slice/crio-00368c3648557b306d1425637cf99d15813e63d99ce30e49d1a32a11470370a4 WatchSource:0}: Error finding container 00368c3648557b306d1425637cf99d15813e63d99ce30e49d1a32a11470370a4: Status 404 returned error can't find the container with id 00368c3648557b306d1425637cf99d15813e63d99ce30e49d1a32a11470370a4 Sep 09 22:59:23.871826 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:23.871796 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c91596c_475b_4187_ae7e_7eb5a8e2f6de.slice/crio-a0af84d0412f5a4cd84d81dd3ed5f90c408fc511d2a16e5bfcd5bab3b618fceb WatchSource:0}: Error finding container a0af84d0412f5a4cd84d81dd3ed5f90c408fc511d2a16e5bfcd5bab3b618fceb: Status 404 returned error can't find the container with id a0af84d0412f5a4cd84d81dd3ed5f90c408fc511d2a16e5bfcd5bab3b618fceb Sep 09 22:59:23.922409 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.922382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:23.922550 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:23.922489 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:23.931227 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.931195 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpmns" event={"ID":"5ecffe0f-bc84-4287-aec4-92c4992e1f14","Type":"ContainerStarted","Data":"da0bf7aef32894a8086b6bf9e2bd0d560f23b3af9365c1180bb863be4de9dd0d"} Sep 09 22:59:23.932426 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.932398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6q5q8" event={"ID":"4e02aebf-0377-49f8-a453-643ea03b59bd","Type":"ContainerStarted","Data":"d7e77e26d6979212624c520b33426ddbec1fe564b01f245eb34159de4f3763a4"} Sep 09 22:59:23.933479 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.933451 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" event={"ID":"0c91596c-475b-4187-ae7e-7eb5a8e2f6de","Type":"ContainerStarted","Data":"a0af84d0412f5a4cd84d81dd3ed5f90c408fc511d2a16e5bfcd5bab3b618fceb"} Sep 09 22:59:23.934705 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.934683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmzzv" event={"ID":"851add08-645a-45b9-9553-b36fd38c8f54","Type":"ContainerStarted","Data":"00368c3648557b306d1425637cf99d15813e63d99ce30e49d1a32a11470370a4"} Sep 09 22:59:23.936006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.935978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9s55" event={"ID":"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d","Type":"ContainerStarted","Data":"6d2300d6b0d8097761dfd0624d55ce227791a3a332a467a194ee8683eda09423"} Sep 09 22:59:23.937269 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.937246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"1fc1b88b51ad6c6de53ecab0fdd26e50f3b8f47cebf31fc459a0e0ea734c0922"} Sep 09 22:59:23.938476 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.938453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerStarted","Data":"80403f71b2e18829035fa20e8f96412e65a1b48914325f507ba1e9eb4a3af53d"} Sep 09 22:59:23.939708 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.939681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzkxv" event={"ID":"372ef220-706c-4c53-8249-ee2943d587ac","Type":"ContainerStarted","Data":"34bc64301b558cf9102848fab590a586dcfcc1451deb868d346e0ab26a217f34"} Sep 09 22:59:23.940919 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:23.940895 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8c244" event={"ID":"6f689789-a67d-469f-adf1-7acb21823a55","Type":"ContainerStarted","Data":"3f205587abe2846c6c2f8b99ab4756acd86f228f8f1eb8d72c3b6ce737373d66"} Sep 09 22:59:24.391744 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.391555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:24.391744 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.391659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:24.391964 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.391805 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:24.391964 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.391829 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:24.391964 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.391842 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:24.391964 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.391899 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:26.391881618 +0000 UTC m=+5.950039578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:24.392314 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.392275 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:24.392366 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.392326 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:26.392308719 +0000 UTC m=+5.950466678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:24.493432 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.492840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:24.493432 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.493006 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:24.493432 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.493071 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:26.493054567 +0000 UTC m=+6.051212529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:24.809450 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.809161 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:54:22 +0000 UTC" deadline="2028-02-22 23:26:01.440691713 +0000 UTC" Sep 09 22:59:24.809450 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.809446 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12744h26m36.63125904s" Sep 09 22:59:24.922797 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.922698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:24.922965 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.922827 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:24.923609 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.923589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:24.923753 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:24.923708 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:24.954915 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.954875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" event={"ID":"fa185125bed916a8592295deab1ac091","Type":"ContainerStarted","Data":"def73291d032718600794573935a171dcce3b718af3933d4198528a0fae5b9d3"} Sep 09 22:59:24.983604 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.983195 2561 generic.go:356] "Generic (PLEG): container finished" podID="b72c9e094581ed7edd63ec499ba83450" containerID="54b8a440501f76691b6215edb3e22ed7213d1eb7d5355ca316b0059f094fda09" exitCode=0 Sep 09 22:59:24.983604 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:24.983241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" event={"ID":"b72c9e094581ed7edd63ec499ba83450","Type":"ContainerDied","Data":"54b8a440501f76691b6215edb3e22ed7213d1eb7d5355ca316b0059f094fda09"} Sep 09 22:59:25.000712 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:25.000656 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-25.ec2.internal" podStartSLOduration=4.000632745 podStartE2EDuration="4.000632745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:24.970642646 +0000 UTC m=+4.528800649" watchObservedRunningTime="2026-09-09 22:59:25.000632745 +0000 UTC m=+4.558790736" Sep 09 22:59:25.921951 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:25.921920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:25.922413 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:25.922051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:26.021854 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.021783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" event={"ID":"b72c9e094581ed7edd63ec499ba83450","Type":"ContainerStarted","Data":"d608cadd4f0fdbe2f4e6f5eacad82a21c404d41002aedfc38521d6d618922120"} Sep 09 22:59:26.038324 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.037326 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-25.ec2.internal" podStartSLOduration=5.037305558 podStartE2EDuration="5.037305558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:26.035827941 +0000 UTC m=+5.593985939" watchObservedRunningTime="2026-09-09 22:59:26.037305558 +0000 UTC m=+5.595463536" Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.411509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.411603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411738 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411799 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:30.41178067 +0000 UTC m=+9.969938647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411883 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411895 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411907 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:26.412368 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.411940 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:30.411930126 +0000 UTC m=+9.970088094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:26.512858 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.512817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:26.513053 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.512986 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:26.513117 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.513065 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:30.513044596 +0000 UTC m=+10.071202569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:26.922718 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.922685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:26.923184 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.922827 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:26.923184 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:26.922875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:26.923184 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:26.922997 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:27.922645 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:27.922613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:27.922836 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:27.922736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:28.922361 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:28.922324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:28.922544 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:28.922381 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:28.922544 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:28.922474 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:28.922923 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:28.922895 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:29.921770 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:29.921691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:29.921925 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:29.921841 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:30.444165 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:30.444126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:30.444649 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:30.444196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:30.444649 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444326 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:30.444649 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444386 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:38.444368494 +0000 UTC m=+18.002526471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:30.444809 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444730 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:30.444809 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444758 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:30.444809 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444772 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:30.444913 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.444827 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:38.44481132 +0000 UTC m=+18.002969279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:30.544760 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:30.544725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:30.544942 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.544872 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:30.544992 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.544951 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:38.544928953 +0000 UTC m=+18.103086911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:30.923226 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:30.923189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:30.923376 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.923317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:30.923717 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:30.923694 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:30.923928 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:30.923819 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:31.922833 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:31.922663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:31.922833 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:31.922789 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:32.922428 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:32.922401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:32.922608 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:32.922444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:32.922608 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:32.922526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:32.922921 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:32.922902 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:33.921732 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:33.921693 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:33.921930 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:33.921826 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:34.922531 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:34.922487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:34.923006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:34.922487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:34.923006 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:34.922653 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:34.923006 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:34.922733 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:35.921952 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:35.921910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:35.922147 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:35.922081 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:36.922893 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:36.922365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:36.922893 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:36.922517 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:36.922893 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:36.922592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:36.922893 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:36.922723 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:37.921987 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:37.921950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:37.922253 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:37.922083 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:38.511144 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:38.511105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:38.511182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511288 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511291 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511315 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511328 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511352 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:54.511331347 +0000 UTC m=+34.069489322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:38.511554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.511380 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:54.511363958 +0000 UTC m=+34.069521924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:38.612121 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:38.612065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:38.612304 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.612245 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:38.612358 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.612322 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:54.612302399 +0000 UTC m=+34.170460387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:38.921860 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:38.921824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:38.922023 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:38.921864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:38.922023 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.921957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:38.922141 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:38.922116 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:39.921899 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:39.921705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:39.921899 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:39.921833 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:40.923095 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:40.923063 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:40.923554 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:40.923181 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:40.923663 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:40.923611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:40.923725 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:40.923707 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:41.922255 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:41.922238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:41.922346 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:41.922328 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:42.051941 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.051913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6q5q8" event={"ID":"4e02aebf-0377-49f8-a453-643ea03b59bd","Type":"ContainerStarted","Data":"7f1385c10fbb310ed5f5140b74279fae0b3f32f34a4ed3fbd4cc3e6599175b02"} Sep 09 22:59:42.053463 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.053437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerStarted","Data":"3901fbf693d1c2fbfd40211f0167bcc911508681ea41230b57ab16df74028479"} Sep 09 22:59:42.054850 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.054827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzkxv" event={"ID":"372ef220-706c-4c53-8249-ee2943d587ac","Type":"ContainerStarted","Data":"bfee0c53a35afe3106e0c4f181b5010f6e7d02878536a6ff6a5c0588d9458c3a"} Sep 09 22:59:42.070619 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.070555 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6q5q8" podStartSLOduration=6.9531336790000005 podStartE2EDuration="21.07054112s" totalImagesPullingTime="14.117407441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:42.070274451 +0000 UTC m=+21.628432429" watchObservedRunningTime="2026-09-09 22:59:42.07054112 +0000 UTC m=+21.628699096" Sep 09 22:59:42.083330 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.083250 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nzkxv" podStartSLOduration=4.143069339 podStartE2EDuration="22.083234916s" totalImagesPullingTime="17.940165577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:42.082857876 +0000 UTC m=+21.641015871" watchObservedRunningTime="2026-09-09 22:59:42.083234916 +0000 UTC m=+21.641392891" Sep 09 22:59:42.170048 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.170014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:42.244840 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.244788 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:42.922207 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.922026 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:42.922320 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:42.922031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:42.922394 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:42.922303 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:42.922433 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:42.922415 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:43.059443 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.059183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8c244" event={"ID":"6f689789-a67d-469f-adf1-7acb21823a55","Type":"ContainerStarted","Data":"d3c298bd457884583c7d24b6fdeddf69ec358cb01d11e70c804e8b8175394aa1"} Sep 09 22:59:43.061047 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.061021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpmns" event={"ID":"5ecffe0f-bc84-4287-aec4-92c4992e1f14","Type":"ContainerStarted","Data":"ac5278bee73c21902690618b1b2528194a0d61d3ab5b935154f7e36d7e9660dd"} Sep 09 22:59:43.063006 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.062977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" event={"ID":"0c91596c-475b-4187-ae7e-7eb5a8e2f6de","Type":"ContainerStarted","Data":"793272918c02f058e2336b948109facd23e19794cfd3f1ab3a162c2df79af795"} Sep 09 22:59:43.064742 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.064719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9s55" event={"ID":"c846f30b-97d9-44e4-9cfc-14dd80eb3e7d","Type":"ContainerStarted","Data":"e2cd4cacd7fcffd0d5bb42125a7ca01d3cfb341d76ba45ea80b58315b2282bb8"} Sep 09 22:59:43.067918 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.067898 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 22:59:43.068307 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068281 2561 generic.go:356] "Generic (PLEG): container finished" podID="7b6921d2-7735-4dd7-b586-048fcbeae660" containerID="47f24d5a59489c97a8d4963aa11d5ae73575757274d12df451ed9a516d0d934b" exitCode=1 Sep 09 22:59:43.068418 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"e7dc9d3f9dc82003bb0b5d6532ef0066705e91a04d3466ce13091ad6073f8059"} Sep 09 22:59:43.068418 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068407 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"3bb319fa4f48ac2578ee03cc9498a6ba8e93d8d85f4167ed22257b0fb75a73e7"} Sep 09 22:59:43.068527 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"598b76eb7a53724b24070348657b285486ed3127a22019fe5961ceb39a22889b"} Sep 09 22:59:43.068527 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068489 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"d3b6d957f0b0fd9ae21085cfd09d624cfc11d62206ad6e200417573d8f6207bb"} Sep 09 22:59:43.068662 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerDied","Data":"47f24d5a59489c97a8d4963aa11d5ae73575757274d12df451ed9a516d0d934b"} Sep 09 22:59:43.068662 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.068591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"bd246c2aaf980dc62b0efa9b61b3eab9460e5e1457fb8e4a0687228df9bf3578"} Sep 09 22:59:43.070163 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.070139 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="3901fbf693d1c2fbfd40211f0167bcc911508681ea41230b57ab16df74028479" exitCode=0 Sep 09 22:59:43.070251 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.070174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"3901fbf693d1c2fbfd40211f0167bcc911508681ea41230b57ab16df74028479"} Sep 09 22:59:43.092214 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.092108 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p9s55" podStartSLOduration=5.068875343 podStartE2EDuration="23.092089724s" totalImagesPullingTime="18.023214381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:43.092028733 +0000 UTC m=+22.650186731" watchObservedRunningTime="2026-09-09 22:59:43.092089724 +0000 UTC m=+22.650247699" Sep 09 22:59:43.092443 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.092333 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8c244" podStartSLOduration=3.805150763 podStartE2EDuration="22.092327399s" totalImagesPullingTime="18.287176636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:43.076090228 +0000 UTC m=+22.634248201" watchObservedRunningTime="2026-09-09 22:59:43.092327399 +0000 UTC m=+22.650485374" Sep 09 22:59:43.125648 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.125584 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lpmns" podStartSLOduration=4.111838514 podStartE2EDuration="22.125551592s" totalImagesPullingTime="18.013713078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:43.125372062 +0000 UTC m=+22.683530060" watchObservedRunningTime="2026-09-09 22:59:43.125551592 +0000 UTC m=+22.683709567" Sep 09 22:59:43.192811 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.192775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:43.252106 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.252071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:43.519113 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.519091 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 22:59:43.854943 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.854852 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T22:59:43.519109529Z","UUID":"c13f08e6-c13c-47e5-a4a3-baae95a0ca9e","Handler":null,"Name":"","Endpoint":""} Sep 09 22:59:43.857332 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.857311 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 22:59:43.857332 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.857343 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 22:59:43.921867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:43.921834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:43.922005 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:43.921957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:44.075009 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.074973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" event={"ID":"0c91596c-475b-4187-ae7e-7eb5a8e2f6de","Type":"ContainerStarted","Data":"983ac635cf1558ac1da56c8efd70438c99724eccd0779b6ad2e70e7005e1b1d0"} Sep 09 22:59:44.077265 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.077240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmzzv" event={"ID":"851add08-645a-45b9-9553-b36fd38c8f54","Type":"ContainerStarted","Data":"4d07487bc1d41e9e20037128239c38ad6482eff296a25c19952b37a45f1c7127"} Sep 09 22:59:44.091739 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.091699 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lmzzv" podStartSLOduration=6.07319 podStartE2EDuration="24.091682649s" totalImagesPullingTime="18.018492649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:44.091111039 +0000 UTC m=+23.649269033" watchObservedRunningTime="2026-09-09 22:59:44.091682649 +0000 UTC m=+23.649840627" Sep 09 22:59:44.208068 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.208033 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:44.263048 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.263014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:44.922021 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.921950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:44.922021 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:44.921986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:44.922241 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:44.922084 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:44.922241 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:44.922227 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:45.081985 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.081953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" event={"ID":"0c91596c-475b-4187-ae7e-7eb5a8e2f6de","Type":"ContainerStarted","Data":"4c51a4d59bbfebc133c7fab7982b996eeea52af2d4d6b1be9b48c1f6709c739f"} Sep 09 22:59:45.085249 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.085203 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 22:59:45.099690 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.099647 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4kzvx" podStartSLOduration=3.787654249 podStartE2EDuration="24.09963358s" totalImagesPullingTime="20.311979331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:45.09941531 +0000 UTC m=+24.657573304" watchObservedRunningTime="2026-09-09 22:59:45.09963358 +0000 UTC m=+24.657791556" Sep 09 22:59:45.373014 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.372906 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:45.373587 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.373546 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:45.922404 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:45.922380 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:45.922556 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:45.922475 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:46.092923 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.092891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 22:59:46.093375 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.093348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"f01ef9217079e3ab780a3134b9d2ea3b7ff2d71667b403a6c24396e7fc14ff5d"} Sep 09 22:59:46.093855 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.093832 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:46.094350 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.094327 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6q5q8" Sep 09 22:59:46.152867 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.152831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:46.922689 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.922648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:46.922860 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:46.922648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:46.922860 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:46.922799 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:46.922860 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:46.922833 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:47.922677 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:47.922343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:47.923542 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:47.922723 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.102387 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.103527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"bac8839eaaeac4dcf1fd6e2e42def288809ee9d41254e72c5b44384654f4fbff"} Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.104164 2561 scope.go:117] "RemoveContainer" containerID="47f24d5a59489c97a8d4963aa11d5ae73575757274d12df451ed9a516d0d934b" Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.104232 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.104329 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:48.105112 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.104402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:48.123847 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.123825 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:48.126320 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.126295 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 22:59:48.922383 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.922354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:48.922562 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:48.922354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:48.922562 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:48.922467 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:48.922562 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:48.922537 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:49.111223 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.111125 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="b7112e560d66391623a6f74091e9c2e7aef41988dba9b15a4969bc6ae88713d7" exitCode=0 Sep 09 22:59:49.111371 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.111245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"b7112e560d66391623a6f74091e9c2e7aef41988dba9b15a4969bc6ae88713d7"} Sep 09 22:59:49.120424 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.120404 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 22:59:49.121513 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.121488 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" event={"ID":"7b6921d2-7735-4dd7-b586-048fcbeae660","Type":"ContainerStarted","Data":"4ec61278849e04dc95a56cdbddd357ea7d62e5aa3bd38ddd32a0d1e189a2e61f"} Sep 09 22:59:49.163672 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.163611 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" podStartSLOduration=10.640009501 podStartE2EDuration="29.163590776s" totalImagesPullingTime="18.523581275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 22:59:49.161984358 +0000 UTC m=+28.720142370" watchObservedRunningTime="2026-09-09 22:59:49.163590776 +0000 UTC m=+28.721748744" Sep 09 22:59:49.778892 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.778560 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j65hg"] Sep 09 22:59:49.779066 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.778966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:49.779066 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:49.779051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:49.781605 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.781293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dmv9g"] Sep 09 22:59:49.781605 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.781407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:49.781605 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:49.781514 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:49.782828 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.782805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6mk7"] Sep 09 22:59:49.782957 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:49.782913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:49.783007 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:49.782995 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:51.127874 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:51.127840 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="48f562f40ed384dc6b6360e15170c4467a4fb839fde8b0abf764270e5090d326" exitCode=0 Sep 09 22:59:51.128256 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:51.127920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"48f562f40ed384dc6b6360e15170c4467a4fb839fde8b0abf764270e5090d326"} Sep 09 22:59:51.922264 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:51.922233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:51.922403 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:51.922326 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:51.922403 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:51.922346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:51.922403 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:51.922328 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:51.922492 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:51.922403 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:51.922492 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:51.922449 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:53.137532 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:53.137501 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="a16412f9880ee6710bfa624a7232875fb39f0d766bc6eea4865aff8ac95b08d5" exitCode=0 Sep 09 22:59:53.137884 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:53.137550 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"a16412f9880ee6710bfa624a7232875fb39f0d766bc6eea4865aff8ac95b08d5"} Sep 09 22:59:53.922258 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:53.922219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:53.922443 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:53.922220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:53.922443 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:53.922354 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 22:59:53.922443 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:53.922220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:53.922592 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:53.922448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dmv9g" podUID="b4e04167-625c-4d9c-b46e-34812688cf51" Sep 09 22:59:53.922592 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:53.922499 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j65hg" podUID="186be559-cfb9-4797-8eea-10e334bd80b0" Sep 09 22:59:54.527022 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:54.526935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:54.527022 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:54.527005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527049 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527073 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527085 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qkpdt for pod openshift-network-diagnostics/network-check-target-j65hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527144 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527152 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt podName:186be559-cfb9-4797-8eea-10e334bd80b0 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:26.527130893 +0000 UTC m=+66.085288868 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkpdt" (UniqueName: "kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt") pod "network-check-target-j65hg" (UID: "186be559-cfb9-4797-8eea-10e334bd80b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 22:59:54.527557 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.527212 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:26.527196441 +0000 UTC m=+66.085354398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 22:59:54.627907 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:54.627876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:54.628084 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.628042 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:54.628130 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:54.628117 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret podName:b4e04167-625c-4d9c-b46e-34812688cf51 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:26.628100909 +0000 UTC m=+66.186258865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret") pod "global-pull-secret-syncer-dmv9g" (UID: "b4e04167-625c-4d9c-b46e-34812688cf51") : object "kube-system"/"original-pull-secret" not registered Sep 09 22:59:55.675386 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.675147 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-25.ec2.internal" event="NodeReady" Sep 09 22:59:55.675831 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.675507 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 22:59:55.717866 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.717783 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mnfnq"] Sep 09 22:59:55.720979 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.720947 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hgsdj"] Sep 09 22:59:55.721100 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.721083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.723878 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.723857 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 22:59:55.724087 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.724060 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 22:59:55.724329 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.724309 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7bbt\"" Sep 09 22:59:55.724455 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.724436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.727107 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.727065 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 22:59:55.727203 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.727122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dx997\"" Sep 09 22:59:55.727277 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.727070 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 22:59:55.727368 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.727342 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 22:59:55.730075 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.730056 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mnfnq"] Sep 09 22:59:55.732308 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.732264 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgsdj"] Sep 09 22:59:55.827769 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.827735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:55.841304 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxkmr\" (UniqueName: \"kubernetes.io/projected/ab69d037-2670-425d-a18c-b306d0ab6c99-kube-api-access-gxkmr\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.841455 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab69d037-2670-425d-a18c-b306d0ab6c99-config-volume\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.841455 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab69d037-2670-425d-a18c-b306d0ab6c99-tmp-dir\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.841547 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w4x2\" (UniqueName: \"kubernetes.io/projected/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-kube-api-access-7w4x2\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.841547 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-cert\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.841680 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.841633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.922526 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.922497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 22:59:55.922690 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.922498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 22:59:55.922690 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.922498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 22:59:55.925713 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.925689 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 22:59:55.925844 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.925747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 22:59:55.925844 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.925690 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjfnz\"" Sep 09 22:59:55.925844 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.925697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 22:59:55.925844 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.925839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sns2d\"" Sep 09 22:59:55.926067 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.926051 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 22:59:55.941977 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.941951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab69d037-2670-425d-a18c-b306d0ab6c99-config-volume\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.942115 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab69d037-2670-425d-a18c-b306d0ab6c99-tmp-dir\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.942115 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4x2\" (UniqueName: \"kubernetes.io/projected/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-kube-api-access-7w4x2\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.942115 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-cert\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.942279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.942279 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkmr\" (UniqueName: \"kubernetes.io/projected/ab69d037-2670-425d-a18c-b306d0ab6c99-kube-api-access-gxkmr\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.942481 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab69d037-2670-425d-a18c-b306d0ab6c99-tmp-dir\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.942481 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:55.942456 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 22:59:55.942611 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:55.942513 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:56.442492011 +0000 UTC m=+36.000649983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 22:59:55.942786 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.942761 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab69d037-2670-425d-a18c-b306d0ab6c99-config-volume\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.946987 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.946966 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-cert\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:55.953024 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.952998 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkmr\" (UniqueName: \"kubernetes.io/projected/ab69d037-2670-425d-a18c-b306d0ab6c99-kube-api-access-gxkmr\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:55.953132 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:55.953031 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w4x2\" (UniqueName: \"kubernetes.io/projected/d6e94f83-bb0c-42e6-9c16-6e696a6432c6-kube-api-access-7w4x2\") pod \"ingress-canary-hgsdj\" (UID: \"d6e94f83-bb0c-42e6-9c16-6e696a6432c6\") " pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:56.041718 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:56.041679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgsdj" Sep 09 22:59:56.446057 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:56.446018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:56.446240 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:56.446175 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 22:59:56.446298 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:56.446241 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:57.446222628 +0000 UTC m=+37.004380586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 22:59:57.453133 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:57.453108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:57.453777 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:57.453242 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 22:59:57.453777 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:57.453299 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 22:59:59.453282925 +0000 UTC m=+39.011440903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 22:59:57.547288 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:57.547212 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgsdj"] Sep 09 22:59:57.554897 ip-10-0-142-25 kubenswrapper[2561]: W0909 22:59:57.554864 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e94f83_bb0c_42e6_9c16_6e696a6432c6.slice/crio-340373c9084bd8921217ed0abcbcf26eb88719e4d1916aa2578e570c53703941 WatchSource:0}: Error finding container 340373c9084bd8921217ed0abcbcf26eb88719e4d1916aa2578e570c53703941: Status 404 returned error can't find the container with id 340373c9084bd8921217ed0abcbcf26eb88719e4d1916aa2578e570c53703941 Sep 09 22:59:58.152254 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:58.152015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgsdj" event={"ID":"d6e94f83-bb0c-42e6-9c16-6e696a6432c6","Type":"ContainerStarted","Data":"340373c9084bd8921217ed0abcbcf26eb88719e4d1916aa2578e570c53703941"} Sep 09 22:59:58.155186 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:58.155159 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="03ecd82dae84bc931e1806bb3ca8aaea186a4a6e612ef2cf0f5acda9ee1ec64d" exitCode=0 Sep 09 22:59:58.155400 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:58.155210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"03ecd82dae84bc931e1806bb3ca8aaea186a4a6e612ef2cf0f5acda9ee1ec64d"} Sep 09 22:59:58.566272 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:58.566230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:58.623941 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:58.623904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:59.161439 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.161399 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6c36a55-39eb-44b1-be70-e5b0772f2af0" containerID="a734297ac39ac1ef6aae77c34da577ac9fcd1b6fda6349d01611d9efc1231a02" exitCode=0 Sep 09 22:59:59.161634 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.161481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerDied","Data":"a734297ac39ac1ef6aae77c34da577ac9fcd1b6fda6349d01611d9efc1231a02"} Sep 09 22:59:59.194997 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.194968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:59.249816 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.249790 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:59.310086 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.310055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:59.467786 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.467754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 22:59:59.467961 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:59.467924 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 22:59:59.468025 ip-10-0-142-25 kubenswrapper[2561]: E0909 22:59:59.468012 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:03.46799195 +0000 UTC m=+43.026149956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 22:59:59.615335 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.615300 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 22:59:59.671404 ip-10-0-142-25 kubenswrapper[2561]: I0909 22:59:59.671369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:00:00.166897 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:00.166862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbx29" event={"ID":"a6c36a55-39eb-44b1-be70-e5b0772f2af0","Type":"ContainerStarted","Data":"c8f9effb5b42826b4fa3e1cd6449e431db37abfc1b0a486938838bf9ed866f69"} Sep 09 23:00:00.193776 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:00.193715 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zbx29" podStartSLOduration=10.066429953 podStartE2EDuration="39.19369855s" totalImagesPullingTime="29.127268597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:00.193113744 +0000 UTC m=+39.751271739" watchObservedRunningTime="2026-09-09 23:00:00.19369855 +0000 UTC m=+39.751856526" Sep 09 23:00:00.315337 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:00.315308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:00:00.415761 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:00.415729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:00:01.170907 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:01.170873 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgsdj" event={"ID":"d6e94f83-bb0c-42e6-9c16-6e696a6432c6","Type":"ContainerStarted","Data":"6969d2a1c3bcdd9dda7adbef4e3c5294d213a06004dd488571ac15e06b1069f5"} Sep 09 23:00:01.189630 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:01.189562 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hgsdj" podStartSLOduration=3.411238076 podStartE2EDuration="6.18954565s" totalImagesPullingTime="2.778307574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:01.189278842 +0000 UTC m=+40.747436838" watchObservedRunningTime="2026-09-09 23:00:01.18954565 +0000 UTC m=+40.747703626" Sep 09 23:00:03.499081 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:03.499043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:00:03.499425 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:03.499198 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:00:03.499425 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:03.499262 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:11.499245496 +0000 UTC m=+51.057403456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 23:00:11.551739 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:11.551700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:00:11.552194 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:11.551888 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:00:11.552194 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:11.551962 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:27.55194396 +0000 UTC m=+67.110101919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 23:00:20.145322 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:20.145292 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftz28" Sep 09 23:00:20.258005 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:20.257970 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:00:20.357858 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:20.357824 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:00:26.553621 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.553561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 23:00:26.554083 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.553667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:00:26.556708 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.556685 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:00:26.556776 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.556727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:00:26.563960 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:26.563932 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:00:26.564048 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:26.564032 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 23:01:30.564015041 +0000 UTC m=+130.122172995 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : secret "metrics-daemon-secret" not found Sep 09 23:00:26.566451 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.566435 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:00:26.578460 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.578434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpdt\" (UniqueName: \"kubernetes.io/projected/186be559-cfb9-4797-8eea-10e334bd80b0-kube-api-access-qkpdt\") pod \"network-check-target-j65hg\" (UID: \"186be559-cfb9-4797-8eea-10e334bd80b0\") " pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 23:00:26.654804 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.654763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 23:00:26.657770 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.657750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:00:26.668157 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.668128 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4e04167-625c-4d9c-b46e-34812688cf51-original-pull-secret\") pod \"global-pull-secret-syncer-dmv9g\" (UID: \"b4e04167-625c-4d9c-b46e-34812688cf51\") " pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 23:00:26.843001 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.842907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sns2d\"" Sep 09 23:00:26.846303 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.846290 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dmv9g" Sep 09 23:00:26.850430 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:26.850413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 23:00:27.140386 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:27.140308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dmv9g"] Sep 09 23:00:27.143391 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:00:27.143365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e04167_625c_4d9c_b46e_34812688cf51.slice/crio-8ca2ef615b8016b718dd87247124f8e05d5057b18049bacd10e95f07c8955c8d WatchSource:0}: Error finding container 8ca2ef615b8016b718dd87247124f8e05d5057b18049bacd10e95f07c8955c8d: Status 404 returned error can't find the container with id 8ca2ef615b8016b718dd87247124f8e05d5057b18049bacd10e95f07c8955c8d Sep 09 23:00:27.158465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:27.158444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j65hg"] Sep 09 23:00:27.162914 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:00:27.160891 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186be559_cfb9_4797_8eea_10e334bd80b0.slice/crio-1d18db37bb047cabee1a6b79248f98975aa7666f01ac9da7c668bcd81feff5c4 WatchSource:0}: Error finding container 1d18db37bb047cabee1a6b79248f98975aa7666f01ac9da7c668bcd81feff5c4: Status 404 returned error can't find the container with id 1d18db37bb047cabee1a6b79248f98975aa7666f01ac9da7c668bcd81feff5c4 Sep 09 23:00:27.234896 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:27.234861 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j65hg" event={"ID":"186be559-cfb9-4797-8eea-10e334bd80b0","Type":"ContainerStarted","Data":"1d18db37bb047cabee1a6b79248f98975aa7666f01ac9da7c668bcd81feff5c4"} Sep 09 23:00:27.236025 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:27.235991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dmv9g" event={"ID":"b4e04167-625c-4d9c-b46e-34812688cf51","Type":"ContainerStarted","Data":"8ca2ef615b8016b718dd87247124f8e05d5057b18049bacd10e95f07c8955c8d"} Sep 09 23:00:27.566068 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:27.566024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:00:27.566457 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:27.566150 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:00:27.566457 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:27.566206 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:00:59.566192726 +0000 UTC m=+99.124350680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 23:00:30.320485 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.320449 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t"] Sep 09 23:00:30.322263 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.322240 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs"] Sep 09 23:00:30.322409 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.322387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.324151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.324123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.326098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.325810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 23:00:30.326098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.325819 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 23:00:30.326098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.325852 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 09 23:00:30.326098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.325882 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 23:00:30.327118 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.327087 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 23:00:30.327215 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.327151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 23:00:30.327215 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.327187 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 23:00:30.327358 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.327271 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 23:00:30.332833 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.332763 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t"] Sep 09 23:00:30.333647 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.333629 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs"] Sep 09 23:00:30.388927 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.388891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.388938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-klusterlet-config\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.389098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.388972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7bfp\" (UniqueName: \"kubernetes.io/projected/7f686c56-ee3d-46cf-83d3-6fb564b09b41-kube-api-access-b7bfp\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389269 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389269 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f686c56-ee3d-46cf-83d3-6fb564b09b41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.389269 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztfn5\" (UniqueName: \"kubernetes.io/projected/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-kube-api-access-ztfn5\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.389269 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.389207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-tmp\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.490382 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztfn5\" (UniqueName: \"kubernetes.io/projected/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-kube-api-access-ztfn5\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.490596 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-tmp\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.490596 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490596 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-klusterlet-config\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.490596 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490596 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7bfp\" (UniqueName: \"kubernetes.io/projected/7f686c56-ee3d-46cf-83d3-6fb564b09b41-kube-api-access-b7bfp\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490915 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490721 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490915 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490915 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f686c56-ee3d-46cf-83d3-6fb564b09b41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.490915 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.490890 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-tmp\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.491521 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.491485 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f686c56-ee3d-46cf-83d3-6fb564b09b41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.493849 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.493829 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.493928 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.493852 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.493928 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.493896 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.494523 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.494500 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-klusterlet-config\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.495280 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.495260 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f686c56-ee3d-46cf-83d3-6fb564b09b41-ca\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.499399 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.499375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztfn5\" (UniqueName: \"kubernetes.io/projected/54992c9a-3e5c-4bfa-bed4-858fbbaac3be-kube-api-access-ztfn5\") pod \"klusterlet-addon-workmgr-564998459-mqf4t\" (UID: \"54992c9a-3e5c-4bfa-bed4-858fbbaac3be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.499502 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.499419 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7bfp\" (UniqueName: \"kubernetes.io/projected/7f686c56-ee3d-46cf-83d3-6fb564b09b41-kube-api-access-b7bfp\") pod \"cluster-proxy-proxy-agent-54f44df44c-gr7gs\" (UID: \"7f686c56-ee3d-46cf-83d3-6fb564b09b41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:30.635766 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.635686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:30.653484 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:30.653454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:00:32.251232 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.251193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j65hg" event={"ID":"186be559-cfb9-4797-8eea-10e334bd80b0","Type":"ContainerStarted","Data":"c4cd24e1d799a40303f66747b581a9b3e2e882725401f02d25e8c4624fc423c1"} Sep 09 23:00:32.251720 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.251288 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 23:00:32.252805 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.252776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dmv9g" event={"ID":"b4e04167-625c-4d9c-b46e-34812688cf51","Type":"ContainerStarted","Data":"26c3143ff1a1541edb53cbf9ca215b078ce6aa2cfa8a5165ed304f99f2d76c6e"} Sep 09 23:00:32.267794 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.267741 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j65hg" podStartSLOduration=67.378980299 podStartE2EDuration="1m12.267725613s" totalImagesPullingTime="4.888745314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:32.267140307 +0000 UTC m=+71.825298301" watchObservedRunningTime="2026-09-09 23:00:32.267725613 +0000 UTC m=+71.825883606" Sep 09 23:00:32.283708 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.283659 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dmv9g" podStartSLOduration=66.35817388 podStartE2EDuration="1m11.283640806s" totalImagesPullingTime="4.925466926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 22:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:32.283280136 +0000 UTC m=+71.841438137" watchObservedRunningTime="2026-09-09 23:00:32.283640806 +0000 UTC m=+71.841798782" Sep 09 23:00:32.328665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.328550 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs"] Sep 09 23:00:32.329353 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:32.329293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t"] Sep 09 23:00:32.331828 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:00:32.331790 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f686c56_ee3d_46cf_83d3_6fb564b09b41.slice/crio-f212101b2d7b2fe324b9a7cb42c01ad0a0ab5bb6195552a183c2591bb182aef7 WatchSource:0}: Error finding container f212101b2d7b2fe324b9a7cb42c01ad0a0ab5bb6195552a183c2591bb182aef7: Status 404 returned error can't find the container with id f212101b2d7b2fe324b9a7cb42c01ad0a0ab5bb6195552a183c2591bb182aef7 Sep 09 23:00:32.332536 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:00:32.332512 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54992c9a_3e5c_4bfa_bed4_858fbbaac3be.slice/crio-2abeb17dbadb2f3a3247600c83554ae25c9ac31138fb0f05a6344ba6beb5d54d WatchSource:0}: Error finding container 2abeb17dbadb2f3a3247600c83554ae25c9ac31138fb0f05a6344ba6beb5d54d: Status 404 returned error can't find the container with id 2abeb17dbadb2f3a3247600c83554ae25c9ac31138fb0f05a6344ba6beb5d54d Sep 09 23:00:33.258154 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:33.258121 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" event={"ID":"54992c9a-3e5c-4bfa-bed4-858fbbaac3be","Type":"ContainerStarted","Data":"2abeb17dbadb2f3a3247600c83554ae25c9ac31138fb0f05a6344ba6beb5d54d"} Sep 09 23:00:33.259420 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:33.259381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerStarted","Data":"f212101b2d7b2fe324b9a7cb42c01ad0a0ab5bb6195552a183c2591bb182aef7"} Sep 09 23:00:38.278221 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:38.278171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerStarted","Data":"aa6fbd90400e46cc30f143db23115cdd04c75719ed317be9d8cce1fe72109306"} Sep 09 23:00:38.280467 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:38.280047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" event={"ID":"54992c9a-3e5c-4bfa-bed4-858fbbaac3be","Type":"ContainerStarted","Data":"b6b6f77666b34750da2b6414f6c5937a808261326cd990ae0282969de386eb68"} Sep 09 23:00:38.280467 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:38.280393 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:38.282241 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:38.282200 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" podUID="54992c9a-3e5c-4bfa-bed4-858fbbaac3be" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Sep 09 23:00:38.294994 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:38.294946 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" podStartSLOduration=2.4311542250000002 podStartE2EDuration="8.294931026s" totalImagesPullingTime="5.863776801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:38.294557632 +0000 UTC m=+77.852715631" watchObservedRunningTime="2026-09-09 23:00:38.294931026 +0000 UTC m=+77.853088996" Sep 09 23:00:39.285289 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:39.285255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerStarted","Data":"0c191865e4337e01d7a1e883519fd4c35f6969c9c27a59007b0704ba47c8e998"} Sep 09 23:00:39.285670 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:39.285300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerStarted","Data":"17105a957bbd076bef0146f49caf0d61e4b2ec5db5d744bd5e754d82a4aa5df5"} Sep 09 23:00:39.286590 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:39.286551 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:00:39.303260 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:39.303211 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" podStartSLOduration=3.436676543 podStartE2EDuration="9.303196394s" totalImagesPullingTime="5.866519851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:00:39.302890696 +0000 UTC m=+78.861048671" watchObservedRunningTime="2026-09-09 23:00:39.303196394 +0000 UTC m=+78.861354369" Sep 09 23:00:59.606271 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:00:59.606183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:00:59.606696 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:59.606331 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:00:59.606696 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:00:59.606391 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:02:03.606375604 +0000 UTC m=+163.164533557 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 23:01:03.261996 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:01:03.261963 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j65hg" Sep 09 23:01:30.616387 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:01:30.616343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:01:30.616891 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:01:30.616499 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:01:30.616891 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:01:30.616594 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:32.616552647 +0000 UTC m=+252.174710601 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : secret "metrics-daemon-secret" not found Sep 09 23:01:58.734689 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:01:58.734647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mnfnq" podUID="ab69d037-2670-425d-a18c-b306d0ab6c99" Sep 09 23:01:58.933942 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:01:58.933905 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 23:01:59.516751 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:01:59.516720 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mnfnq" Sep 09 23:02:03.651728 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:03.651672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:02:03.652204 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:02:03.651822 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:02:03.652204 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:02:03.651899 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls podName:ab69d037-2670-425d-a18c-b306d0ab6c99 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:05.651883143 +0000 UTC m=+285.210041096 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls") pod "dns-default-mnfnq" (UID: "ab69d037-2670-425d-a18c-b306d0ab6c99") : secret "dns-default-metrics-tls" not found Sep 09 23:02:09.922394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:09.922357 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:02:38.629023 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:38.628942 2561 generic.go:356] "Generic (PLEG): container finished" podID="54992c9a-3e5c-4bfa-bed4-858fbbaac3be" containerID="b6b6f77666b34750da2b6414f6c5937a808261326cd990ae0282969de386eb68" exitCode=1 Sep 09 23:02:38.629023 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:38.628982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" event={"ID":"54992c9a-3e5c-4bfa-bed4-858fbbaac3be","Type":"ContainerDied","Data":"b6b6f77666b34750da2b6414f6c5937a808261326cd990ae0282969de386eb68"} Sep 09 23:02:38.629496 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:38.629306 2561 scope.go:117] "RemoveContainer" containerID="b6b6f77666b34750da2b6414f6c5937a808261326cd990ae0282969de386eb68" Sep 09 23:02:39.286194 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:39.286158 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:02:39.633846 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:39.633757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" event={"ID":"54992c9a-3e5c-4bfa-bed4-858fbbaac3be","Type":"ContainerStarted","Data":"082fad8d6454c53ef87f777a2fbfde09e2e0f1155a2f050cda7a70753240f20c"} Sep 09 23:02:39.634248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:39.634003 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:02:39.634586 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:39.634554 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564998459-mqf4t" Sep 09 23:02:49.866663 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:02:49.866624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:18.425595 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:18.425531 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:18.530073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:18.530041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:20.704042 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:20.704009 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:20.755334 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:20.755283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:22.006757 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.006724 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rlp7l"] Sep 09 23:03:22.009113 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.009090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.011805 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.011781 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:03:22.011805 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.011807 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:03:22.011979 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.011843 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:03:22.011979 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.011781 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:03:22.011979 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.011949 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nh9jh\"" Sep 09 23:03:22.014104 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.014050 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:22.021061 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.021037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlp7l"] Sep 09 23:03:22.082196 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.082169 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:22.091714 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.091682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.091887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.091737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52e23bbd-2483-434e-9a59-1c6ec01fad66-crio-socket\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.091887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.091762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52e23bbd-2483-434e-9a59-1c6ec01fad66-data-volume\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.091887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.091845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hhg\" (UniqueName: \"kubernetes.io/projected/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-api-access-w6hhg\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.092047 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.091972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192332 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hhg\" (UniqueName: \"kubernetes.io/projected/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-api-access-w6hhg\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52e23bbd-2483-434e-9a59-1c6ec01fad66-crio-socket\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52e23bbd-2483-434e-9a59-1c6ec01fad66-data-volume\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.192512 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:03:22.192537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52e23bbd-2483-434e-9a59-1c6ec01fad66-crio-socket\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.192887 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.192532 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:22.192887 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.192621 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:22.692598542 +0000 UTC m=+242.250756520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : configmap "kube-rbac-proxy" not found Sep 09 23:03:22.192887 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.192649 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:22.692630852 +0000 UTC m=+242.250788819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:22.192887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.192761 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52e23bbd-2483-434e-9a59-1c6ec01fad66-data-volume\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.201222 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.201197 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hhg\" (UniqueName: \"kubernetes.io/projected/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-api-access-w6hhg\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.696145 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.696108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.696145 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:22.696146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:22.696363 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.696230 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:03:22.696363 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.696276 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:22.696363 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.696333 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:23.696313857 +0000 UTC m=+243.254471825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:22.696363 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:22.696351 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:23.696342437 +0000 UTC m=+243.254500392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : configmap "kube-rbac-proxy" not found Sep 09 23:03:23.370615 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.370583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:23.435704 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.435671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:23.703530 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.703504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:23.703711 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.703539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:23.703711 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:23.703640 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:03:23.703711 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:23.703656 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:23.703711 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:23.703699 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:25.703686647 +0000 UTC m=+245.261844614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:23.703711 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:23.703711 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:25.703705376 +0000 UTC m=+245.261863330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : configmap "kube-rbac-proxy" not found Sep 09 23:03:23.799749 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.799717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:23.957366 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:23.957290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpmns_5ecffe0f-bc84-4287-aec4-92c4992e1f14/dns-node-resolver/0.log" Sep 09 23:03:24.086970 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:24.086934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:24.177849 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:24.177820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:25.096694 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:25.096662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:25.154044 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:25.154019 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzkxv_372ef220-706c-4c53-8249-ee2943d587ac/node-ca/0.log" Sep 09 23:03:25.718912 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:25.718876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:25.718912 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:25.718913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:25.719127 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:25.719023 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:03:25.719127 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:25.719086 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:29.719069859 +0000 UTC m=+249.277227813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : configmap "kube-rbac-proxy" not found Sep 09 23:03:25.719127 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:25.719028 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:25.719247 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:25.719160 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:29.719148858 +0000 UTC m=+249.277306813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:25.954379 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:25.954350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hgsdj_d6e94f83-bb0c-42e6-9c16-6e696a6432c6/serve-healthcheck-canary/0.log" Sep 09 23:03:26.696536 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:26.696506 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:29.748350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:29.748303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:29.748350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:29.748354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:29.748803 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:29.748421 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:03:29.748803 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:29.748469 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:29.748803 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:29.748482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:37.74846751 +0000 UTC m=+257.306625464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : configmap "kube-rbac-proxy" not found Sep 09 23:03:29.748803 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:29.748507 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:37.748496419 +0000 UTC m=+257.306654372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:29.999869 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:29.999781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:30.120673 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:30.120639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:30.196425 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:30.196389 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:30.289975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:30.289884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:30.353124 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:30.353092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:30.722354 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:30.722325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:31.481346 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:31.481311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:32.110367 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:32.110340 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:32.304999 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:32.304965 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:32.523243 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:32.523191 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:32.670070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:32.670034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:03:32.670258 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:32.670205 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:03:32.670329 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:32.670282 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs podName:f7353398-c9d2-4d2a-9af8-ed0922fd0449 nodeName:}" failed. No retries permitted until 2026-09-09 23:05:34.670261095 +0000 UTC m=+374.228419052 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs") pod "network-metrics-daemon-n6mk7" (UID: "f7353398-c9d2-4d2a-9af8-ed0922fd0449") : secret "metrics-daemon-secret" not found Sep 09 23:03:32.896661 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:32.896541 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:33.639116 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:33.639075 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:33.738233 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:33.738197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:33.922014 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:33.921975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:34.090781 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:34.090746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:34.285968 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:34.285723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:34.479141 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:34.479106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:34.677893 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:34.677861 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:35.254640 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:35.254605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:35.700241 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:35.700210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:36.084628 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:36.084528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:36.341617 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:36.341477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:36.508986 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:36.508954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:36.600856 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:36.600779 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:36.713228 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:36.713201 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:37.695500 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:37.695442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:37.810506 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:37.810471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:37.810506 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:37.810505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:37.810928 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:37.810637 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:03:37.810928 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:03:37.810696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls podName:52e23bbd-2483-434e-9a59-1c6ec01fad66 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.810677759 +0000 UTC m=+273.368835726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rlp7l" (UID: "52e23bbd-2483-434e-9a59-1c6ec01fad66") : secret "insights-runtime-extractor-tls" not found Sep 09 23:03:37.811018 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:37.810999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52e23bbd-2483-434e-9a59-1c6ec01fad66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:38.094921 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:38.094832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:38.323466 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:38.323429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:38.500344 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:38.500312 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:38.685544 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:38.685509 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:38.907798 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:38.907709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:39.292688 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:39.292648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:39.882771 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:39.882734 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:40.283195 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:40.283163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:40.436361 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:40.436326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:40.491638 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:40.491609 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:40.889196 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:40.889161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:41.702870 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:41.702832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:41.761549 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:41.761514 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:45.265123 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:45.265087 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:45.353607 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:45.353546 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:45.456450 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:45.456414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:53.142795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.142760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:53.239837 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.239803 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:53.315971 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.315935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:53.437430 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.437393 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:53.820867 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.820780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:53.823227 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:53.823203 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52e23bbd-2483-434e-9a59-1c6ec01fad66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rlp7l\" (UID: \"52e23bbd-2483-434e-9a59-1c6ec01fad66\") " pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:54.118621 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:54.118500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rlp7l" Sep 09 23:03:54.387035 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:54.386955 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rlp7l"] Sep 09 23:03:54.390282 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:03:54.390256 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e23bbd_2483_434e_9a59_1c6ec01fad66.slice/crio-e768a3064bb2d754b0ec3b3e277e0c82ce5321c9ae9bd608e6e80923ee3b1728 WatchSource:0}: Error finding container e768a3064bb2d754b0ec3b3e277e0c82ce5321c9ae9bd608e6e80923ee3b1728: Status 404 returned error can't find the container with id e768a3064bb2d754b0ec3b3e277e0c82ce5321c9ae9bd608e6e80923ee3b1728 Sep 09 23:03:54.852824 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:54.852779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlp7l" event={"ID":"52e23bbd-2483-434e-9a59-1c6ec01fad66","Type":"ContainerStarted","Data":"6363899684edbc46429ce7262de8b1cdb5e9bb44b433ccd8be5bebedf25b1262"} Sep 09 23:03:54.852998 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:54.852841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlp7l" event={"ID":"52e23bbd-2483-434e-9a59-1c6ec01fad66","Type":"ContainerStarted","Data":"e768a3064bb2d754b0ec3b3e277e0c82ce5321c9ae9bd608e6e80923ee3b1728"} Sep 09 23:03:55.330595 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:55.330549 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:55.401445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:55.401418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:55.566452 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:55.566421 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:55.858075 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:55.858041 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlp7l" event={"ID":"52e23bbd-2483-434e-9a59-1c6ec01fad66","Type":"ContainerStarted","Data":"13d6b3da0c9cd23364fc58b23712b5082a8e8d66caeb1e459586010e1bef4949"} Sep 09 23:03:56.862658 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:56.862551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rlp7l" event={"ID":"52e23bbd-2483-434e-9a59-1c6ec01fad66","Type":"ContainerStarted","Data":"80ffc7a4bdbdea1627decef24f7699c8c76b5cb60b31ad1396550de1d51a4015"} Sep 09 23:03:56.884540 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:56.884492 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rlp7l" podStartSLOduration=33.836246478 podStartE2EDuration="35.884474467s" totalImagesPullingTime="2.048227989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:56.882674033 +0000 UTC m=+276.440832029" watchObservedRunningTime="2026-09-09 23:03:56.884474467 +0000 UTC m=+276.442632444" Sep 09 23:03:57.752865 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:57.752829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:59.690238 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.690203 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:59.712821 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.712793 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q6c4x"] Sep 09 23:03:59.715172 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.715151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.718386 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.718365 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:03:59.718483 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.718378 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jc9mn\"" Sep 09 23:03:59.719595 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.719560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:03:59.719702 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.719598 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:03:59.719702 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.719647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:03:59.719702 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.719564 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:03:59.719894 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.719851 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:03:59.765817 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-wtmp\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.765817 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-textfile\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766039 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-root\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766039 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-metrics-client-ca\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766039 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-tls\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766039 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7zq\" (UniqueName: \"kubernetes.io/projected/821de3ba-c191-444f-ac00-de83168ea3db-kube-api-access-rj7zq\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766039 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.765991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766196 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.766049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-sys\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.766196 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.766069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.785734 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.785695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:59.866591 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-metrics-client-ca\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866591 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-tls\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866821 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7zq\" (UniqueName: \"kubernetes.io/projected/821de3ba-c191-444f-ac00-de83168ea3db-kube-api-access-rj7zq\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866821 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866945 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-sys\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866945 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.866945 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-wtmp\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867105 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-sys\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867105 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.866935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-textfile\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867105 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-root\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867105 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867068 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-wtmp\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867287 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821de3ba-c191-444f-ac00-de83168ea3db-root\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867287 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867229 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-textfile\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867287 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867235 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-metrics-client-ca\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.867423 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.867405 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.869666 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.869646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.869760 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.869712 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821de3ba-c191-444f-ac00-de83168ea3db-node-exporter-tls\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.874549 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.874526 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7zq\" (UniqueName: \"kubernetes.io/projected/821de3ba-c191-444f-ac00-de83168ea3db-kube-api-access-rj7zq\") pod \"node-exporter-q6c4x\" (UID: \"821de3ba-c191-444f-ac00-de83168ea3db\") " pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:03:59.879917 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.879895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:03:59.980992 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:03:59.980909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:00.024353 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.024314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6c4x" Sep 09 23:04:00.033300 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:00.033267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821de3ba_c191_444f_ac00_de83168ea3db.slice/crio-d5489a345c7a892912c77a64e97de82d2285f8fdb4d08f7f44b28d705c09ee80 WatchSource:0}: Error finding container d5489a345c7a892912c77a64e97de82d2285f8fdb4d08f7f44b28d705c09ee80: Status 404 returned error can't find the container with id d5489a345c7a892912c77a64e97de82d2285f8fdb4d08f7f44b28d705c09ee80 Sep 09 23:04:00.171015 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.170983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:00.499117 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.499083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:00.701948 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.701897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:00.778145 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.778044 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:00.876713 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:00.876680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4x" event={"ID":"821de3ba-c191-444f-ac00-de83168ea3db","Type":"ContainerStarted","Data":"d5489a345c7a892912c77a64e97de82d2285f8fdb4d08f7f44b28d705c09ee80"} Sep 09 23:04:01.039466 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:01.039425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:01.881173 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:01.881138 2561 generic.go:356] "Generic (PLEG): container finished" podID="821de3ba-c191-444f-ac00-de83168ea3db" containerID="1751554f651731459f6b9a0701336953d2fa861040cf02c2bec0e05a9d57150f" exitCode=0 Sep 09 23:04:01.881552 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:01.881204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4x" event={"ID":"821de3ba-c191-444f-ac00-de83168ea3db","Type":"ContainerDied","Data":"1751554f651731459f6b9a0701336953d2fa861040cf02c2bec0e05a9d57150f"} Sep 09 23:04:02.518057 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:04:02.517995 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mnfnq" podUID="ab69d037-2670-425d-a18c-b306d0ab6c99" Sep 09 23:04:02.679423 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.679384 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:02.778052 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.777958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:02.884980 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.884914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:02.887080 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.887061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:02.887080 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.887072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4x" event={"ID":"821de3ba-c191-444f-ac00-de83168ea3db","Type":"ContainerStarted","Data":"fa1416d0a840d24decce829c2f963a6ae87a12579478b43b4a20debd24204e9d"} Sep 09 23:04:02.887243 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.887149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6c4x" event={"ID":"821de3ba-c191-444f-ac00-de83168ea3db","Type":"ContainerStarted","Data":"efbe3702ef3d823906b193f6c7f3e8faaf2ab8b8db92a66e4f03020a011b70f6"} Sep 09 23:04:02.917239 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:02.917190 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q6c4x" podStartSLOduration=2.858440605 podStartE2EDuration="3.917174563s" totalImagesPullingTime="989.243976ms" totalInitContainerRuntime="69.489982ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:02.916440227 +0000 UTC m=+282.474598221" watchObservedRunningTime="2026-09-09 23:04:02.917174563 +0000 UTC m=+282.475332591" Sep 09 23:04:03.464684 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:03.464642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:03.828532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:03.828435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:03.907858 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:03.907821 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.010182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.010139 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.267028 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.266994 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-685c4d5c58-thw99"] Sep 09 23:04:04.268944 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.268928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.273305 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.273280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 23:04:04.273305 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.273282 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:04:04.273494 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.273435 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 23:04:04.273624 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.273610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 23:04:04.274669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.274649 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1rbebbfkusa0r\"" Sep 09 23:04:04.274785 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.274767 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gbdj5\"" Sep 09 23:04:04.290440 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.290414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-685c4d5c58-thw99"] Sep 09 23:04:04.298710 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-metrics-server-audit-profiles\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.298846 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-tls\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.298846 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.298944 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8286\" (UniqueName: \"kubernetes.io/projected/c012dd1a-5c5b-4e60-b60e-9ef072c29292-kube-api-access-k8286\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.298944 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c012dd1a-5c5b-4e60-b60e-9ef072c29292-audit-log\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.299022 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-client-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.299022 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.298979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-client-certs\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.344904 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.344871 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.399993 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.399953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-client-certs\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400154 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-metrics-server-audit-profiles\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400198 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-tls\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400249 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400249 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8286\" (UniqueName: \"kubernetes.io/projected/c012dd1a-5c5b-4e60-b60e-9ef072c29292-kube-api-access-k8286\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c012dd1a-5c5b-4e60-b60e-9ef072c29292-audit-log\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-client-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.400704 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.400677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c012dd1a-5c5b-4e60-b60e-9ef072c29292-audit-log\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.401062 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.401044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-metrics-server-audit-profiles\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.401136 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.401084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c012dd1a-5c5b-4e60-b60e-9ef072c29292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.402730 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.402712 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-client-certs\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.403286 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.403258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-secret-metrics-server-tls\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.403356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.403269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c012dd1a-5c5b-4e60-b60e-9ef072c29292-client-ca-bundle\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.418491 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.418468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8286\" (UniqueName: \"kubernetes.io/projected/c012dd1a-5c5b-4e60-b60e-9ef072c29292-kube-api-access-k8286\") pod \"metrics-server-685c4d5c58-thw99\" (UID: \"c012dd1a-5c5b-4e60-b60e-9ef072c29292\") " pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.465030 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.464991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.577802 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.577716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:04.633717 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.632911 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.871855 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.871773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-685c4d5c58-thw99"] Sep 09 23:04:04.874445 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:04.874417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc012dd1a_5c5b_4e60_b60e_9ef072c29292.slice/crio-a44f5ffc75b6ca2fc1d4b506ad00bb114bb0018c63b466e27554961bf96e9c43 WatchSource:0}: Error finding container a44f5ffc75b6ca2fc1d4b506ad00bb114bb0018c63b466e27554961bf96e9c43: Status 404 returned error can't find the container with id a44f5ffc75b6ca2fc1d4b506ad00bb114bb0018c63b466e27554961bf96e9c43 Sep 09 23:04:04.885216 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.885188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:04.895118 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:04.895092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" event={"ID":"c012dd1a-5c5b-4e60-b60e-9ef072c29292","Type":"ContainerStarted","Data":"a44f5ffc75b6ca2fc1d4b506ad00bb114bb0018c63b466e27554961bf96e9c43"} Sep 09 23:04:05.708406 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:05.708364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:05.711229 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:05.711201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab69d037-2670-425d-a18c-b306d0ab6c99-metrics-tls\") pod \"dns-default-mnfnq\" (UID: \"ab69d037-2670-425d-a18c-b306d0ab6c99\") " pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:05.893023 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:05.892970 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7bbt\"" Sep 09 23:04:05.898672 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:05.898640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:06.024336 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.024302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:06.179344 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.179317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mnfnq"] Sep 09 23:04:06.361072 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.360996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:06.370781 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:06.370750 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab69d037_2670_425d_a18c_b306d0ab6c99.slice/crio-5a6ef38d0ddc76114a7aebe5586b1b237f7f09b5c3eba9ec9ad9f7116ae98c6c WatchSource:0}: Error finding container 5a6ef38d0ddc76114a7aebe5586b1b237f7f09b5c3eba9ec9ad9f7116ae98c6c: Status 404 returned error can't find the container with id 5a6ef38d0ddc76114a7aebe5586b1b237f7f09b5c3eba9ec9ad9f7116ae98c6c Sep 09 23:04:06.589863 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.589825 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:06.902639 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.902603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" event={"ID":"c012dd1a-5c5b-4e60-b60e-9ef072c29292","Type":"ContainerStarted","Data":"980e2761a8a8f11a533cafe74f76d0afd841b8eebfa96b9ef47b47622aca3c17"} Sep 09 23:04:06.903726 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.903704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mnfnq" event={"ID":"ab69d037-2670-425d-a18c-b306d0ab6c99","Type":"ContainerStarted","Data":"5a6ef38d0ddc76114a7aebe5586b1b237f7f09b5c3eba9ec9ad9f7116ae98c6c"} Sep 09 23:04:06.926241 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:06.926183 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" podStartSLOduration=1.4056207760000001 podStartE2EDuration="2.926165471s" totalImagesPullingTime="1.520544695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:06.92465426 +0000 UTC m=+286.482812262" watchObservedRunningTime="2026-09-09 23:04:06.926165471 +0000 UTC m=+286.484323851" Sep 09 23:04:07.932151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:07.932070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:08.017779 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.017690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:08.107175 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.107142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:08.640743 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.640712 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:08.739025 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.739002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:08.912774 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.912683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mnfnq" event={"ID":"ab69d037-2670-425d-a18c-b306d0ab6c99","Type":"ContainerStarted","Data":"b8c01d44be68d95cf0d954245b9fd93c891df39e610c8482bbbf71de7553a501"} Sep 09 23:04:08.912774 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.912768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mnfnq" event={"ID":"ab69d037-2670-425d-a18c-b306d0ab6c99","Type":"ContainerStarted","Data":"67816744a73a9d8e620f7f057e2b5d1c7add9da036491b2180fe0a16773175e7"} Sep 09 23:04:08.912985 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.912826 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:08.934466 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:08.934421 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mnfnq" podStartSLOduration=251.73628364 podStartE2EDuration="4m13.934407145s" totalImagesPullingTime="2.198123505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:08.933338953 +0000 UTC m=+288.491496928" watchObservedRunningTime="2026-09-09 23:04:08.934407145 +0000 UTC m=+288.492565121" Sep 09 23:04:11.738025 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:11.737989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:11.850099 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:11.850055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:12.923627 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:04:12.923558 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6mk7" podUID="f7353398-c9d2-4d2a-9af8-ed0922fd0449" Sep 09 23:04:18.627522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.627488 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-b48b6"] Sep 09 23:04:18.629422 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.629407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:18.632077 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.632059 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hk2bf\"" Sep 09 23:04:18.632158 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.632063 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:04:18.632158 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.632153 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:04:18.639098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.639076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-b48b6"] Sep 09 23:04:18.650550 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.650527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:18.705804 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.705763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtm8\" (UniqueName: \"kubernetes.io/projected/949be171-a0cf-4809-98f3-b00cf6820a31-kube-api-access-txtm8\") pod \"downloads-85d98c998f-b48b6\" (UID: \"949be171-a0cf-4809-98f3-b00cf6820a31\") " pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:18.752007 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.751957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:18.806364 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.806330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtm8\" (UniqueName: \"kubernetes.io/projected/949be171-a0cf-4809-98f3-b00cf6820a31-kube-api-access-txtm8\") pod \"downloads-85d98c998f-b48b6\" (UID: \"949be171-a0cf-4809-98f3-b00cf6820a31\") " pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:18.807285 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.807260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:18.815585 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.815542 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtm8\" (UniqueName: \"kubernetes.io/projected/949be171-a0cf-4809-98f3-b00cf6820a31-kube-api-access-txtm8\") pod \"downloads-85d98c998f-b48b6\" (UID: \"949be171-a0cf-4809-98f3-b00cf6820a31\") " pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:18.920420 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.920394 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mnfnq" Sep 09 23:04:18.937968 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.937932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:18.944408 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:18.944379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.215304 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.215191 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-b48b6"] Sep 09 23:04:19.217396 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:19.217367 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949be171_a0cf_4809_98f3_b00cf6820a31.slice/crio-352e2cf54346aaef133eda7bf619ed856aa941c9ae7a36bc9fb3bc850d65fbcc WatchSource:0}: Error finding container 352e2cf54346aaef133eda7bf619ed856aa941c9ae7a36bc9fb3bc850d65fbcc: Status 404 returned error can't find the container with id 352e2cf54346aaef133eda7bf619ed856aa941c9ae7a36bc9fb3bc850d65fbcc Sep 09 23:04:19.325207 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.325168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.391448 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.391412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.727616 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.727550 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.789407 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.789369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.942501 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.942470 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:19.954132 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.954098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-b48b6" event={"ID":"949be171-a0cf-4809-98f3-b00cf6820a31","Type":"ContainerStarted","Data":"352e2cf54346aaef133eda7bf619ed856aa941c9ae7a36bc9fb3bc850d65fbcc"} Sep 09 23:04:19.996946 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:19.996844 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:20.135917 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.135886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:20.385460 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.385379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:20.625351 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.625301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:20.786279 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.786242 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:04:20.788452 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.788428 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:04:20.790312 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:20.790291 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:04:22.123919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:22.123879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:22.187344 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:22.187304 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:22.364235 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:22.364202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:22.462114 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:22.462077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:24.577871 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:24.577837 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:24.578267 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:24.577903 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:25.440500 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.440465 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:04:25.472747 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.472715 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:04:25.472932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.472852 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.476262 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.476235 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:04:25.476415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.476277 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:04:25.476415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.476294 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cbgfb\"" Sep 09 23:04:25.476415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.476241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:04:25.476415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.476241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:04:25.477648 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.477629 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:04:25.565066 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.565066 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.565310 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb94k\" (UniqueName: \"kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.565310 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.565310 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.565438 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.565316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666243 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.666715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.666543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb94k\" (UniqueName: \"kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.667543 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.667494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.667765 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.667736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.667983 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.667961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.669374 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.669350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.669737 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.669716 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.681081 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.681053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb94k\" (UniqueName: \"kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k\") pod \"console-7fb4597b-knxdz\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.783787 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.783690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:25.922096 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:25.922057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:04:26.079086 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:26.079061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:04:26.081733 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:26.081706 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e74abed_fa35_477f_8ba0_4cfa0b14f60c.slice/crio-9330244b53e1a9b472e7e8426050f6855d90a30769f55c9ee2c24455ecbdf7ea WatchSource:0}: Error finding container 9330244b53e1a9b472e7e8426050f6855d90a30769f55c9ee2c24455ecbdf7ea: Status 404 returned error can't find the container with id 9330244b53e1a9b472e7e8426050f6855d90a30769f55c9ee2c24455ecbdf7ea Sep 09 23:04:26.083984 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:26.083961 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:04:26.712415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:26.712377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:26.773426 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:26.773384 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:26.981989 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:26.981900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb4597b-knxdz" event={"ID":"3e74abed-fa35-477f-8ba0-4cfa0b14f60c","Type":"ContainerStarted","Data":"9330244b53e1a9b472e7e8426050f6855d90a30769f55c9ee2c24455ecbdf7ea"} Sep 09 23:04:28.041333 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:28.041289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:28.100534 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:28.100491 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:28.943143 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:28.943102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:29.055513 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:29.055476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:31.748058 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:31.748013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:31.824200 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:31.824151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:36.146683 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.146625 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:36.202818 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.202786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:36.571120 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.571095 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:04:36.572927 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.572912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.581921 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.581899 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:04:36.585909 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.585856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:04:36.662709 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662810 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662810 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662810 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662958 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662958 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.662958 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.662896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8jtx\" (UniqueName: \"kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764237 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8jtx\" (UniqueName: \"kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.764445 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.764412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.765328 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.765183 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.765328 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.765270 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.765328 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.765321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.765586 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.765536 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.767290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.767262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.767439 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.767421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.774061 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.774035 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8jtx\" (UniqueName: \"kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx\") pod \"console-7c94d6b697-qzhcn\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:36.882519 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:36.882431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:37.019982 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.019942 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb4597b-knxdz" event={"ID":"3e74abed-fa35-477f-8ba0-4cfa0b14f60c","Type":"ContainerStarted","Data":"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d"} Sep 09 23:04:37.021929 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.021897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-b48b6" event={"ID":"949be171-a0cf-4809-98f3-b00cf6820a31","Type":"ContainerStarted","Data":"5deee26d8c408aa54068053d6ff9ac086da0343c0d065bcab405c68914034514"} Sep 09 23:04:37.022074 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.022025 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:37.035728 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.035697 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-b48b6" Sep 09 23:04:37.038406 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.038354 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fb4597b-knxdz" podStartSLOduration=1.5507354279999999 podStartE2EDuration="12.038338983s" totalImagesPullingTime="10.487603555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:37.037741087 +0000 UTC m=+316.595899094" watchObservedRunningTime="2026-09-09 23:04:37.038338983 +0000 UTC m=+316.596496959" Sep 09 23:04:37.055248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.055200 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-b48b6" podStartSLOduration=1.6679630140000001 podStartE2EDuration="19.055186816s" totalImagesPullingTime="17.387223802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:37.053877055 +0000 UTC m=+316.612035059" watchObservedRunningTime="2026-09-09 23:04:37.055186816 +0000 UTC m=+316.613344792" Sep 09 23:04:37.163587 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:37.163544 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:04:37.166156 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:04:37.166128 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76689870_08b8_4b5e_ac11_a088b161a98b.slice/crio-5ae012356248fabdfe0ccd1591e917ed0b8faeca96f8c68077b2b41142fc7dae WatchSource:0}: Error finding container 5ae012356248fabdfe0ccd1591e917ed0b8faeca96f8c68077b2b41142fc7dae: Status 404 returned error can't find the container with id 5ae012356248fabdfe0ccd1591e917ed0b8faeca96f8c68077b2b41142fc7dae Sep 09 23:04:38.028949 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:38.028902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d6b697-qzhcn" event={"ID":"76689870-08b8-4b5e-ac11-a088b161a98b","Type":"ContainerStarted","Data":"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454"} Sep 09 23:04:38.029144 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:38.028977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d6b697-qzhcn" event={"ID":"76689870-08b8-4b5e-ac11-a088b161a98b","Type":"ContainerStarted","Data":"5ae012356248fabdfe0ccd1591e917ed0b8faeca96f8c68077b2b41142fc7dae"} Sep 09 23:04:38.063879 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:38.063817 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c94d6b697-qzhcn" podStartSLOduration=2.063792337 podStartE2EDuration="2.063792337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:38.062290352 +0000 UTC m=+317.620448353" watchObservedRunningTime="2026-09-09 23:04:38.063792337 +0000 UTC m=+317.621950314" Sep 09 23:04:40.738929 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:40.738894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:41.706025 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:41.705983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:41.779873 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:41.779837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:42.960816 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:42.960780 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:44.584884 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:44.584845 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:44.590415 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:44.590380 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-685c4d5c58-thw99" Sep 09 23:04:45.784442 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:45.784407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:45.784819 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:45.784470 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:45.790147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:45.790119 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:46.065919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:46.065850 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:04:46.882870 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:46.882831 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:46.883342 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:46.882896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:46.887318 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:46.887297 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:47.069820 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:47.069796 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:04:47.113387 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:47.113360 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:04:49.557980 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:49.557948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:49.615166 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:49.615121 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:50.655153 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:50.655119 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" podUID="7f686c56-ee3d-46cf-83d3-6fb564b09b41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:04:55.155706 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:55.155664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:55.211112 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:55.211083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:56.702040 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:56.702006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:04:56.900832 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:04:56.900796 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:00.655179 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:00.655138 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" podUID="7f686c56-ee3d-46cf-83d3-6fb564b09b41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:05:10.654816 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:10.654774 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" podUID="7f686c56-ee3d-46cf-83d3-6fb564b09b41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:05:10.655194 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:10.654842 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" Sep 09 23:05:10.655307 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:10.655279 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0c191865e4337e01d7a1e883519fd4c35f6969c9c27a59007b0704ba47c8e998"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 23:05:10.655343 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:10.655328 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" podUID="7f686c56-ee3d-46cf-83d3-6fb564b09b41" containerName="service-proxy" containerID="cri-o://0c191865e4337e01d7a1e883519fd4c35f6969c9c27a59007b0704ba47c8e998" gracePeriod=30 Sep 09 23:05:11.154699 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:11.154653 2561 generic.go:356] "Generic (PLEG): container finished" podID="7f686c56-ee3d-46cf-83d3-6fb564b09b41" containerID="0c191865e4337e01d7a1e883519fd4c35f6969c9c27a59007b0704ba47c8e998" exitCode=2 Sep 09 23:05:11.154863 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:11.154709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerDied","Data":"0c191865e4337e01d7a1e883519fd4c35f6969c9c27a59007b0704ba47c8e998"} Sep 09 23:05:11.154863 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:11.154754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54f44df44c-gr7gs" event={"ID":"7f686c56-ee3d-46cf-83d3-6fb564b09b41","Type":"ContainerStarted","Data":"70d77e027dc2b12fcb86fa808e959ed6c3a237628157495263e0a7ff6b158c22"} Sep 09 23:05:11.708126 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:11.708094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:11.767290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:11.767260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:13.089651 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.089604 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fb4597b-knxdz" podUID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" containerName="console" containerID="cri-o://0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d" gracePeriod=15 Sep 09 23:05:13.355539 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.355482 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:05:13.456674 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456634 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.456861 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.456861 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb94k\" (UniqueName: \"kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.456861 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456753 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.456861 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456778 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.456861 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.456822 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert\") pod \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\" (UID: \"3e74abed-fa35-477f-8ba0-4cfa0b14f60c\") " Sep 09 23:05:13.457184 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.457080 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:05:13.457244 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.457189 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:05:13.457416 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.457390 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config" (OuterVolumeSpecName: "console-config") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:05:13.459239 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.459211 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:05:13.459331 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.459246 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:05:13.459331 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.459324 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k" (OuterVolumeSpecName: "kube-api-access-wb94k") pod "3e74abed-fa35-477f-8ba0-4cfa0b14f60c" (UID: "3e74abed-fa35-477f-8ba0-4cfa0b14f60c"). InnerVolumeSpecName "kube-api-access-wb94k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:05:13.558101 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558062 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:13.558101 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558094 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-service-ca\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:13.558293 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558108 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-oauth-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:13.558293 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558121 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb94k\" (UniqueName: \"kubernetes.io/projected/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-kube-api-access-wb94k\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:13.558293 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558132 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-oauth-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:13.558293 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:13.558143 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e74abed-fa35-477f-8ba0-4cfa0b14f60c-console-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:05:14.165887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.165851 2561 generic.go:356] "Generic (PLEG): container finished" podID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" containerID="0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d" exitCode=0 Sep 09 23:05:14.166295 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.165896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb4597b-knxdz" event={"ID":"3e74abed-fa35-477f-8ba0-4cfa0b14f60c","Type":"ContainerDied","Data":"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d"} Sep 09 23:05:14.166295 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.165916 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb4597b-knxdz" Sep 09 23:05:14.166295 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.165947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb4597b-knxdz" event={"ID":"3e74abed-fa35-477f-8ba0-4cfa0b14f60c","Type":"ContainerDied","Data":"9330244b53e1a9b472e7e8426050f6855d90a30769f55c9ee2c24455ecbdf7ea"} Sep 09 23:05:14.166295 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.165988 2561 scope.go:117] "RemoveContainer" containerID="0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d" Sep 09 23:05:14.184867 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.184843 2561 scope.go:117] "RemoveContainer" containerID="0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d" Sep 09 23:05:14.185193 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:05:14.185167 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d\": container with ID starting with 0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d not found: ID does not exist" containerID="0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d" Sep 09 23:05:14.185259 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.185205 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d"} err="failed to get container status \"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d\": rpc error: code = NotFound desc = could not find container \"0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d\": container with ID starting with 0857881a74c21f7623f5c617e161140182dc164b7f3d670a10857d8e2979ce4d not found: ID does not exist" Sep 09 23:05:14.185865 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.185850 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:05:14.188993 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.188974 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fb4597b-knxdz"] Sep 09 23:05:14.926725 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:14.926684 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" path="/var/lib/kubelet/pods/3e74abed-fa35-477f-8ba0-4cfa0b14f60c/volumes" Sep 09 23:05:15.631327 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:15.631294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:15.687235 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:15.687202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:16.169053 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:16.169021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:16.286735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:16.286699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:18.961848 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:18.961812 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:19.167054 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:19.167013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:27.244011 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.243976 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:05:27.244478 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.244230 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" containerName="console" Sep 09 23:05:27.244478 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.244242 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" containerName="console" Sep 09 23:05:27.244478 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.244296 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e74abed-fa35-477f-8ba0-4cfa0b14f60c" containerName="console" Sep 09 23:05:27.246830 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.246816 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.259265 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.259245 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:05:27.299562 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.299533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:27.357715 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.357849 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.357849 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.357849 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhhf\" (UniqueName: \"kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.358010 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.358010 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.358010 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.357918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459159 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459292 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459292 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459292 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhhf\" (UniqueName: \"kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459292 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459480 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459480 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.459895 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459863 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.460002 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.459944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.460113 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.460089 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.460163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.460116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.461911 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.461880 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.461990 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.461967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.467904 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.467883 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhhf\" (UniqueName: \"kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf\") pod \"console-7d846fc699-8kwbk\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.555688 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.555605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:27.828096 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:27.828023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:05:27.831313 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:05:27.831292 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8477b614_a91c_4b7a_946f_7b6dd3b885f8.slice/crio-9fedc522894a361dc14db05d46ca8856a695f91c74987ffbb540cb71bf7bd332 WatchSource:0}: Error finding container 9fedc522894a361dc14db05d46ca8856a695f91c74987ffbb540cb71bf7bd332: Status 404 returned error can't find the container with id 9fedc522894a361dc14db05d46ca8856a695f91c74987ffbb540cb71bf7bd332 Sep 09 23:05:28.214027 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:28.213991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d846fc699-8kwbk" event={"ID":"8477b614-a91c-4b7a-946f-7b6dd3b885f8","Type":"ContainerStarted","Data":"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf"} Sep 09 23:05:28.214182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:28.214053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d846fc699-8kwbk" event={"ID":"8477b614-a91c-4b7a-946f-7b6dd3b885f8","Type":"ContainerStarted","Data":"9fedc522894a361dc14db05d46ca8856a695f91c74987ffbb540cb71bf7bd332"} Sep 09 23:05:28.231998 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:28.231957 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d846fc699-8kwbk" podStartSLOduration=1.231945442 podStartE2EDuration="1.231945442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:28.230648725 +0000 UTC m=+367.788806708" watchObservedRunningTime="2026-09-09 23:05:28.231945442 +0000 UTC m=+367.790103418" Sep 09 23:05:34.719484 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:34.719444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:05:34.721856 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:34.721837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7353398-c9d2-4d2a-9af8-ed0922fd0449-metrics-certs\") pod \"network-metrics-daemon-n6mk7\" (UID: \"f7353398-c9d2-4d2a-9af8-ed0922fd0449\") " pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:05:34.926191 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:34.926160 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjfnz\"" Sep 09 23:05:34.933431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:34.933416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6mk7" Sep 09 23:05:35.198622 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:35.198590 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6mk7"] Sep 09 23:05:35.201611 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:05:35.201583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7353398_c9d2_4d2a_9af8_ed0922fd0449.slice/crio-7cd09a824378b76ea086cac4a05c847f088dd2bcd81bf5a1fa0f32b4ed3e1ece WatchSource:0}: Error finding container 7cd09a824378b76ea086cac4a05c847f088dd2bcd81bf5a1fa0f32b4ed3e1ece: Status 404 returned error can't find the container with id 7cd09a824378b76ea086cac4a05c847f088dd2bcd81bf5a1fa0f32b4ed3e1ece Sep 09 23:05:35.237363 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:35.237288 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6mk7" event={"ID":"f7353398-c9d2-4d2a-9af8-ed0922fd0449","Type":"ContainerStarted","Data":"7cd09a824378b76ea086cac4a05c847f088dd2bcd81bf5a1fa0f32b4ed3e1ece"} Sep 09 23:05:36.244720 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:36.244621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6mk7" event={"ID":"f7353398-c9d2-4d2a-9af8-ed0922fd0449","Type":"ContainerStarted","Data":"e75ba9044a9ad5be3b317562626afeb479bc55911d5342b98c66e24c0958cfe8"} Sep 09 23:05:37.250659 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.250627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6mk7" event={"ID":"f7353398-c9d2-4d2a-9af8-ed0922fd0449","Type":"ContainerStarted","Data":"147742ca71b14961f7b028fd34196a981167966f64590381182ec8ec3ceab4c6"} Sep 09 23:05:37.267836 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.267792 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n6mk7" podStartSLOduration=376.352427349 podStartE2EDuration="6m17.267777475s" totalImagesPullingTime="915.350126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 22:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:37.266729389 +0000 UTC m=+376.824887390" watchObservedRunningTime="2026-09-09 23:05:37.267777475 +0000 UTC m=+376.825935452" Sep 09 23:05:37.393311 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.393284 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:37.452965 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.452921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:37.556585 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.556499 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:37.556585 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.556547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:37.561147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:37.561122 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:38.258070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:38.258043 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:05:38.307453 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:38.307416 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:05:38.423852 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:38.423819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:38.527557 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:38.527457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:05:38.596387 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:05:38.596350 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:03.069719 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.069683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:03.170276 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.170241 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:03.328091 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.327994 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c94d6b697-qzhcn" podUID="76689870-08b8-4b5e-ac11-a088b161a98b" containerName="console" containerID="cri-o://b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454" gracePeriod=15 Sep 09 23:06:03.559297 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.559276 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:06:03.727988 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.727956 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728010 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728049 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728071 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8jtx\" (UniqueName: \"kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728088 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728120 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728151 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728135 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert\") pod \"76689870-08b8-4b5e-ac11-a088b161a98b\" (UID: \"76689870-08b8-4b5e-ac11-a088b161a98b\") " Sep 09 23:06:03.728532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728486 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:06:03.728532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728523 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:06:03.728711 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728541 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config" (OuterVolumeSpecName: "console-config") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:06:03.728711 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.728607 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca" (OuterVolumeSpecName: "service-ca") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:06:03.730385 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.730358 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx" (OuterVolumeSpecName: "kube-api-access-c8jtx") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "kube-api-access-c8jtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:06:03.730385 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.730367 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:06:03.730527 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.730404 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76689870-08b8-4b5e-ac11-a088b161a98b" (UID: "76689870-08b8-4b5e-ac11-a088b161a98b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829013 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-console-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829062 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8jtx\" (UniqueName: \"kubernetes.io/projected/76689870-08b8-4b5e-ac11-a088b161a98b-kube-api-access-c8jtx\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829073 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-oauth-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829082 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-trusted-ca-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829090 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76689870-08b8-4b5e-ac11-a088b161a98b-console-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829098 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-oauth-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:03.829398 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:03.829106 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76689870-08b8-4b5e-ac11-a088b161a98b-service-ca\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:06:04.343524 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.343489 2561 generic.go:356] "Generic (PLEG): container finished" podID="76689870-08b8-4b5e-ac11-a088b161a98b" containerID="b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454" exitCode=0 Sep 09 23:06:04.343975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.343535 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c94d6b697-qzhcn" Sep 09 23:06:04.343975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.343559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d6b697-qzhcn" event={"ID":"76689870-08b8-4b5e-ac11-a088b161a98b","Type":"ContainerDied","Data":"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454"} Sep 09 23:06:04.343975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.343632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c94d6b697-qzhcn" event={"ID":"76689870-08b8-4b5e-ac11-a088b161a98b","Type":"ContainerDied","Data":"5ae012356248fabdfe0ccd1591e917ed0b8faeca96f8c68077b2b41142fc7dae"} Sep 09 23:06:04.343975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.343663 2561 scope.go:117] "RemoveContainer" containerID="b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454" Sep 09 23:06:04.351914 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.351898 2561 scope.go:117] "RemoveContainer" containerID="b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454" Sep 09 23:06:04.352193 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:06:04.352176 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454\": container with ID starting with b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454 not found: ID does not exist" containerID="b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454" Sep 09 23:06:04.352229 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.352203 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454"} err="failed to get container status \"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454\": rpc error: code = NotFound desc = could not find container \"b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454\": container with ID starting with b0de1f092beba4225ede76d5a42ea793c70e454c80c391f47817e6835f482454 not found: ID does not exist" Sep 09 23:06:04.376483 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.376450 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:06:04.380992 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.380969 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c94d6b697-qzhcn"] Sep 09 23:06:04.926969 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:04.926937 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76689870-08b8-4b5e-ac11-a088b161a98b" path="/var/lib/kubelet/pods/76689870-08b8-4b5e-ac11-a088b161a98b/volumes" Sep 09 23:06:08.154201 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:08.154171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:34.220795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:34.220760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:34.308836 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:34.308797 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:46.127509 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:46.127397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:46.185978 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:46.185949 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:49.350454 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.350419 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:06:49.350822 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.350661 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76689870-08b8-4b5e-ac11-a088b161a98b" containerName="console" Sep 09 23:06:49.350822 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.350672 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76689870-08b8-4b5e-ac11-a088b161a98b" containerName="console" Sep 09 23:06:49.350822 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.350727 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="76689870-08b8-4b5e-ac11-a088b161a98b" containerName="console" Sep 09 23:06:49.352320 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.352304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.380140 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.380114 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:06:49.399036 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.399001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:49.426176 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9tbd\" (UniqueName: \"kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426176 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426247 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.426394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.426286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.455560 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.455526 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:49.526811 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9tbd\" (UniqueName: \"kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.526974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.526962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.527623 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.527596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.527750 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.527672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.527961 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.527938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.528078 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.528061 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.529610 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.529590 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.529694 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.529655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.536993 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.536971 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9tbd\" (UniqueName: \"kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd\") pod \"console-65d47dd9d7-fpmrt\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.661547 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.661439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:49.928928 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:49.928902 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:06:49.931241 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:06:49.931210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfacbf23_d196_4f9b_9af4_33e853b7b987.slice/crio-76bdf32d7954b9cea480e5f757f4c8340969d8aa2e037e9dd753277cf6d53019 WatchSource:0}: Error finding container 76bdf32d7954b9cea480e5f757f4c8340969d8aa2e037e9dd753277cf6d53019: Status 404 returned error can't find the container with id 76bdf32d7954b9cea480e5f757f4c8340969d8aa2e037e9dd753277cf6d53019 Sep 09 23:06:50.504461 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:50.504431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47dd9d7-fpmrt" event={"ID":"bfacbf23-d196-4f9b-9af4-33e853b7b987","Type":"ContainerStarted","Data":"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6"} Sep 09 23:06:50.504972 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:50.504475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47dd9d7-fpmrt" event={"ID":"bfacbf23-d196-4f9b-9af4-33e853b7b987","Type":"ContainerStarted","Data":"76bdf32d7954b9cea480e5f757f4c8340969d8aa2e037e9dd753277cf6d53019"} Sep 09 23:06:50.523800 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:50.523755 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d47dd9d7-fpmrt" podStartSLOduration=1.523737943 podStartE2EDuration="1.523737943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:06:50.522348493 +0000 UTC m=+450.080506496" watchObservedRunningTime="2026-09-09 23:06:50.523737943 +0000 UTC m=+450.081895954" Sep 09 23:06:56.709786 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:56.709749 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:56.810647 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:56.810599 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:06:59.662053 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:59.662021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:59.662493 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:59.662079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:06:59.668053 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:06:59.668032 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:07:00.544430 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:00.544402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:07:00.591995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:00.591965 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:07:00.689005 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:00.688962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:07:00.742751 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:00.742717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:07:00.800669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:00.800555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:07:25.612011 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.611968 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d846fc699-8kwbk" podUID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" containerName="console" containerID="cri-o://15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf" gracePeriod=15 Sep 09 23:07:25.842549 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.842526 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:07:25.888225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888152 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888183 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888210 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888232 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888305 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888329 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbhhf\" (UniqueName: \"kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888376 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert\") pod \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\" (UID: \"8477b614-a91c-4b7a-946f-7b6dd3b885f8\") " Sep 09 23:07:25.888910 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.888880 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:07:25.889076 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.889051 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:07:25.889162 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.889134 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:07:25.889300 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.889250 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config" (OuterVolumeSpecName: "console-config") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:07:25.894746 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.894713 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:07:25.894876 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.894829 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:07:25.894876 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.894846 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf" (OuterVolumeSpecName: "kube-api-access-zbhhf") pod "8477b614-a91c-4b7a-946f-7b6dd3b885f8" (UID: "8477b614-a91c-4b7a-946f-7b6dd3b885f8"). InnerVolumeSpecName "kube-api-access-zbhhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:07:25.989693 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989660 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-service-ca\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989693 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989687 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbhhf\" (UniqueName: \"kubernetes.io/projected/8477b614-a91c-4b7a-946f-7b6dd3b885f8-kube-api-access-zbhhf\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989693 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989697 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989706 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989714 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-trusted-ca-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989721 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8477b614-a91c-4b7a-946f-7b6dd3b885f8-oauth-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:25.989919 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:25.989730 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8477b614-a91c-4b7a-946f-7b6dd3b885f8-console-oauth-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:26.627588 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.627536 2561 generic.go:356] "Generic (PLEG): container finished" podID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" containerID="15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf" exitCode=0 Sep 09 23:07:26.627974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.627611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d846fc699-8kwbk" event={"ID":"8477b614-a91c-4b7a-946f-7b6dd3b885f8","Type":"ContainerDied","Data":"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf"} Sep 09 23:07:26.627974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.627654 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d846fc699-8kwbk" event={"ID":"8477b614-a91c-4b7a-946f-7b6dd3b885f8","Type":"ContainerDied","Data":"9fedc522894a361dc14db05d46ca8856a695f91c74987ffbb540cb71bf7bd332"} Sep 09 23:07:26.627974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.627673 2561 scope.go:117] "RemoveContainer" containerID="15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf" Sep 09 23:07:26.627974 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.627618 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d846fc699-8kwbk" Sep 09 23:07:26.636099 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.636081 2561 scope.go:117] "RemoveContainer" containerID="15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf" Sep 09 23:07:26.636370 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:07:26.636352 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf\": container with ID starting with 15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf not found: ID does not exist" containerID="15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf" Sep 09 23:07:26.636411 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.636377 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf"} err="failed to get container status \"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf\": rpc error: code = NotFound desc = could not find container \"15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf\": container with ID starting with 15a6939f0039edeea18f59e820000f84401b065b048c9a97390662d584619aaf not found: ID does not exist" Sep 09 23:07:26.647714 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.647692 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:07:26.650682 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.650664 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d846fc699-8kwbk"] Sep 09 23:07:26.926899 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:26.926872 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" path="/var/lib/kubelet/pods/8477b614-a91c-4b7a-946f-7b6dd3b885f8/volumes" Sep 09 23:07:32.018266 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.018224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:07:32.114246 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.114213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:07:32.817725 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.817694 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j"] Sep 09 23:07:32.817972 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.817958 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" containerName="console" Sep 09 23:07:32.818013 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.817977 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" containerName="console" Sep 09 23:07:32.818045 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.818025 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8477b614-a91c-4b7a-946f-7b6dd3b885f8" containerName="console" Sep 09 23:07:32.822411 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.822395 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:32.825394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.825372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:07:32.826720 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.826701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4wsg\"" Sep 09 23:07:32.826837 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.826735 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:07:32.830495 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.830474 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j"] Sep 09 23:07:32.938696 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.938660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qbk\" (UniqueName: \"kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:32.938880 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.938723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:32.938880 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:32.938798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.039929 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.039889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.040363 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.039944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.040363 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.039977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qbk\" (UniqueName: \"kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.040363 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.040250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.040363 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.040350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.049351 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.049320 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qbk\" (UniqueName: \"kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.131496 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.131418 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:33.399137 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.399112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j"] Sep 09 23:07:33.400775 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:07:33.400746 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09772898_a125_4aea_ade2_a08522e32361.slice/crio-0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f WatchSource:0}: Error finding container 0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f: Status 404 returned error can't find the container with id 0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f Sep 09 23:07:33.652885 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:33.652796 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerStarted","Data":"0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f"} Sep 09 23:07:40.685296 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:40.685259 2561 generic.go:356] "Generic (PLEG): container finished" podID="09772898-a125-4aea-ade2-a08522e32361" containerID="43948101faef3498b3ae767b0700cfc323259b9a49b671eb3da7c6b0f06b86e1" exitCode=0 Sep 09 23:07:40.685729 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:40.685343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerDied","Data":"43948101faef3498b3ae767b0700cfc323259b9a49b671eb3da7c6b0f06b86e1"} Sep 09 23:07:42.693741 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:42.693711 2561 generic.go:356] "Generic (PLEG): container finished" podID="09772898-a125-4aea-ade2-a08522e32361" containerID="442c0ee11729dadfd90df0243668b713b22d24f884e6fd67761302fd4249c53f" exitCode=0 Sep 09 23:07:42.694167 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:42.693794 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerDied","Data":"442c0ee11729dadfd90df0243668b713b22d24f884e6fd67761302fd4249c53f"} Sep 09 23:07:49.723772 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:49.723718 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerStarted","Data":"ef7cea50df088a22c6f386a052bbd4bbb14d13471b09e3479b5be7a70e4e883d"} Sep 09 23:07:49.744453 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:49.744410 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" podStartSLOduration=2.562627402 podStartE2EDuration="17.744395049s" totalImagesPullingTime="15.181767647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:49.743331135 +0000 UTC m=+509.301489132" watchObservedRunningTime="2026-09-09 23:07:49.744395049 +0000 UTC m=+509.302553025" Sep 09 23:07:50.729063 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:50.729027 2561 generic.go:356] "Generic (PLEG): container finished" podID="09772898-a125-4aea-ade2-a08522e32361" containerID="ef7cea50df088a22c6f386a052bbd4bbb14d13471b09e3479b5be7a70e4e883d" exitCode=0 Sep 09 23:07:50.729431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:50.729119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerDied","Data":"ef7cea50df088a22c6f386a052bbd4bbb14d13471b09e3479b5be7a70e4e883d"} Sep 09 23:07:51.851267 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.851238 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:51.995394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.995306 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle\") pod \"09772898-a125-4aea-ade2-a08522e32361\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " Sep 09 23:07:51.995394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.995346 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util\") pod \"09772898-a125-4aea-ade2-a08522e32361\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " Sep 09 23:07:51.995394 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.995381 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9qbk\" (UniqueName: \"kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk\") pod \"09772898-a125-4aea-ade2-a08522e32361\" (UID: \"09772898-a125-4aea-ade2-a08522e32361\") " Sep 09 23:07:51.996193 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.996118 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle" (OuterVolumeSpecName: "bundle") pod "09772898-a125-4aea-ade2-a08522e32361" (UID: "09772898-a125-4aea-ade2-a08522e32361"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:07:51.997807 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:51.997780 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk" (OuterVolumeSpecName: "kube-api-access-g9qbk") pod "09772898-a125-4aea-ade2-a08522e32361" (UID: "09772898-a125-4aea-ade2-a08522e32361"). InnerVolumeSpecName "kube-api-access-g9qbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:07:52.000656 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.000630 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util" (OuterVolumeSpecName: "util") pod "09772898-a125-4aea-ade2-a08522e32361" (UID: "09772898-a125-4aea-ade2-a08522e32361"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:07:52.096248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.096205 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9qbk\" (UniqueName: \"kubernetes.io/projected/09772898-a125-4aea-ade2-a08522e32361-kube-api-access-g9qbk\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:52.096248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.096235 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:52.096248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.096245 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09772898-a125-4aea-ade2-a08522e32361-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:07:52.739146 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.739109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" event={"ID":"09772898-a125-4aea-ade2-a08522e32361","Type":"ContainerDied","Data":"0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f"} Sep 09 23:07:52.739146 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.739144 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754092r2j" Sep 09 23:07:52.739349 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:52.739162 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b0a34ed3586d508e8af2ebd196a51165c4563e9288d0bd471590be0365cb26f" Sep 09 23:07:54.226285 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:07:54.226247 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:01.060943 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:01.060904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:01.183830 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:01.183797 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:03.420156 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:03.420119 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:03.826852 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:03.826777 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:06.258847 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.258812 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt"] Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259034 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="util" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259044 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="util" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259059 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="pull" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259064 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="pull" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259071 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="extract" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259077 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="extract" Sep 09 23:08:06.259225 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.259120 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="09772898-a125-4aea-ade2-a08522e32361" containerName="extract" Sep 09 23:08:06.264834 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.264813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.267458 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.267432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:08:06.268827 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.268804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gbz7g\"" Sep 09 23:08:06.268973 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.268806 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:08:06.270183 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.270158 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt"] Sep 09 23:08:06.399753 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.399705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqdr\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-kube-api-access-xxqdr\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.399925 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.399819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.500665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.500631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.500823 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.500681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqdr\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-kube-api-access-xxqdr\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.509011 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.508948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.509224 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.509192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqdr\" (UniqueName: \"kubernetes.io/projected/1b00d782-65b4-46e1-b242-2b7fecb50c05-kube-api-access-xxqdr\") pod \"cert-manager-cainjector-559cdd8c87-g8mrt\" (UID: \"1b00d782-65b4-46e1-b242-2b7fecb50c05\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.574888 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.574856 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" Sep 09 23:08:06.841460 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:06.841376 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt"] Sep 09 23:08:06.843548 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:06.843521 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b00d782_65b4_46e1_b242_2b7fecb50c05.slice/crio-a1ee596af32b5a6de63f29fce09034def23b724b7a0095728d0d844366df4ded WatchSource:0}: Error finding container a1ee596af32b5a6de63f29fce09034def23b724b7a0095728d0d844366df4ded: Status 404 returned error can't find the container with id a1ee596af32b5a6de63f29fce09034def23b724b7a0095728d0d844366df4ded Sep 09 23:08:07.795959 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:07.795922 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" event={"ID":"1b00d782-65b4-46e1-b242-2b7fecb50c05","Type":"ContainerStarted","Data":"a1ee596af32b5a6de63f29fce09034def23b724b7a0095728d0d844366df4ded"} Sep 09 23:08:09.806204 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:09.806164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" event={"ID":"1b00d782-65b4-46e1-b242-2b7fecb50c05","Type":"ContainerStarted","Data":"e3382fafe15b435621212afa9c19a287e9c832047a4368cd3e804ff706c4f8c5"} Sep 09 23:08:09.823303 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:09.823250 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8mrt" podStartSLOduration=1.254374321 podStartE2EDuration="3.823234762s" totalImagesPullingTime="2.568860441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:09.822051212 +0000 UTC m=+529.380209190" watchObservedRunningTime="2026-09-09 23:08:09.823234762 +0000 UTC m=+529.381392738" Sep 09 23:08:10.170441 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:10.170409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:10.229960 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:10.229921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:10.634528 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:10.634435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:12.183048 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.182963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:12.451862 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.451785 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp"] Sep 09 23:08:12.454238 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.454222 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.457502 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.457481 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:08:12.459171 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.459151 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:08:12.459267 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.459160 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4wsg\"" Sep 09 23:08:12.475651 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.475623 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp"] Sep 09 23:08:12.544798 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.544761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.544798 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.544796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.545017 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.544887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs2pm\" (UniqueName: \"kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.645876 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.645823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs2pm\" (UniqueName: \"kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.645876 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.645885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.646130 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.645906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.646259 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.646242 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.646309 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.646271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.654998 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.654980 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs2pm\" (UniqueName: \"kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:12.762887 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:12.762803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:13.029721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:13.029699 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp"] Sep 09 23:08:13.031489 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:13.031465 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca9a293_be11_4505_8d73_a4dd43347e6e.slice/crio-e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45 WatchSource:0}: Error finding container e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45: Status 404 returned error can't find the container with id e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45 Sep 09 23:08:13.829057 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:13.829019 2561 generic.go:356] "Generic (PLEG): container finished" podID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerID="09072fcc3fa97e0ee2cae9296047edf15b75416085b1447c8fce9a3110a21834" exitCode=0 Sep 09 23:08:13.829405 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:13.829083 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" event={"ID":"cca9a293-be11-4505-8d73-a4dd43347e6e","Type":"ContainerDied","Data":"09072fcc3fa97e0ee2cae9296047edf15b75416085b1447c8fce9a3110a21834"} Sep 09 23:08:13.829405 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:13.829126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" event={"ID":"cca9a293-be11-4505-8d73-a4dd43347e6e","Type":"ContainerStarted","Data":"e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45"} Sep 09 23:08:16.840746 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:16.840709 2561 generic.go:356] "Generic (PLEG): container finished" podID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerID="9ce9813431e0886b8f567d897140c2f5dc695f722cc330feb5541ffeebc796d4" exitCode=0 Sep 09 23:08:16.841117 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:16.840789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" event={"ID":"cca9a293-be11-4505-8d73-a4dd43347e6e","Type":"ContainerDied","Data":"9ce9813431e0886b8f567d897140c2f5dc695f722cc330feb5541ffeebc796d4"} Sep 09 23:08:17.846061 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:17.846027 2561 generic.go:356] "Generic (PLEG): container finished" podID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerID="38f671aee6ba6c665bea955c610868ec1d6b77dc7519fa5484f0f9ea253f1eb9" exitCode=0 Sep 09 23:08:17.846418 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:17.846108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" event={"ID":"cca9a293-be11-4505-8d73-a4dd43347e6e","Type":"ContainerDied","Data":"38f671aee6ba6c665bea955c610868ec1d6b77dc7519fa5484f0f9ea253f1eb9"} Sep 09 23:08:18.967214 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.967191 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:18.988201 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.988175 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util\") pod \"cca9a293-be11-4505-8d73-a4dd43347e6e\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " Sep 09 23:08:18.988356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.988228 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle\") pod \"cca9a293-be11-4505-8d73-a4dd43347e6e\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " Sep 09 23:08:18.988356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.988266 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs2pm\" (UniqueName: \"kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm\") pod \"cca9a293-be11-4505-8d73-a4dd43347e6e\" (UID: \"cca9a293-be11-4505-8d73-a4dd43347e6e\") " Sep 09 23:08:18.988695 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.988670 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle" (OuterVolumeSpecName: "bundle") pod "cca9a293-be11-4505-8d73-a4dd43347e6e" (UID: "cca9a293-be11-4505-8d73-a4dd43347e6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:18.990616 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.990591 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm" (OuterVolumeSpecName: "kube-api-access-xs2pm") pod "cca9a293-be11-4505-8d73-a4dd43347e6e" (UID: "cca9a293-be11-4505-8d73-a4dd43347e6e"). InnerVolumeSpecName "kube-api-access-xs2pm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:18.995041 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:18.995016 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util" (OuterVolumeSpecName: "util") pod "cca9a293-be11-4505-8d73-a4dd43347e6e" (UID: "cca9a293-be11-4505-8d73-a4dd43347e6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:19.089626 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.089591 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:19.089626 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.089619 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs2pm\" (UniqueName: \"kubernetes.io/projected/cca9a293-be11-4505-8d73-a4dd43347e6e-kube-api-access-xs2pm\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:19.089626 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.089629 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca9a293-be11-4505-8d73-a4dd43347e6e-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:19.855458 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.855436 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" Sep 09 23:08:19.855623 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.855429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjgmjp" event={"ID":"cca9a293-be11-4505-8d73-a4dd43347e6e","Type":"ContainerDied","Data":"e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45"} Sep 09 23:08:19.855623 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:19.855556 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8803d693e87325ebe0a938390f654319f0ebafd1dbe4b309fa9bc3344182c45" Sep 09 23:08:23.536932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:23.536890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:23.634620 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:23.634563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:30.018836 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:30.018791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:31.445072 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.445040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:31.498490 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498460 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr"] Sep 09 23:08:31.498734 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498721 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="pull" Sep 09 23:08:31.498795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498736 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="pull" Sep 09 23:08:31.498795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498745 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="extract" Sep 09 23:08:31.498795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498750 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="extract" Sep 09 23:08:31.498795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498764 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="util" Sep 09 23:08:31.498795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498770 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="util" Sep 09 23:08:31.498934 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.498873 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca9a293-be11-4505-8d73-a4dd43347e6e" containerName="extract" Sep 09 23:08:31.503071 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.503056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.505823 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.505806 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:08:31.507120 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.507100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:08:31.507120 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.507116 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4wsg\"" Sep 09 23:08:31.510070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.509982 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr"] Sep 09 23:08:31.576799 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.576765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.576932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.576816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.576932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.576849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtcb\" (UniqueName: \"kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.678036 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.677998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.678150 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.678055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.678150 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.678078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtcb\" (UniqueName: \"kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.678376 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.678357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.678434 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.678418 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.687799 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.687773 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtcb\" (UniqueName: \"kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:31.812273 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:31.812195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:32.084463 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:32.084439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr"] Sep 09 23:08:32.086314 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:32.086288 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517c9766_ccff_4e72_b896_4ef072db8e31.slice/crio-2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b WatchSource:0}: Error finding container 2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b: Status 404 returned error can't find the container with id 2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b Sep 09 23:08:32.253137 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:32.253101 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:32.905356 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:32.905326 2561 generic.go:356] "Generic (PLEG): container finished" podID="517c9766-ccff-4e72-b896-4ef072db8e31" containerID="6541d9ebe0aa698209600548cf7dec66dd51eaf5ca6dc2cdda18c2d689deae4d" exitCode=0 Sep 09 23:08:32.905776 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:32.905368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" event={"ID":"517c9766-ccff-4e72-b896-4ef072db8e31","Type":"ContainerDied","Data":"6541d9ebe0aa698209600548cf7dec66dd51eaf5ca6dc2cdda18c2d689deae4d"} Sep 09 23:08:32.905776 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:32.905410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" event={"ID":"517c9766-ccff-4e72-b896-4ef072db8e31","Type":"ContainerStarted","Data":"2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b"} Sep 09 23:08:33.911288 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:33.911198 2561 generic.go:356] "Generic (PLEG): container finished" podID="517c9766-ccff-4e72-b896-4ef072db8e31" containerID="1fa0ca852bdfedd3a64be22277c70dceff3fb09d930be4be28ce26f996873db8" exitCode=0 Sep 09 23:08:33.911288 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:33.911266 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" event={"ID":"517c9766-ccff-4e72-b896-4ef072db8e31","Type":"ContainerDied","Data":"1fa0ca852bdfedd3a64be22277c70dceff3fb09d930be4be28ce26f996873db8"} Sep 09 23:08:34.918020 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:34.917988 2561 generic.go:356] "Generic (PLEG): container finished" podID="517c9766-ccff-4e72-b896-4ef072db8e31" containerID="c55d8daf33c60906e76d2f9efeb9385696054177bfa713dcdee0d52b9c99b334" exitCode=0 Sep 09 23:08:34.918493 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:34.918022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" event={"ID":"517c9766-ccff-4e72-b896-4ef072db8e31","Type":"ContainerDied","Data":"c55d8daf33c60906e76d2f9efeb9385696054177bfa713dcdee0d52b9c99b334"} Sep 09 23:08:36.048094 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.048072 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:36.113026 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.112980 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle\") pod \"517c9766-ccff-4e72-b896-4ef072db8e31\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " Sep 09 23:08:36.113223 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.113041 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util\") pod \"517c9766-ccff-4e72-b896-4ef072db8e31\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " Sep 09 23:08:36.113223 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.113101 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhtcb\" (UniqueName: \"kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb\") pod \"517c9766-ccff-4e72-b896-4ef072db8e31\" (UID: \"517c9766-ccff-4e72-b896-4ef072db8e31\") " Sep 09 23:08:36.113840 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.113808 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle" (OuterVolumeSpecName: "bundle") pod "517c9766-ccff-4e72-b896-4ef072db8e31" (UID: "517c9766-ccff-4e72-b896-4ef072db8e31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:36.115332 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.115311 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb" (OuterVolumeSpecName: "kube-api-access-hhtcb") pod "517c9766-ccff-4e72-b896-4ef072db8e31" (UID: "517c9766-ccff-4e72-b896-4ef072db8e31"). InnerVolumeSpecName "kube-api-access-hhtcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:36.118817 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.118781 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util" (OuterVolumeSpecName: "util") pod "517c9766-ccff-4e72-b896-4ef072db8e31" (UID: "517c9766-ccff-4e72-b896-4ef072db8e31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:36.214384 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.214295 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhtcb\" (UniqueName: \"kubernetes.io/projected/517c9766-ccff-4e72-b896-4ef072db8e31-kube-api-access-hhtcb\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.214384 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.214325 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.214384 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.214350 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517c9766-ccff-4e72-b896-4ef072db8e31-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.504460 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.504375 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:36.532237 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532210 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2"] Sep 09 23:08:36.532480 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532467 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="pull" Sep 09 23:08:36.532522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532483 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="pull" Sep 09 23:08:36.532522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532502 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="extract" Sep 09 23:08:36.532522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532507 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="extract" Sep 09 23:08:36.532522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532515 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="util" Sep 09 23:08:36.532522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532520 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="util" Sep 09 23:08:36.532687 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.532582 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="517c9766-ccff-4e72-b896-4ef072db8e31" containerName="extract" Sep 09 23:08:36.535514 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.535495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.538470 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.538450 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:08:36.539603 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.539557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:08:36.539735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.539612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:08:36.539735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.539627 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:08:36.539735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.539697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hxlnl\"" Sep 09 23:08:36.539894 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.539731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:08:36.547379 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.547359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2"] Sep 09 23:08:36.604388 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.604347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:36.616381 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.616346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7cbc338-4b06-417c-be2a-ee9a6b51299a-manager-config\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.616524 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.616404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-metrics-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.616524 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.616428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.616524 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.616501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd8vp\" (UniqueName: \"kubernetes.io/projected/f7cbc338-4b06-417c-be2a-ee9a6b51299a-kube-api-access-rd8vp\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.717021 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.716981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd8vp\" (UniqueName: \"kubernetes.io/projected/f7cbc338-4b06-417c-be2a-ee9a6b51299a-kube-api-access-rd8vp\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.717021 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.717025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7cbc338-4b06-417c-be2a-ee9a6b51299a-manager-config\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.717278 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.717047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-metrics-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.717278 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.717068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.717683 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.717659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7cbc338-4b06-417c-be2a-ee9a6b51299a-manager-config\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.719693 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.719672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-metrics-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.719796 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.719780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7cbc338-4b06-417c-be2a-ee9a6b51299a-cert\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.727618 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.727591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd8vp\" (UniqueName: \"kubernetes.io/projected/f7cbc338-4b06-417c-be2a-ee9a6b51299a-kube-api-access-rd8vp\") pod \"lws-controller-manager-5c9946bf76-lvlw2\" (UID: \"f7cbc338-4b06-417c-be2a-ee9a6b51299a\") " pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.844925 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.844839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:36.927392 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.927369 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" Sep 09 23:08:36.927537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.927399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvxtdr" event={"ID":"517c9766-ccff-4e72-b896-4ef072db8e31","Type":"ContainerDied","Data":"2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b"} Sep 09 23:08:36.927537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:36.927439 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ef8a6e3b2e36ba24b6e1d441824f962d77fe0806271aa9b4eccf9fdd9d24b3b" Sep 09 23:08:37.117281 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:37.117208 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2"] Sep 09 23:08:37.120316 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:37.120286 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cbc338_4b06_417c_be2a_ee9a6b51299a.slice/crio-8f366bbaa9a696747d5220fb47384c2fceb4c5b1c60697efe980da33d471ce28 WatchSource:0}: Error finding container 8f366bbaa9a696747d5220fb47384c2fceb4c5b1c60697efe980da33d471ce28: Status 404 returned error can't find the container with id 8f366bbaa9a696747d5220fb47384c2fceb4c5b1c60697efe980da33d471ce28 Sep 09 23:08:37.931901 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:37.931868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" event={"ID":"f7cbc338-4b06-417c-be2a-ee9a6b51299a","Type":"ContainerStarted","Data":"8f366bbaa9a696747d5220fb47384c2fceb4c5b1c60697efe980da33d471ce28"} Sep 09 23:08:38.937850 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:38.937810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" event={"ID":"f7cbc338-4b06-417c-be2a-ee9a6b51299a","Type":"ContainerStarted","Data":"c43ad8f1e7cb1d9b45d6b6f95bf1f3c5945fba8e90c43fb37cc7518c7fa4f0d4"} Sep 09 23:08:38.938304 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:38.937888 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:38.954765 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:38.954711 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" podStartSLOduration=1.32878901 podStartE2EDuration="2.954690334s" totalImagesPullingTime="1.625901324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:38.953659762 +0000 UTC m=+558.511817738" watchObservedRunningTime="2026-09-09 23:08:38.954690334 +0000 UTC m=+558.512848378" Sep 09 23:08:47.696637 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.696600 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7"] Sep 09 23:08:47.701631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.701617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.704561 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.704530 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:08:47.704703 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.704589 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:08:47.706522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.706498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4wsg\"" Sep 09 23:08:47.714383 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.714356 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7"] Sep 09 23:08:47.794143 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.794103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.794143 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.794143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9wk\" (UniqueName: \"kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.794340 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.794234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.895540 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.895509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.895734 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.895549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.895734 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.895590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9wk\" (UniqueName: \"kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.895994 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.895970 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.896032 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.895981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:47.907260 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.907204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:47.907377 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:47.907327 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9wk\" (UniqueName: \"kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:48.008022 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.007933 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.013742 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.013723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:48.285643 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.285620 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7"] Sep 09 23:08:48.287351 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:48.287324 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5714786_e68a_4e3b_ba00_8dae65a47426.slice/crio-20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4 WatchSource:0}: Error finding container 20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4: Status 404 returned error can't find the container with id 20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4 Sep 09 23:08:48.512486 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.512458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.777707 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.777671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.879276 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.879244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.946385 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.946355 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj"] Sep 09 23:08:48.948832 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.948810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:48.952371 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.952347 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vkrgg\"" Sep 09 23:08:48.952664 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.952646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:08:48.952664 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.952660 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:08:48.952790 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.952652 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:08:48.952790 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.952655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:08:48.971910 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.971881 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj"] Sep 09 23:08:48.976438 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.976412 2561 generic.go:356] "Generic (PLEG): container finished" podID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerID="7c4b1bc5407cb61133c182823a9fde4ed49ca52c012c1586e0a7c249d51abc80" exitCode=0 Sep 09 23:08:48.976556 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.976502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" event={"ID":"c5714786-e68a-4e3b-ba00-8dae65a47426","Type":"ContainerDied","Data":"7c4b1bc5407cb61133c182823a9fde4ed49ca52c012c1586e0a7c249d51abc80"} Sep 09 23:08:48.976556 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:48.976550 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" event={"ID":"c5714786-e68a-4e3b-ba00-8dae65a47426","Type":"ContainerStarted","Data":"20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4"} Sep 09 23:08:49.003699 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.003669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-manifests\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.003699 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.003699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.003926 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.003763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-tmp\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.003926 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.003810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpfw8\" (UniqueName: \"kubernetes.io/projected/43074e25-cd86-4f77-9174-a9428cc4fc5f-kube-api-access-bpfw8\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.003926 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.003842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.053963 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.053872 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.104497 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpfw8\" (UniqueName: \"kubernetes.io/projected/43074e25-cd86-4f77-9174-a9428cc4fc5f-kube-api-access-bpfw8\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.104665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.104665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-manifests\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.104665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.104817 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-tmp\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.104980 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.104948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-manifests\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.107165 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.107143 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43074e25-cd86-4f77-9174-a9428cc4fc5f-tmp\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.107255 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.107205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.107377 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.107357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43074e25-cd86-4f77-9174-a9428cc4fc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.113079 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.113060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpfw8\" (UniqueName: \"kubernetes.io/projected/43074e25-cd86-4f77-9174-a9428cc4fc5f-kube-api-access-bpfw8\") pod \"opendatahub-operator-controller-manager-65d8796fc4-fvlsj\" (UID: \"43074e25-cd86-4f77-9174-a9428cc4fc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.153784 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.153752 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.253342 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.253302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.259132 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.259101 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:49.353182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.353159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.466892 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.466856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.567051 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.567026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj"] Sep 09 23:08:49.572958 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:08:49.572935 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43074e25_cd86_4f77_9174_a9428cc4fc5f.slice/crio-435d336c9f6800825f4cbef8cc3b5c62c53bfb8e173548e771a20450fa108229 WatchSource:0}: Error finding container 435d336c9f6800825f4cbef8cc3b5c62c53bfb8e173548e771a20450fa108229: Status 404 returned error can't find the container with id 435d336c9f6800825f4cbef8cc3b5c62c53bfb8e173548e771a20450fa108229 Sep 09 23:08:49.597561 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.597519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.944812 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.944784 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c9946bf76-lvlw2" Sep 09 23:08:49.982642 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.982605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" event={"ID":"43074e25-cd86-4f77-9174-a9428cc4fc5f","Type":"ContainerStarted","Data":"435d336c9f6800825f4cbef8cc3b5c62c53bfb8e173548e771a20450fa108229"} Sep 09 23:08:49.984541 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.984509 2561 generic.go:356] "Generic (PLEG): container finished" podID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerID="40ef3873757edf351ba776b6345740c809edcc1806d2f9e9f5ee185974895534" exitCode=0 Sep 09 23:08:49.984664 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:49.984563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" event={"ID":"c5714786-e68a-4e3b-ba00-8dae65a47426","Type":"ContainerDied","Data":"40ef3873757edf351ba776b6345740c809edcc1806d2f9e9f5ee185974895534"} Sep 09 23:08:50.992266 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:50.992227 2561 generic.go:356] "Generic (PLEG): container finished" podID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerID="c43c05acb79471118394d2a65d26353003535379d46a52885b84718dfdd4b190" exitCode=0 Sep 09 23:08:50.992731 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:50.992286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" event={"ID":"c5714786-e68a-4e3b-ba00-8dae65a47426","Type":"ContainerDied","Data":"c43c05acb79471118394d2a65d26353003535379d46a52885b84718dfdd4b190"} Sep 09 23:08:52.709465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.709441 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:52.836918 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.836884 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq9wk\" (UniqueName: \"kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk\") pod \"c5714786-e68a-4e3b-ba00-8dae65a47426\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " Sep 09 23:08:52.837069 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.836927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle\") pod \"c5714786-e68a-4e3b-ba00-8dae65a47426\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " Sep 09 23:08:52.837069 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.836951 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util\") pod \"c5714786-e68a-4e3b-ba00-8dae65a47426\" (UID: \"c5714786-e68a-4e3b-ba00-8dae65a47426\") " Sep 09 23:08:52.837730 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.837664 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle" (OuterVolumeSpecName: "bundle") pod "c5714786-e68a-4e3b-ba00-8dae65a47426" (UID: "c5714786-e68a-4e3b-ba00-8dae65a47426"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:52.839106 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.839079 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk" (OuterVolumeSpecName: "kube-api-access-cq9wk") pod "c5714786-e68a-4e3b-ba00-8dae65a47426" (UID: "c5714786-e68a-4e3b-ba00-8dae65a47426"). InnerVolumeSpecName "kube-api-access-cq9wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:52.842198 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.842165 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util" (OuterVolumeSpecName: "util") pod "c5714786-e68a-4e3b-ba00-8dae65a47426" (UID: "c5714786-e68a-4e3b-ba00-8dae65a47426"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:52.937809 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.937786 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq9wk\" (UniqueName: \"kubernetes.io/projected/c5714786-e68a-4e3b-ba00-8dae65a47426-kube-api-access-cq9wk\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:52.937809 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.937810 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:52.937953 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:52.937818 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5714786-e68a-4e3b-ba00-8dae65a47426-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:08:53.003091 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:53.002996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" event={"ID":"43074e25-cd86-4f77-9174-a9428cc4fc5f","Type":"ContainerStarted","Data":"7ff1e7e4f29e4f0c0a9c92a4ac367a275b1d0d06f79ffb8396690bf47cb3ea59"} Sep 09 23:08:53.005093 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:53.005067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" event={"ID":"c5714786-e68a-4e3b-ba00-8dae65a47426","Type":"ContainerDied","Data":"20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4"} Sep 09 23:08:53.005093 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:53.005084 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02cbg7" Sep 09 23:08:53.005275 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:53.005108 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20235403ae80f489296c71ae8f9f3c312f996735177eac03386a000e2e6b46e4" Sep 09 23:08:54.011047 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:54.011016 2561 generic.go:356] "Generic (PLEG): container finished" podID="43074e25-cd86-4f77-9174-a9428cc4fc5f" containerID="7ff1e7e4f29e4f0c0a9c92a4ac367a275b1d0d06f79ffb8396690bf47cb3ea59" exitCode=0 Sep 09 23:08:54.011426 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:54.011089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" event={"ID":"43074e25-cd86-4f77-9174-a9428cc4fc5f","Type":"ContainerDied","Data":"7ff1e7e4f29e4f0c0a9c92a4ac367a275b1d0d06f79ffb8396690bf47cb3ea59"} Sep 09 23:08:55.017792 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:55.017758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" event={"ID":"43074e25-cd86-4f77-9174-a9428cc4fc5f","Type":"ContainerStarted","Data":"566a2bf503f0d83cc8de7eea03022a623cb50765d5a2c9407fd9ec24504ae75d"} Sep 09 23:08:55.018140 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:55.017829 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:08:55.044852 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:08:55.043675 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" podStartSLOduration=2.5479802 podStartE2EDuration="7.043652874s" totalImagesPullingTime="3.463945783s" totalInitContainerRuntime="1.031726891s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:55.038783324 +0000 UTC m=+574.596941415" watchObservedRunningTime="2026-09-09 23:08:55.043652874 +0000 UTC m=+574.601810869" Sep 09 23:09:01.111594 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:01.111542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:01.211529 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:01.211498 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:06.024059 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:06.024030 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65d8796fc4-fvlsj" Sep 09 23:09:07.972494 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:07.972458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:08.090918 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:08.090879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:08.421769 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:08.421743 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:08.654521 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:08.654487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:09.896712 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:09.896672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:10.014801 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:10.014763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:10.833590 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:10.833521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:12.821684 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:12.821639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:15.511403 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.511363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:15.613258 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.613221 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:15.949001 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.948971 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs"] Sep 09 23:09:15.949249 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949238 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="extract" Sep 09 23:09:15.949290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949251 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="extract" Sep 09 23:09:15.949290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949263 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="util" Sep 09 23:09:15.949290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949269 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="util" Sep 09 23:09:15.949290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949277 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="pull" Sep 09 23:09:15.949290 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949282 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="pull" Sep 09 23:09:15.949439 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.949328 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5714786-e68a-4e3b-ba00-8dae65a47426" containerName="extract" Sep 09 23:09:15.952069 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.952048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:15.954753 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.954723 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:09:15.955138 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.955098 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:09:15.955240 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.955142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:09:15.955240 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.955157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n9cm5\"" Sep 09 23:09:15.963102 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.963079 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs"] Sep 09 23:09:15.978661 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:15.978621 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:16.122024 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.121992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122024 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122272 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122272 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122272 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122272 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122272 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvkc\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-kube-api-access-ltvkc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122449 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.122449 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.122307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.189303 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.189267 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:16.222995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.222914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.222995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.222946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvkc\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-kube-api-access-ltvkc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.222995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.222963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.222995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.222979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223314 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223314 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223314 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223314 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223488 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223488 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223488 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223430 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223653 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223744 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.223968 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.223920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.225434 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.225413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.225606 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.225592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.232015 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.231990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.232142 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.232119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvkc\" (UniqueName: \"kubernetes.io/projected/d824bcfa-bc67-426a-b21d-8e2c93bcb686-kube-api-access-ltvkc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs\" (UID: \"d824bcfa-bc67-426a-b21d-8e2c93bcb686\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.262070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.262038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:16.289995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.289959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:16.534250 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:16.534226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs"] Sep 09 23:09:16.536170 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:09:16.536140 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd824bcfa_bc67_426a_b21d_8e2c93bcb686.slice/crio-df19317ab494293c7fa54c9f11dea38d719a2bc30394d5774b693cc038610ca7 WatchSource:0}: Error finding container df19317ab494293c7fa54c9f11dea38d719a2bc30394d5774b693cc038610ca7: Status 404 returned error can't find the container with id df19317ab494293c7fa54c9f11dea38d719a2bc30394d5774b693cc038610ca7 Sep 09 23:09:17.116436 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:17.116401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" event={"ID":"d824bcfa-bc67-426a-b21d-8e2c93bcb686","Type":"ContainerStarted","Data":"df19317ab494293c7fa54c9f11dea38d719a2bc30394d5774b693cc038610ca7"} Sep 09 23:09:19.045120 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.045084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7cpms"] Sep 09 23:09:19.052038 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.052012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.056131 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.056083 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ksk7v\"" Sep 09 23:09:19.056131 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.056120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 23:09:19.066105 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.066080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7cpms"] Sep 09 23:09:19.115178 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.115137 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:19.149879 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.149829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4llg\" (UniqueName: \"kubernetes.io/projected/95504448-ed0f-4fec-bf66-c243a37feaf5-kube-api-access-m4llg\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.150059 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.149963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.218479 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.218411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:19.250669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.250627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.250669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.250675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4llg\" (UniqueName: \"kubernetes.io/projected/95504448-ed0f-4fec-bf66-c243a37feaf5-kube-api-access-m4llg\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.250910 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:09:19.250792 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 09 23:09:19.250910 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:09:19.250866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert podName:95504448-ed0f-4fec-bf66-c243a37feaf5 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:19.750843112 +0000 UTC m=+599.309001065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert") pod "odh-model-controller-7998c67dc4-7cpms" (UID: "95504448-ed0f-4fec-bf66-c243a37feaf5") : secret "odh-model-controller-webhook-cert" not found Sep 09 23:09:19.263164 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.263129 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4llg\" (UniqueName: \"kubernetes.io/projected/95504448-ed0f-4fec-bf66-c243a37feaf5-kube-api-access-m4llg\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.319732 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.319644 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:19.400775 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.400742 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 09 23:09:19.400850 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.400812 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 09 23:09:19.400850 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.400842 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 09 23:09:19.499484 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.499437 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:19.679449 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.679413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:19.755328 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.755286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.757762 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.757742 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95504448-ed0f-4fec-bf66-c243a37feaf5-cert\") pod \"odh-model-controller-7998c67dc4-7cpms\" (UID: \"95504448-ed0f-4fec-bf66-c243a37feaf5\") " pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:19.965099 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:19.965004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:20.081092 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.081054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:20.132435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.132406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" event={"ID":"d824bcfa-bc67-426a-b21d-8e2c93bcb686","Type":"ContainerStarted","Data":"45e47b00f987bfb69d89e8371be7dfb1c172acaaa33b3e39739e10e10b72015d"} Sep 09 23:09:20.153894 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.153841 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" podStartSLOduration=2.2915364719999998 podStartE2EDuration="5.153824076s" totalImagesPullingTime="2.862287604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:20.152053954 +0000 UTC m=+599.710211975" watchObservedRunningTime="2026-09-09 23:09:20.153824076 +0000 UTC m=+599.711982052" Sep 09 23:09:20.239468 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.239441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7cpms"] Sep 09 23:09:20.241280 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:09:20.241254 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95504448_ed0f_4fec_bf66_c243a37feaf5.slice/crio-e71bd30c1ae4f85b5771ca9c5bda8d2b099dd3b22b32579019aa52dfe0fc1993 WatchSource:0}: Error finding container e71bd30c1ae4f85b5771ca9c5bda8d2b099dd3b22b32579019aa52dfe0fc1993: Status 404 returned error can't find the container with id e71bd30c1ae4f85b5771ca9c5bda8d2b099dd3b22b32579019aa52dfe0fc1993 Sep 09 23:09:20.262632 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.262606 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:20.267930 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.267905 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:20.815658 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.815618 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:09:20.815862 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:20.815782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:09:21.139774 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:21.139693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" event={"ID":"95504448-ed0f-4fec-bf66-c243a37feaf5","Type":"ContainerStarted","Data":"e71bd30c1ae4f85b5771ca9c5bda8d2b099dd3b22b32579019aa52dfe0fc1993"} Sep 09 23:09:21.140193 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:21.140018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:21.141237 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:21.141208 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs" Sep 09 23:09:23.149932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:23.149892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" event={"ID":"95504448-ed0f-4fec-bf66-c243a37feaf5","Type":"ContainerStarted","Data":"fa3fcd6e3d7f238ab9eeef2ebd2e396c0ef2b098f9654e8d0ad7f5398cfba689"} Sep 09 23:09:23.150392 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:23.149947 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:23.165389 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:23.165349 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" podStartSLOduration=1.499422287 podStartE2EDuration="4.165276791s" totalImagesPullingTime="2.665854504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:23.165030025 +0000 UTC m=+602.723188014" watchObservedRunningTime="2026-09-09 23:09:23.165276791 +0000 UTC m=+602.723434771" Sep 09 23:09:25.867958 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.867921 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw"] Sep 09 23:09:25.874766 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.874742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.877991 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.877967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:09:25.878136 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.877967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gmwhs\"" Sep 09 23:09:25.878136 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.878000 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:09:25.878252 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.878240 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:09:25.890313 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.890289 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw"] Sep 09 23:09:25.909957 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.909924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.909957 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.909960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkkc6\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-kube-api-access-pkkc6\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.910132 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.909997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.910132 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.910036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.910132 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.910106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.910229 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.910136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:25.910229 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:25.910172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70f5d09-2205-4994-9896-526e305083b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011041 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011235 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011235 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70f5d09-2205-4994-9896-526e305083b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkkc6\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-kube-api-access-pkkc6\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.011350 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.011343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.012185 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.012159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.013689 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.013662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70f5d09-2205-4994-9896-526e305083b7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.013793 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.013717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.013793 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.013750 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.013793 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.013780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f70f5d09-2205-4994-9896-526e305083b7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.020860 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.020837 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.021048 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.021027 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkkc6\" (UniqueName: \"kubernetes.io/projected/f70f5d09-2205-4994-9896-526e305083b7-kube-api-access-pkkc6\") pod \"istiod-openshift-gateway-5677ccb49b-9f6hw\" (UID: \"f70f5d09-2205-4994-9896-526e305083b7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.183684 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.183659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:26.502255 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.502227 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw"] Sep 09 23:09:26.503159 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:09:26.503140 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70f5d09_2205_4994_9896_526e305083b7.slice/crio-6bbe3daa519ae7eace61fdb2b989731c09ca8ac70d3d4408b2a14df4a4f95228 WatchSource:0}: Error finding container 6bbe3daa519ae7eace61fdb2b989731c09ca8ac70d3d4408b2a14df4a4f95228: Status 404 returned error can't find the container with id 6bbe3daa519ae7eace61fdb2b989731c09ca8ac70d3d4408b2a14df4a4f95228 Sep 09 23:09:26.505454 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.505435 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:09:26.652400 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.652364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6c5bcc5-kkzrn"] Sep 09 23:09:26.655139 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.655124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.673099 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.673071 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6c5bcc5-kkzrn"] Sep 09 23:09:26.715338 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715338 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9hl\" (UniqueName: \"kubernetes.io/projected/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-kube-api-access-dw9hl\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-oauth-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-oauth-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-service-ca\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-trusted-ca-bundle\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.715829 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.715634 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:26.782682 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.782594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:26.816110 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816110 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9hl\" (UniqueName: \"kubernetes.io/projected/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-kube-api-access-dw9hl\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816330 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-oauth-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816330 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816330 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-oauth-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816330 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-service-ca\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816640 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-trusted-ca-bundle\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816965 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816873 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816965 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816897 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-oauth-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.816965 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.816960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-service-ca\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.817264 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.817244 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-trusted-ca-bundle\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.819407 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.819380 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-serving-cert\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.819492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.819386 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-console-oauth-config\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.825506 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.825488 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9hl\" (UniqueName: \"kubernetes.io/projected/3cec8bca-bb38-44cc-afe8-10c3f9da32b9-kube-api-access-dw9hl\") pod \"console-6c6c5bcc5-kkzrn\" (UID: \"3cec8bca-bb38-44cc-afe8-10c3f9da32b9\") " pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:26.964429 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:26.964399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:27.171213 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:27.171174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" event={"ID":"f70f5d09-2205-4994-9896-526e305083b7","Type":"ContainerStarted","Data":"6bbe3daa519ae7eace61fdb2b989731c09ca8ac70d3d4408b2a14df4a4f95228"} Sep 09 23:09:27.245263 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:27.245238 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6c5bcc5-kkzrn"] Sep 09 23:09:27.247780 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:09:27.247746 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cec8bca_bb38_44cc_afe8_10c3f9da32b9.slice/crio-7c644348dc5aefe82d90592bc60615a0c264b6571ce933c1e2b99765eb93b82b WatchSource:0}: Error finding container 7c644348dc5aefe82d90592bc60615a0c264b6571ce933c1e2b99765eb93b82b: Status 404 returned error can't find the container with id 7c644348dc5aefe82d90592bc60615a0c264b6571ce933c1e2b99765eb93b82b Sep 09 23:09:28.178002 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.177962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6c5bcc5-kkzrn" event={"ID":"3cec8bca-bb38-44cc-afe8-10c3f9da32b9","Type":"ContainerStarted","Data":"aa46ab81b398cdc0551a39d109c6da578be9c0794c330394d2ea992da8b0a3e9"} Sep 09 23:09:28.178405 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.178022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6c5bcc5-kkzrn" event={"ID":"3cec8bca-bb38-44cc-afe8-10c3f9da32b9","Type":"ContainerStarted","Data":"7c644348dc5aefe82d90592bc60615a0c264b6571ce933c1e2b99765eb93b82b"} Sep 09 23:09:28.230161 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.230104 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6c5bcc5-kkzrn" podStartSLOduration=2.230085609 podStartE2EDuration="2.230085609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:28.229641919 +0000 UTC m=+607.787799913" watchObservedRunningTime="2026-09-09 23:09:28.230085609 +0000 UTC m=+607.788243585" Sep 09 23:09:28.788884 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.788815 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 09 23:09:28.789009 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.788902 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 09 23:09:28.790023 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.789986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:28.906444 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:28.906410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:29.184934 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.184898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" event={"ID":"f70f5d09-2205-4994-9896-526e305083b7","Type":"ContainerStarted","Data":"1a3c91d20c9ac38494ac2a54c10e94960c91d5d061835371bec4fad7b1ebe3cc"} Sep 09 23:09:29.185342 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.185067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:29.186943 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.186916 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-9f6hw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 23:09:29.187063 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.186968 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" podUID="f70f5d09-2205-4994-9896-526e305083b7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:09:29.249475 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.249419 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" podStartSLOduration=1.966475479 podStartE2EDuration="4.249402528s" totalImagesPullingTime="2.282927049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:29.246260823 +0000 UTC m=+608.804418822" watchObservedRunningTime="2026-09-09 23:09:29.249402528 +0000 UTC m=+608.807560504" Sep 09 23:09:29.325137 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.325097 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:29.464739 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:29.464661 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:30.142874 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:30.142830 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:30.189684 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:30.189651 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9f6hw" Sep 09 23:09:30.228141 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:30.228112 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:30.323972 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:30.323926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:34.156542 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:34.156508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7cpms" Sep 09 23:09:36.965012 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:36.964978 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:36.965506 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:36.965039 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:36.969831 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:36.969810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:37.221191 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:37.221108 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6c5bcc5-kkzrn" Sep 09 23:09:37.275848 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:37.275817 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:09:37.390713 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:37.390680 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:37.489679 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:37.489588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:37.635657 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:09:37.635620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:02.296239 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.296151 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65d47dd9d7-fpmrt" podUID="bfacbf23-d196-4f9b-9af4-33e853b7b987" containerName="console" containerID="cri-o://ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6" gracePeriod=15 Sep 09 23:10:02.534082 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.534054 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:10:02.635178 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635075 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635178 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635131 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635178 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635153 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635440 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635193 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635440 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635218 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9tbd\" (UniqueName: \"kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635440 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635254 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635440 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635276 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config\") pod \"bfacbf23-d196-4f9b-9af4-33e853b7b987\" (UID: \"bfacbf23-d196-4f9b-9af4-33e853b7b987\") " Sep 09 23:10:02.635665 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635562 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:02.635736 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635708 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:02.635787 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635746 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config" (OuterVolumeSpecName: "console-config") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:02.635787 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.635761 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:02.637553 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.637522 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:10:02.637671 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.637584 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd" (OuterVolumeSpecName: "kube-api-access-q9tbd") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "kube-api-access-q9tbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:02.637761 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.637743 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfacbf23-d196-4f9b-9af4-33e853b7b987" (UID: "bfacbf23-d196-4f9b-9af4-33e853b7b987"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:10:02.736182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736143 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-oauth-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736176 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736182 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736189 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-serving-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736414 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736200 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-service-ca\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736414 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736212 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfacbf23-d196-4f9b-9af4-33e853b7b987-trusted-ca-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736414 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736223 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfacbf23-d196-4f9b-9af4-33e853b7b987-console-oauth-config\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:02.736414 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:02.736234 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9tbd\" (UniqueName: \"kubernetes.io/projected/bfacbf23-d196-4f9b-9af4-33e853b7b987-kube-api-access-q9tbd\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:03.333983 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.333889 2561 generic.go:356] "Generic (PLEG): container finished" podID="bfacbf23-d196-4f9b-9af4-33e853b7b987" containerID="ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6" exitCode=0 Sep 09 23:10:03.333983 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.333968 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47dd9d7-fpmrt" Sep 09 23:10:03.334479 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.333975 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47dd9d7-fpmrt" event={"ID":"bfacbf23-d196-4f9b-9af4-33e853b7b987","Type":"ContainerDied","Data":"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6"} Sep 09 23:10:03.334479 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.334050 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47dd9d7-fpmrt" event={"ID":"bfacbf23-d196-4f9b-9af4-33e853b7b987","Type":"ContainerDied","Data":"76bdf32d7954b9cea480e5f757f4c8340969d8aa2e037e9dd753277cf6d53019"} Sep 09 23:10:03.334479 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.334070 2561 scope.go:117] "RemoveContainer" containerID="ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6" Sep 09 23:10:03.342460 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.342442 2561 scope.go:117] "RemoveContainer" containerID="ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6" Sep 09 23:10:03.342758 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:10:03.342738 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6\": container with ID starting with ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6 not found: ID does not exist" containerID="ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6" Sep 09 23:10:03.342838 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.342765 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6"} err="failed to get container status \"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6\": rpc error: code = NotFound desc = could not find container \"ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6\": container with ID starting with ef18b9b8a1e727956ef550077df3d68b217e8eb355813a80b488ffada68704e6 not found: ID does not exist" Sep 09 23:10:03.350370 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.350343 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:10:03.355212 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:03.355142 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d47dd9d7-fpmrt"] Sep 09 23:10:04.927315 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:04.927282 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfacbf23-d196-4f9b-9af4-33e853b7b987" path="/var/lib/kubelet/pods/bfacbf23-d196-4f9b-9af4-33e853b7b987/volumes" Sep 09 23:10:20.057411 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:20.057370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:20.142890 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:20.142849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:23.814243 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.814207 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs"] Sep 09 23:10:23.814631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.814540 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfacbf23-d196-4f9b-9af4-33e853b7b987" containerName="console" Sep 09 23:10:23.814631 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.814556 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfacbf23-d196-4f9b-9af4-33e853b7b987" containerName="console" Sep 09 23:10:23.814707 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.814636 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfacbf23-d196-4f9b-9af4-33e853b7b987" containerName="console" Sep 09 23:10:23.818915 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.818899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.821641 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.821613 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:10:23.821641 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.821616 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:10:23.822774 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.822758 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c4wsg\"" Sep 09 23:10:23.826273 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.826253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs"] Sep 09 23:10:23.896680 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.896641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.896680 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.896687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ww7k\" (UniqueName: \"kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.896897 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.896705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.912795 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.912765 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f"] Sep 09 23:10:23.915978 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.915962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:23.924393 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.924364 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f"] Sep 09 23:10:23.997626 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ww7k\" (UniqueName: \"kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.997820 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.997820 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:23.997820 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:23.997955 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t85c\" (UniqueName: \"kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:23.997955 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.997855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.998035 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.998017 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:23.998147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:23.998132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:24.006963 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.006934 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ww7k\" (UniqueName: \"kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:24.018140 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.018103 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88"] Sep 09 23:10:24.021462 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.021445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.030499 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.030474 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88"] Sep 09 23:10:24.099208 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t85c\" (UniqueName: \"kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.099208 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.099431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbwzj\" (UniqueName: \"kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.099431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.099431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.099431 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.099657 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.099698 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.099687 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.107929 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.107910 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t85c\" (UniqueName: \"kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.121933 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.121909 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69"] Sep 09 23:10:24.125271 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.125258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.128089 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.128068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:24.135946 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.135926 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69"] Sep 09 23:10:24.200792 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.200760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.200975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.200804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbwzj\" (UniqueName: \"kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.200975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.200856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.200975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.200888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzk4c\" (UniqueName: \"kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.200975 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.200926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.201185 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.201028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.201240 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.201181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.201406 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.201376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.209854 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.209826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbwzj\" (UniqueName: \"kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.225634 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.225585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:24.302248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.302220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.302403 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.302259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzk4c\" (UniqueName: \"kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.302480 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.302396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.302699 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.302675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.302812 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.302778 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.311034 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.311014 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzk4c\" (UniqueName: \"kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.330859 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.330833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:24.406611 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.406509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs"] Sep 09 23:10:24.406745 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:10:24.406701 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7098939_6a76_4abc_85ca_de4497d6d83f.slice/crio-33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df WatchSource:0}: Error finding container 33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df: Status 404 returned error can't find the container with id 33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df Sep 09 23:10:24.425011 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.424977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" event={"ID":"e7098939-6a76-4abc-85ca-de4497d6d83f","Type":"ContainerStarted","Data":"33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df"} Sep 09 23:10:24.436276 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.436211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:24.497302 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.497149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f"] Sep 09 23:10:24.500872 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:10:24.500843 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb162b54_2ead_4a82_a42b_ca817d0908b9.slice/crio-9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d WatchSource:0}: Error finding container 9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d: Status 404 returned error can't find the container with id 9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d Sep 09 23:10:24.602368 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.602336 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88"] Sep 09 23:10:24.602869 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:10:24.602844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4da66aa_dcd6_4aa8_b317_0d3a4b5d385d.slice/crio-1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab WatchSource:0}: Error finding container 1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab: Status 404 returned error can't find the container with id 1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab Sep 09 23:10:24.710918 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:24.710883 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69"] Sep 09 23:10:24.712781 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:10:24.712756 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46d47e4_73c7_41e6_af3e_0bb7e2c7360f.slice/crio-cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032 WatchSource:0}: Error finding container cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032: Status 404 returned error can't find the container with id cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032 Sep 09 23:10:25.431261 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.431228 2561 generic.go:356] "Generic (PLEG): container finished" podID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerID="077a34473c362a093daaed344da626d867612449346f8e6515c80c6b7d69d8f0" exitCode=0 Sep 09 23:10:25.431745 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.431321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" event={"ID":"e7098939-6a76-4abc-85ca-de4497d6d83f","Type":"ContainerDied","Data":"077a34473c362a093daaed344da626d867612449346f8e6515c80c6b7d69d8f0"} Sep 09 23:10:25.432947 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.432924 2561 generic.go:356] "Generic (PLEG): container finished" podID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerID="949fbab567f8a6a73bdefb0a0e40f0cd0b07812ba4b7e5ff271772fec6f6ba58" exitCode=0 Sep 09 23:10:25.433013 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.432954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" event={"ID":"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f","Type":"ContainerDied","Data":"949fbab567f8a6a73bdefb0a0e40f0cd0b07812ba4b7e5ff271772fec6f6ba58"} Sep 09 23:10:25.433065 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.433015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" event={"ID":"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f","Type":"ContainerStarted","Data":"cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032"} Sep 09 23:10:25.434619 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.434599 2561 generic.go:356] "Generic (PLEG): container finished" podID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerID="724ece16ebd95c6b3cca5fd89c9c4519c9e7f65a38b3419df01996c839c729d2" exitCode=0 Sep 09 23:10:25.434741 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.434721 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" event={"ID":"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d","Type":"ContainerDied","Data":"724ece16ebd95c6b3cca5fd89c9c4519c9e7f65a38b3419df01996c839c729d2"} Sep 09 23:10:25.434816 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.434770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" event={"ID":"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d","Type":"ContainerStarted","Data":"1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab"} Sep 09 23:10:25.436397 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.436380 2561 generic.go:356] "Generic (PLEG): container finished" podID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerID="cddcf7b5ec2264e62040792663b31945abe55c31314c5defaf69a8ca163dfe7c" exitCode=0 Sep 09 23:10:25.436466 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.436405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" event={"ID":"eb162b54-2ead-4a82-a42b-ca817d0908b9","Type":"ContainerDied","Data":"cddcf7b5ec2264e62040792663b31945abe55c31314c5defaf69a8ca163dfe7c"} Sep 09 23:10:25.436466 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:25.436447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" event={"ID":"eb162b54-2ead-4a82-a42b-ca817d0908b9","Type":"ContainerStarted","Data":"9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d"} Sep 09 23:10:27.448875 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.448843 2561 generic.go:356] "Generic (PLEG): container finished" podID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerID="100c88b87fe459318222b78fd629f96aa57b73da43afaf11dea34ed48f35f40d" exitCode=0 Sep 09 23:10:27.449251 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.448919 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" event={"ID":"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f","Type":"ContainerDied","Data":"100c88b87fe459318222b78fd629f96aa57b73da43afaf11dea34ed48f35f40d"} Sep 09 23:10:27.450853 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.450833 2561 generic.go:356] "Generic (PLEG): container finished" podID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerID="4e4900a6418d344914fbf1534c9a2375475d18748e13e3e7e49f80f112a10bc6" exitCode=0 Sep 09 23:10:27.450959 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.450920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" event={"ID":"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d","Type":"ContainerDied","Data":"4e4900a6418d344914fbf1534c9a2375475d18748e13e3e7e49f80f112a10bc6"} Sep 09 23:10:27.452894 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.452875 2561 generic.go:356] "Generic (PLEG): container finished" podID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerID="51e747b2c2b2aa328703fc8926f7e4ef7dd237cfa212977396e20545916890fe" exitCode=0 Sep 09 23:10:27.453004 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.452940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" event={"ID":"eb162b54-2ead-4a82-a42b-ca817d0908b9","Type":"ContainerDied","Data":"51e747b2c2b2aa328703fc8926f7e4ef7dd237cfa212977396e20545916890fe"} Sep 09 23:10:27.454881 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.454863 2561 generic.go:356] "Generic (PLEG): container finished" podID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerID="2c73a38389ff1b368667e1a3d42cfbaf7139f71f3744eb98f08fd1b92c0b3616" exitCode=0 Sep 09 23:10:27.454961 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:27.454898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" event={"ID":"e7098939-6a76-4abc-85ca-de4497d6d83f","Type":"ContainerDied","Data":"2c73a38389ff1b368667e1a3d42cfbaf7139f71f3744eb98f08fd1b92c0b3616"} Sep 09 23:10:28.462244 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.462206 2561 generic.go:356] "Generic (PLEG): container finished" podID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerID="87a7b37ccbbad2c939a9e6528bb528dab81ce5f1f989a41ad132eb1379b4975e" exitCode=0 Sep 09 23:10:28.462699 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.462299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" event={"ID":"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f","Type":"ContainerDied","Data":"87a7b37ccbbad2c939a9e6528bb528dab81ce5f1f989a41ad132eb1379b4975e"} Sep 09 23:10:28.464366 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.464347 2561 generic.go:356] "Generic (PLEG): container finished" podID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerID="4e333ae88758951b4cb194ed150a54a6333ac4d2b4fb8002a007b0ce431b806c" exitCode=0 Sep 09 23:10:28.464457 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.464438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" event={"ID":"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d","Type":"ContainerDied","Data":"4e333ae88758951b4cb194ed150a54a6333ac4d2b4fb8002a007b0ce431b806c"} Sep 09 23:10:28.466651 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.466628 2561 generic.go:356] "Generic (PLEG): container finished" podID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerID="086b3a3e204e043caf4f1fb53d29e558668b2ec1dd27a9747c2817aaa2d66149" exitCode=0 Sep 09 23:10:28.466779 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.466650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" event={"ID":"eb162b54-2ead-4a82-a42b-ca817d0908b9","Type":"ContainerDied","Data":"086b3a3e204e043caf4f1fb53d29e558668b2ec1dd27a9747c2817aaa2d66149"} Sep 09 23:10:28.468772 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.468753 2561 generic.go:356] "Generic (PLEG): container finished" podID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerID="3c89ea2824fcf20922c1a4d17ab429517fc67819f18819790cc9f3474a8de04f" exitCode=0 Sep 09 23:10:28.468852 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:28.468820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" event={"ID":"e7098939-6a76-4abc-85ca-de4497d6d83f","Type":"ContainerDied","Data":"3c89ea2824fcf20922c1a4d17ab429517fc67819f18819790cc9f3474a8de04f"} Sep 09 23:10:29.633281 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.633253 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:29.663237 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.663209 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:29.665967 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.665950 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:29.669469 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.669451 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:29.744907 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util\") pod \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " Sep 09 23:10:29.744907 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util\") pod \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " Sep 09 23:10:29.744907 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744890 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbwzj\" (UniqueName: \"kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj\") pod \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744913 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle\") pod \"eb162b54-2ead-4a82-a42b-ca817d0908b9\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744949 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle\") pod \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.744983 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle\") pod \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\" (UID: \"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745033 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ww7k\" (UniqueName: \"kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k\") pod \"e7098939-6a76-4abc-85ca-de4497d6d83f\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745056 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util\") pod \"eb162b54-2ead-4a82-a42b-ca817d0908b9\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745091 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util\") pod \"e7098939-6a76-4abc-85ca-de4497d6d83f\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " Sep 09 23:10:29.745163 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745154 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t85c\" (UniqueName: \"kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c\") pod \"eb162b54-2ead-4a82-a42b-ca817d0908b9\" (UID: \"eb162b54-2ead-4a82-a42b-ca817d0908b9\") " Sep 09 23:10:29.745487 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745180 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzk4c\" (UniqueName: \"kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c\") pod \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\" (UID: \"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f\") " Sep 09 23:10:29.745487 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745215 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle\") pod \"e7098939-6a76-4abc-85ca-de4497d6d83f\" (UID: \"e7098939-6a76-4abc-85ca-de4497d6d83f\") " Sep 09 23:10:29.745664 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745617 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle" (OuterVolumeSpecName: "bundle") pod "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" (UID: "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.748074 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.745811 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle" (OuterVolumeSpecName: "bundle") pod "eb162b54-2ead-4a82-a42b-ca817d0908b9" (UID: "eb162b54-2ead-4a82-a42b-ca817d0908b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.748074 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.746143 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle" (OuterVolumeSpecName: "bundle") pod "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" (UID: "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.748074 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.746262 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle" (OuterVolumeSpecName: "bundle") pod "e7098939-6a76-4abc-85ca-de4497d6d83f" (UID: "e7098939-6a76-4abc-85ca-de4497d6d83f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.748074 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.747988 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k" (OuterVolumeSpecName: "kube-api-access-6ww7k") pod "e7098939-6a76-4abc-85ca-de4497d6d83f" (UID: "e7098939-6a76-4abc-85ca-de4497d6d83f"). InnerVolumeSpecName "kube-api-access-6ww7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:29.748354 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.748126 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj" (OuterVolumeSpecName: "kube-api-access-bbwzj") pod "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" (UID: "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d"). InnerVolumeSpecName "kube-api-access-bbwzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:29.748527 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.748495 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c" (OuterVolumeSpecName: "kube-api-access-6t85c") pod "eb162b54-2ead-4a82-a42b-ca817d0908b9" (UID: "eb162b54-2ead-4a82-a42b-ca817d0908b9"). InnerVolumeSpecName "kube-api-access-6t85c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:29.748728 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.748710 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c" (OuterVolumeSpecName: "kube-api-access-bzk4c") pod "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" (UID: "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f"). InnerVolumeSpecName "kube-api-access-bzk4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:29.752188 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.752157 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util" (OuterVolumeSpecName: "util") pod "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" (UID: "c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.753018 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.752997 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util" (OuterVolumeSpecName: "util") pod "eb162b54-2ead-4a82-a42b-ca817d0908b9" (UID: "eb162b54-2ead-4a82-a42b-ca817d0908b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.753973 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.753939 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util" (OuterVolumeSpecName: "util") pod "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" (UID: "b46d47e4-73c7-41e6-af3e-0bb7e2c7360f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.754436 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.754415 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util" (OuterVolumeSpecName: "util") pod "e7098939-6a76-4abc-85ca-de4497d6d83f" (UID: "e7098939-6a76-4abc-85ca-de4497d6d83f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:10:29.846227 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846191 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ww7k\" (UniqueName: \"kubernetes.io/projected/e7098939-6a76-4abc-85ca-de4497d6d83f-kube-api-access-6ww7k\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846227 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846222 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846227 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846234 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846243 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t85c\" (UniqueName: \"kubernetes.io/projected/eb162b54-2ead-4a82-a42b-ca817d0908b9-kube-api-access-6t85c\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846253 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzk4c\" (UniqueName: \"kubernetes.io/projected/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-kube-api-access-bzk4c\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846261 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7098939-6a76-4abc-85ca-de4497d6d83f-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846269 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846275 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-util\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846283 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbwzj\" (UniqueName: \"kubernetes.io/projected/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-kube-api-access-bbwzj\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846290 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb162b54-2ead-4a82-a42b-ca817d0908b9-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846297 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46d47e4-73c7-41e6-af3e-0bb7e2c7360f-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.846433 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:29.846304 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d-bundle\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:10:30.480244 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.480210 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" Sep 09 23:10:30.480430 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.480209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avhx69" event={"ID":"b46d47e4-73c7-41e6-af3e-0bb7e2c7360f","Type":"ContainerDied","Data":"cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032"} Sep 09 23:10:30.480430 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.480360 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd5ba3a2b66a48c20f90ab4282e62ad6b154972da73b3fb022a41abcdb065032" Sep 09 23:10:30.482222 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.482203 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" Sep 09 23:10:30.482339 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.482233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gmt88" event={"ID":"c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d","Type":"ContainerDied","Data":"1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab"} Sep 09 23:10:30.482339 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.482265 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f2f62e3f44a2f796a9bea7b5c77a09b1068539bdacde52180b0084ad6a2beab" Sep 09 23:10:30.484314 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.484292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" event={"ID":"eb162b54-2ead-4a82-a42b-ca817d0908b9","Type":"ContainerDied","Data":"9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d"} Sep 09 23:10:30.484424 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.484333 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dcf824c5bf7be8f32266e32edfa6fd19d88468d371c373bfc3db831946f905d" Sep 09 23:10:30.484424 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.484299 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjv64f" Sep 09 23:10:30.486235 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.486215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" event={"ID":"e7098939-6a76-4abc-85ca-de4497d6d83f","Type":"ContainerDied","Data":"33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df"} Sep 09 23:10:30.486324 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.486250 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33c190e12d355b569de3962e072f3f511e412ba771ad030a4f1fcfe08d9ee6df" Sep 09 23:10:30.486324 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:30.486268 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hxxvs" Sep 09 23:10:34.185581 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:34.185540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:34.283216 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:34.283188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:35.462375 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:35.462333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:36.115139 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:36.115104 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:36.217595 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:36.217540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:37.883928 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:37.883888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:38.297070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:38.297036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:39.306253 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:39.306225 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:39.412888 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:39.412851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:40.513735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:40.513704 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:40.665136 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:40.665095 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:41.274892 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:41.274860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:41.676248 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:41.676214 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:42.145229 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:42.145146 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:42.243032 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:42.242995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:45.078349 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:45.078318 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:45.871054 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:45.871017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:45.965077 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:45.965041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:46.920386 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:46.920346 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:48.086537 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:48.086499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:48.188013 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:48.187977 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:52.006557 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:52.006517 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:52.382930 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:52.382820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:52.708273 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:52.708236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:52.815764 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:52.815716 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:52.911889 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:52.911850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:53.019782 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:53.019695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:57.944768 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:57.944724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:58.024547 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:58.024511 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:10:58.100506 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:10:58.100468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:05.042546 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:05.042514 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:05.140970 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:05.140931 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:07.536406 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:07.536365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:07.638339 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:07.638302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:11.021072 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:11.021037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:12.156617 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:12.156522 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:12.256531 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:12.256497 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:16.950762 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:16.950731 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:17.070862 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:17.070824 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:18.634545 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:18.634507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:19.313260 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:19.313225 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:19.414530 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:19.414499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:23.969875 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:23.969832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:24.071016 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:24.070985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:26.571816 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:26.571779 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:26.673326 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:26.673294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:31.040426 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:31.040391 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:31.275073 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:31.275032 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:31.991222 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:31.991186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:32.059228 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:32.059198 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:32.380065 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:32.379983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:32.481004 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:32.480973 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:34.453057 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:34.453024 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:36.594670 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:36.594633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:36.694340 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:36.694302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:36.812489 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:36.812459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:36.946396 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:36.946364 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:37.015759 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:37.015714 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:37.654486 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:37.654445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:37.762435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:37.762404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:43.800669 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:43.800625 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:43.902042 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:43.901999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:57.974301 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:57.974268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:58.072464 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:58.072424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:58.473750 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:11:58.473709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:11.339828 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:11.339795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:11.907135 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:11.907099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:17.720946 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.720895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:17.752199 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752170 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:17.752448 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752437 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="util" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752450 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="util" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752459 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="pull" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752464 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="pull" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752474 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="util" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752480 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="util" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752488 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="extract" Sep 09 23:12:17.752492 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752492 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752500 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752505 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752511 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752516 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752522 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752527 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752534 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="util" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752539 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="util" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752544 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752549 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="pull" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752553 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752558 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752580 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752585 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752592 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="util" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752597 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="util" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752642 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46d47e4-73c7-41e6-af3e-0bb7e2c7360f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752650 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4da66aa-dcd6-4aa8-b317-0d3a4b5d385d" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752657 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7098939-6a76-4abc-85ca-de4497d6d83f" containerName="extract" Sep 09 23:12:17.752721 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.752663 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb162b54-2ead-4a82-a42b-ca817d0908b9" containerName="extract" Sep 09 23:12:17.755452 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.755426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.758780 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.758760 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 09 23:12:17.760101 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.760084 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 09 23:12:17.760202 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.760103 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gk82k\"" Sep 09 23:12:17.760202 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.760103 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 09 23:12:17.767494 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.767476 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:17.822262 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.822225 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:17.839065 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.839038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.839198 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.839104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.839198 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.839140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97hq\" (UniqueName: \"kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.922983 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.922948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:17.938561 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.938533 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dff5c4b5-7d2zv"] Sep 09 23:12:17.939801 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.939769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.939924 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.939807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97hq\" (UniqueName: \"kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.939924 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.939833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.941883 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.941851 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:17.942379 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.942357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.942453 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.942389 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.947443 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.947424 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97hq\" (UniqueName: \"kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq\") pod \"maas-controller-6886dd5f96-vvxx9\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:17.952648 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:17.952627 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dff5c4b5-7d2zv"] Sep 09 23:12:18.040641 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.040545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-metrics-certs\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.040641 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.040610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-webhook-cert\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.040833 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.040704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqg9\" (UniqueName: \"kubernetes.io/projected/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-kube-api-access-qrqg9\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.066616 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.066548 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:18.141387 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.141348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqg9\" (UniqueName: \"kubernetes.io/projected/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-kube-api-access-qrqg9\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.141597 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.141431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-metrics-certs\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.141597 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.141449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-webhook-cert\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.144215 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.144182 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-metrics-certs\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.144346 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.144180 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-webhook-cert\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.150841 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.150819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqg9\" (UniqueName: \"kubernetes.io/projected/f6a02502-3242-4d2e-8c0c-ebb9ff1eb093-kube-api-access-qrqg9\") pod \"maas-controller-74dff5c4b5-7d2zv\" (UID: \"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093\") " pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.265881 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.265845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:18.355139 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.355107 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:18.356250 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:12:18.355825 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9775f044_6f89_4f5a_9da7_94009dd860fc.slice/crio-461f509e3a70e17d0cd10fbe28e6bc6b9b189d8bbdf3eed777e197f180ca90d7 WatchSource:0}: Error finding container 461f509e3a70e17d0cd10fbe28e6bc6b9b189d8bbdf3eed777e197f180ca90d7: Status 404 returned error can't find the container with id 461f509e3a70e17d0cd10fbe28e6bc6b9b189d8bbdf3eed777e197f180ca90d7 Sep 09 23:12:18.537682 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.537650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dff5c4b5-7d2zv"] Sep 09 23:12:18.539065 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:12:18.539040 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a02502_3242_4d2e_8c0c_ebb9ff1eb093.slice/crio-3faba755033a37daa199344d308568b4594009dd0123602989951d0d26aab592 WatchSource:0}: Error finding container 3faba755033a37daa199344d308568b4594009dd0123602989951d0d26aab592: Status 404 returned error can't find the container with id 3faba755033a37daa199344d308568b4594009dd0123602989951d0d26aab592 Sep 09 23:12:18.995801 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.995765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" event={"ID":"9775f044-6f89-4f5a-9da7-94009dd860fc","Type":"ContainerStarted","Data":"461f509e3a70e17d0cd10fbe28e6bc6b9b189d8bbdf3eed777e197f180ca90d7"} Sep 09 23:12:18.997371 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:18.997318 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" event={"ID":"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093","Type":"ContainerStarted","Data":"3faba755033a37daa199344d308568b4594009dd0123602989951d0d26aab592"} Sep 09 23:12:21.040280 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:21.040257 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 09 23:12:21.235932 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:21.235890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:21.333925 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:21.333840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:22.013218 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.013184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" event={"ID":"f6a02502-3242-4d2e-8c0c-ebb9ff1eb093","Type":"ContainerStarted","Data":"ac15e6f629fffa35204c20f2c214f98471bdefe58fbca96392c7e9a791126b79"} Sep 09 23:12:22.013405 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.013269 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:22.014827 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.014803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" event={"ID":"9775f044-6f89-4f5a-9da7-94009dd860fc","Type":"ContainerStarted","Data":"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa"} Sep 09 23:12:22.014950 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.014863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:22.070429 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.070373 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" podStartSLOduration=2.56673642 podStartE2EDuration="5.07035688s" totalImagesPullingTime="2.50362046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:22.06928453 +0000 UTC m=+781.627442505" watchObservedRunningTime="2026-09-09 23:12:22.07035688 +0000 UTC m=+781.628514908" Sep 09 23:12:22.110325 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:22.110275 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" podStartSLOduration=2.430423486 podStartE2EDuration="5.110258231s" totalImagesPullingTime="2.679834745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:22.109105781 +0000 UTC m=+781.667263777" watchObservedRunningTime="2026-09-09 23:12:22.110258231 +0000 UTC m=+781.668416207" Sep 09 23:12:33.022188 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.022149 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dff5c4b5-7d2zv" Sep 09 23:12:33.022627 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.022244 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:33.070177 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.070149 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:33.070347 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.070310 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" podUID="9775f044-6f89-4f5a-9da7-94009dd860fc" containerName="manager" containerID="cri-o://cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa" gracePeriod=30 Sep 09 23:12:33.314341 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.314317 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:33.368338 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.368305 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert\") pod \"9775f044-6f89-4f5a-9da7-94009dd860fc\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " Sep 09 23:12:33.368338 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.368344 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z97hq\" (UniqueName: \"kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq\") pod \"9775f044-6f89-4f5a-9da7-94009dd860fc\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " Sep 09 23:12:33.368613 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.368397 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs\") pod \"9775f044-6f89-4f5a-9da7-94009dd860fc\" (UID: \"9775f044-6f89-4f5a-9da7-94009dd860fc\") " Sep 09 23:12:33.370754 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.370717 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq" (OuterVolumeSpecName: "kube-api-access-z97hq") pod "9775f044-6f89-4f5a-9da7-94009dd860fc" (UID: "9775f044-6f89-4f5a-9da7-94009dd860fc"). InnerVolumeSpecName "kube-api-access-z97hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:33.370754 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.370716 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9775f044-6f89-4f5a-9da7-94009dd860fc" (UID: "9775f044-6f89-4f5a-9da7-94009dd860fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:33.370927 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.370769 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9775f044-6f89-4f5a-9da7-94009dd860fc" (UID: "9775f044-6f89-4f5a-9da7-94009dd860fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:33.469640 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.469607 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-webhook-cert\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:12:33.469640 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.469633 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z97hq\" (UniqueName: \"kubernetes.io/projected/9775f044-6f89-4f5a-9da7-94009dd860fc-kube-api-access-z97hq\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:12:33.469823 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:33.469655 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9775f044-6f89-4f5a-9da7-94009dd860fc-metrics-certs\") on node \"ip-10-0-142-25.ec2.internal\" DevicePath \"\"" Sep 09 23:12:34.074728 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.074687 2561 generic.go:356] "Generic (PLEG): container finished" podID="9775f044-6f89-4f5a-9da7-94009dd860fc" containerID="cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa" exitCode=0 Sep 09 23:12:34.075103 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.074753 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" Sep 09 23:12:34.075103 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.074752 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" event={"ID":"9775f044-6f89-4f5a-9da7-94009dd860fc","Type":"ContainerDied","Data":"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa"} Sep 09 23:12:34.075103 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.074872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6886dd5f96-vvxx9" event={"ID":"9775f044-6f89-4f5a-9da7-94009dd860fc","Type":"ContainerDied","Data":"461f509e3a70e17d0cd10fbe28e6bc6b9b189d8bbdf3eed777e197f180ca90d7"} Sep 09 23:12:34.075103 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.074899 2561 scope.go:117] "RemoveContainer" containerID="cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa" Sep 09 23:12:34.083910 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.083892 2561 scope.go:117] "RemoveContainer" containerID="cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa" Sep 09 23:12:34.084164 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:12:34.084147 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa\": container with ID starting with cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa not found: ID does not exist" containerID="cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa" Sep 09 23:12:34.084215 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.084173 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa"} err="failed to get container status \"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa\": rpc error: code = NotFound desc = could not find container \"cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa\": container with ID starting with cd479f09a89ff82c55cc76c80f3945daea21df1434fea69a518abae25cce1daa not found: ID does not exist" Sep 09 23:12:34.096549 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.096526 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:34.099897 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.099878 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6886dd5f96-vvxx9"] Sep 09 23:12:34.927258 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:34.927228 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9775f044-6f89-4f5a-9da7-94009dd860fc" path="/var/lib/kubelet/pods/9775f044-6f89-4f5a-9da7-94009dd860fc/volumes" Sep 09 23:12:51.359814 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:51.359720 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:51.461093 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:51.461057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:52.797101 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:52.797069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:52.908049 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:52.908016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:53.016754 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.016722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:53.053623 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.053550 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf575b86-v44wr"] Sep 09 23:12:53.053874 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.053862 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9775f044-6f89-4f5a-9da7-94009dd860fc" containerName="manager" Sep 09 23:12:53.053920 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.053877 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9775f044-6f89-4f5a-9da7-94009dd860fc" containerName="manager" Sep 09 23:12:53.053954 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.053929 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9775f044-6f89-4f5a-9da7-94009dd860fc" containerName="manager" Sep 09 23:12:53.056882 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.056867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.059776 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.059748 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 09 23:12:53.063127 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.061121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7qzlt\"" Sep 09 23:12:53.063127 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.061372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 09 23:12:53.063127 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.061644 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 09 23:12:53.063127 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.062153 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 09 23:12:53.068035 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.068010 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf575b86-v44wr"] Sep 09 23:12:53.153883 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.153845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:53.241226 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.241195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efeb0830-d071-40ca-833e-0044fcb350f9-openshift-service-ca\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.241226 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.241229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-metrics-certs\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.241435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.241250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phczq\" (UniqueName: \"kubernetes.io/projected/efeb0830-d071-40ca-833e-0044fcb350f9-kube-api-access-phczq\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.241435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.241379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-maas-api-tls\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.342259 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.342180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efeb0830-d071-40ca-833e-0044fcb350f9-openshift-service-ca\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.342259 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.342211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-metrics-certs\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.342259 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.342229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phczq\" (UniqueName: \"kubernetes.io/projected/efeb0830-d071-40ca-833e-0044fcb350f9-kube-api-access-phczq\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.342727 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.342306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-maas-api-tls\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.342835 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.342816 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efeb0830-d071-40ca-833e-0044fcb350f9-openshift-service-ca\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.345066 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.345043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-metrics-certs\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.345176 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.345126 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efeb0830-d071-40ca-833e-0044fcb350f9-maas-api-tls\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.350261 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.350238 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phczq\" (UniqueName: \"kubernetes.io/projected/efeb0830-d071-40ca-833e-0044fcb350f9-kube-api-access-phczq\") pod \"maas-api-7bf575b86-v44wr\" (UID: \"efeb0830-d071-40ca-833e-0044fcb350f9\") " pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.373258 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.373229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:53.514700 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.514671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:53.627962 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.627859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:53.660308 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:53.660281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf575b86-v44wr"] Sep 09 23:12:53.661880 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:12:53.661853 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefeb0830_d071_40ca_833e_0044fcb350f9.slice/crio-ccc64a8baeed5c387ca8a348b020075068587c050f9de1a2d31231ff8cd77ca7 WatchSource:0}: Error finding container ccc64a8baeed5c387ca8a348b020075068587c050f9de1a2d31231ff8cd77ca7: Status 404 returned error can't find the container with id ccc64a8baeed5c387ca8a348b020075068587c050f9de1a2d31231ff8cd77ca7 Sep 09 23:12:54.171791 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:54.171755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" event={"ID":"efeb0830-d071-40ca-833e-0044fcb350f9","Type":"ContainerStarted","Data":"ccc64a8baeed5c387ca8a348b020075068587c050f9de1a2d31231ff8cd77ca7"} Sep 09 23:12:56.182128 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:56.182102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" event={"ID":"efeb0830-d071-40ca-833e-0044fcb350f9","Type":"ContainerStarted","Data":"a6db27cf752fd04dfec1fe6e8657d076fbf57548e86c2898e939465f3696d1c8"} Sep 09 23:12:56.182509 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:56.182211 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:12:56.200156 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:12:56.200113 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" podStartSLOduration=0.990316122 podStartE2EDuration="3.200094928s" totalImagesPullingTime="2.209778806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:56.19916104 +0000 UTC m=+815.757319037" watchObservedRunningTime="2026-09-09 23:12:56.200094928 +0000 UTC m=+815.758252904" Sep 09 23:13:02.192941 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:02.192913 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bf575b86-v44wr" Sep 09 23:13:03.175556 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:03.175520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:03.277771 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:03.277734 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.492497 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.492455 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml"] Sep 09 23:13:24.496736 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.496708 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.500735 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.500716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:13:24.500873 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.500751 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:13:24.500873 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.500760 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cl4wn\"" Sep 09 23:13:24.501509 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.501487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 09 23:13:24.506605 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.506581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml"] Sep 09 23:13:24.531212 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.531170 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.606645 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.606806 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.606806 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqf4\" (UniqueName: \"kubernetes.io/projected/d3e6179b-4ebc-434d-ab89-e29d52ba7729-kube-api-access-gfqf4\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.606806 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.606806 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.606943 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.606826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707753 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707753 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqf4\" (UniqueName: \"kubernetes.io/projected/d3e6179b-4ebc-434d-ab89-e29d52ba7729-kube-api-access-gfqf4\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.707995 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.707898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.708232 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.708198 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.708352 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.708209 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.708352 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.708280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.710288 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.710271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e6179b-4ebc-434d-ab89-e29d52ba7729-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.710561 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.710544 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e6179b-4ebc-434d-ab89-e29d52ba7729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.717208 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.717172 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqf4\" (UniqueName: \"kubernetes.io/projected/d3e6179b-4ebc-434d-ab89-e29d52ba7729-kube-api-access-gfqf4\") pod \"e2e-distinct-2-simulated-kserve-859856b874-7nrml\" (UID: \"d3e6179b-4ebc-434d-ab89-e29d52ba7729\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:24.808614 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:24.808512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:25.090057 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:25.090019 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml"] Sep 09 23:13:25.323616 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:25.323554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerStarted","Data":"6ca02f688153df9f510e66464b0ca867af6867a8327f5c4ccdc074f932f1045f"} Sep 09 23:13:26.329668 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:26.329637 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="4a89a778054bd39bc65ad01aaba784ff77f16201e19bcbb3ee0e8d1942aa2636" exitCode=0 Sep 09 23:13:26.330036 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:26.329683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"4a89a778054bd39bc65ad01aaba784ff77f16201e19bcbb3ee0e8d1942aa2636"} Sep 09 23:13:26.330036 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:26.329933 2561 scope.go:117] "RemoveContainer" containerID="4a89a778054bd39bc65ad01aaba784ff77f16201e19bcbb3ee0e8d1942aa2636" Sep 09 23:13:27.336623 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:27.336564 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" exitCode=0 Sep 09 23:13:27.337052 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:27.336636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1"} Sep 09 23:13:27.337052 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:27.336687 2561 scope.go:117] "RemoveContainer" containerID="4a89a778054bd39bc65ad01aaba784ff77f16201e19bcbb3ee0e8d1942aa2636" Sep 09 23:13:27.337052 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:27.336854 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:27.337052 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:27.337014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:28.342704 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:28.342671 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:28.343166 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:28.342896 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:32.086365 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:32.086324 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:34.809496 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:34.809456 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:34.809923 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:34.809542 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:34.809923 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:34.809565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:34.809923 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:34.809610 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:34.810046 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:34.809980 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:34.810170 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:34.810151 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:35.376122 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:35.376096 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:35.376291 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:35.376270 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:42.020467 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:42.020431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:46.922264 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:46.922230 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:47.433315 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:47.433285 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7" exitCode=0 Sep 09 23:13:47.433489 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:47.433360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7"} Sep 09 23:13:47.433489 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:47.433419 2561 scope.go:117] "RemoveContainer" containerID="d9828fa15304b6b8cab8289af7d986dae36900a42589766d160eee537472cde1" Sep 09 23:13:47.433833 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:47.433818 2561 scope.go:117] "RemoveContainer" containerID="f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7" Sep 09 23:13:47.434047 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:47.434026 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:48.097750 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.097713 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25"] Sep 09 23:13:48.102312 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.102288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.105264 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.105239 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 23:13:48.112543 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.112773 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.112773 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.112773 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.112773 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.112993 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.112779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn2wh\" (UniqueName: \"kubernetes.io/projected/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-kube-api-access-tn2wh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.113906 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.113873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25"] Sep 09 23:13:48.137382 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.137306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:48.213277 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213277 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn2wh\" (UniqueName: \"kubernetes.io/projected/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-kube-api-access-tn2wh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213532 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213800 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213853 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.213890 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.213879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.215613 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.215599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.215967 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.215951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.222383 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.222361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn2wh\" (UniqueName: \"kubernetes.io/projected/fe8b39e4-96ec-4e91-bcd5-49e4364269ca-kube-api-access-tn2wh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kdj25\" (UID: \"fe8b39e4-96ec-4e91-bcd5-49e4364269ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.414878 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.414786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:48.690952 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:48.690924 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25"] Sep 09 23:13:48.692236 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:13:48.692206 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8b39e4_96ec_4e91_bcd5_49e4364269ca.slice/crio-09d9c0ef6757da4bad063cc4ef3d46070c776b6c0bea692b6c909b0cf4b78aa3 WatchSource:0}: Error finding container 09d9c0ef6757da4bad063cc4ef3d46070c776b6c0bea692b6c909b0cf4b78aa3: Status 404 returned error can't find the container with id 09d9c0ef6757da4bad063cc4ef3d46070c776b6c0bea692b6c909b0cf4b78aa3 Sep 09 23:13:49.446703 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:49.446665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" event={"ID":"fe8b39e4-96ec-4e91-bcd5-49e4364269ca","Type":"ContainerStarted","Data":"428ba9befb99d44561657ee27571533351f044ad61904cd42f1dda584879c6ba"} Sep 09 23:13:49.447099 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:49.446746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" event={"ID":"fe8b39e4-96ec-4e91-bcd5-49e4364269ca","Type":"ContainerStarted","Data":"09d9c0ef6757da4bad063cc4ef3d46070c776b6c0bea692b6c909b0cf4b78aa3"} Sep 09 23:13:49.464421 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:49.464364 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" podStartSLOduration=1.290677243 podStartE2EDuration="1.464349238s" totalImagesPullingTime="173.671995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:49.463768972 +0000 UTC m=+869.021926982" watchObservedRunningTime="2026-09-09 23:13:49.464349238 +0000 UTC m=+869.022507214" Sep 09 23:13:51.998197 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:51.998161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:54.808896 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:54.808853 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:54.809317 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:54.808933 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:54.809317 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:54.808953 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:54.809317 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:54.808972 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:13:54.809441 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:54.809325 2561 scope.go:117] "RemoveContainer" containerID="f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7" Sep 09 23:13:54.809515 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:13:54.809488 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:13:55.298663 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.298631 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7"] Sep 09 23:13:55.302265 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.302241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.305240 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.305215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:13:55.313475 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.313452 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7"] Sep 09 23:13:55.323116 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.323072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:55.361959 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.361919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17b6703-4429-4da2-acc9-e403d2292728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.362147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.361975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4w9s\" (UniqueName: \"kubernetes.io/projected/e17b6703-4429-4da2-acc9-e403d2292728-kube-api-access-r4w9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.362147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.362028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.362147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.362073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.362147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.362116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.362147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.362139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463428 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17b6703-4429-4da2-acc9-e403d2292728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463635 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4w9s\" (UniqueName: \"kubernetes.io/projected/e17b6703-4429-4da2-acc9-e403d2292728-kube-api-access-r4w9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463635 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463716 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463716 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463716 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.463965 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.463946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.464070 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.464053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.464147 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.464125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.466026 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.466004 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17b6703-4429-4da2-acc9-e403d2292728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.466193 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.466179 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17b6703-4429-4da2-acc9-e403d2292728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.472124 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.472099 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4w9s\" (UniqueName: \"kubernetes.io/projected/e17b6703-4429-4da2-acc9-e403d2292728-kube-api-access-r4w9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7\" (UID: \"e17b6703-4429-4da2-acc9-e403d2292728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.613827 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.613743 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:13:55.888219 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:55.888187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7"] Sep 09 23:13:55.889390 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:13:55.889349 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17b6703_4429_4da2_acc9_e403d2292728.slice/crio-1583e0dd956965af1b9126471aac684428de55584fa05134a4415bb96de15723 WatchSource:0}: Error finding container 1583e0dd956965af1b9126471aac684428de55584fa05134a4415bb96de15723: Status 404 returned error can't find the container with id 1583e0dd956965af1b9126471aac684428de55584fa05134a4415bb96de15723 Sep 09 23:13:56.480996 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:56.480955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" event={"ID":"e17b6703-4429-4da2-acc9-e403d2292728","Type":"ContainerStarted","Data":"238a8b17c4ad55277ac5856e2f2d4df23711f78d720e7a7e87b595bbc5ad09aa"} Sep 09 23:13:56.481148 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:56.481017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" event={"ID":"e17b6703-4429-4da2-acc9-e403d2292728","Type":"ContainerStarted","Data":"1583e0dd956965af1b9126471aac684428de55584fa05134a4415bb96de15723"} Sep 09 23:13:56.501214 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:56.501106 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" podStartSLOduration=1.234460574 podStartE2EDuration="1.501089637s" totalImagesPullingTime="266.629063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:56.500355603 +0000 UTC m=+876.058513592" watchObservedRunningTime="2026-09-09 23:13:56.501089637 +0000 UTC m=+876.059247613" Sep 09 23:13:58.414976 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:58.414936 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:58.415345 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:58.415001 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:58.427722 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:58.427696 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:13:58.502377 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:13:58.502345 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kdj25" Sep 09 23:14:04.227313 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:04.227275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:05.614423 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:05.614382 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:14:05.614933 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:05.614521 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:14:05.627566 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:05.627541 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:14:06.543687 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:06.543654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7" Sep 09 23:14:09.922813 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:09.922784 2561 scope.go:117] "RemoveContainer" containerID="f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7" Sep 09 23:14:10.553131 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:10.553044 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" exitCode=0 Sep 09 23:14:10.553131 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:10.553120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af"} Sep 09 23:14:10.553322 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:10.553184 2561 scope.go:117] "RemoveContainer" containerID="f2175fbc88a823d0bfa27de451945f44bb1965e1ea01bd58e158f8fb0336e6b7" Sep 09 23:14:10.553591 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:10.553549 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:10.553827 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:10.553803 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:14:14.809298 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:14.809212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:14.809298 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:14.809274 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:14.809298 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:14.809290 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:14.809298 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:14.809303 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:14.809880 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:14.809697 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:14.809917 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:14.809873 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:14:20.848208 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:20.848174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:14:20.849002 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:20.848982 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:14:22.195252 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:22.195216 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:25.922444 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:25.922418 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:25.924749 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:25.922611 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:14:37.922032 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:37.922003 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:37.922424 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:37.922189 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:14:51.922097 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:51.922070 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:51.922478 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:51.922347 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:14:52.761274 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:52.761241 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" exitCode=0 Sep 09 23:14:52.761458 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:52.761303 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019"} Sep 09 23:14:52.761458 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:52.761357 2561 scope.go:117] "RemoveContainer" containerID="0860bf37dee8329d9e71fc9715c518525ced6bf98d70adc85038dd1bb47116af" Sep 09 23:14:52.761828 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:52.761801 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:14:52.762016 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:52.761985 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:14:54.809001 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:54.808949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:54.809465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:54.809066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:54.809465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:54.809085 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:54.809465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:54.809099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:14:54.809465 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:14:54.809435 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:14:54.809707 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:14:54.809686 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:15:05.922393 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:15:05.922351 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:15:05.922830 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:15:05.922513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:15:16.922404 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:15:16.922371 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:15:16.922936 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:15:16.922541 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:15:22.832444 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:15:22.832403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:31.922118 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:15:31.922090 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:15:31.922516 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:15:31.922263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:15:45.922089 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:15:45.922011 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:15:45.922465 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:15:45.922190 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:16:00.924386 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:00.924355 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:16:00.924848 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:16:00.924615 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:16:14.922784 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:14.922745 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:16:16.170962 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:16.170922 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" exitCode=0 Sep 09 23:16:16.171388 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:16.170994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" event={"ID":"d3e6179b-4ebc-434d-ab89-e29d52ba7729","Type":"ContainerDied","Data":"87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6"} Sep 09 23:16:16.171388 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:16.171052 2561 scope.go:117] "RemoveContainer" containerID="6c719da51803de6c3400d4679b16327e4f89b191f3db6f3922234540e879f019" Sep 09 23:16:16.171388 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:16.171360 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:16:16.171590 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:16:16.171551 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:16:24.809493 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:24.809452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:16:24.809913 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:24.809521 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:16:24.809913 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:24.809537 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:16:24.809913 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:24.809552 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" Sep 09 23:16:24.809913 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:24.809911 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:16:24.810104 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:16:24.810078 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:16:39.922847 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:39.922812 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:16:39.923241 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:16:39.922966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:16:51.922890 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:16:51.922857 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:16:51.923348 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:16:51.923036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:17:03.922925 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:03.922888 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:17:03.923325 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:17:03.923100 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:17:09.451142 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:09.451111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:09.540321 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:09.540286 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:14.923106 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:14.923024 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:17:14.923468 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:17:14.923200 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:17:28.922522 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:28.922489 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:17:28.922998 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:17:28.922691 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:17:42.922469 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:42.922438 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:17:42.922896 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:17:42.922633 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:17:54.922635 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:17:54.922605 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:17:54.923093 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:17:54.922807 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:18:05.921980 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:05.921949 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:18:05.922447 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:18:05.922113 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:18:12.723500 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:12.723467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74dff5c4b5-7d2zv_f6a02502-3242-4d2e-8c0c-ebb9ff1eb093/manager/0.log" Sep 09 23:18:12.951821 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:12.951791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7cpms_95504448-ed0f-4fec-bf66-c243a37feaf5/manager/0.log" Sep 09 23:18:13.343638 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:13.343607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d8796fc4-fvlsj_43074e25-cd86-4f77-9174-a9428cc4fc5f/manager/0.log" Sep 09 23:18:13.349787 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:13.349762 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d8796fc4-fvlsj_43074e25-cd86-4f77-9174-a9428cc4fc5f/copy-manifests/0.log" Sep 09 23:18:13.700023 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:13.699994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7bf575b86-v44wr_efeb0830-d071-40ca-833e-0044fcb350f9/maas-api/0.log" Sep 09 23:18:15.802108 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:15.802077 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs_d824bcfa-bc67-426a-b21d-8e2c93bcb686/istio-proxy/0.log" Sep 09 23:18:15.926227 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:15.926201 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9f6hw_f70f5d09-2205-4994-9896-526e305083b7/discovery/0.log" Sep 09 23:18:16.969587 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:16.969548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-7nrml_d3e6179b-4ebc-434d-ab89-e29d52ba7729/main/5.log" Sep 09 23:18:17.327912 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:17.327836 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kdj25_fe8b39e4-96ec-4e91-bcd5-49e4364269ca/main/0.log" Sep 09 23:18:17.446944 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:17.446917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvdzp7_e17b6703-4429-4da2-acc9-e403d2292728/main/0.log" Sep 09 23:18:17.922383 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:17.922352 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:18:17.922598 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:18:17.922500 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:18:22.764098 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:22.764062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:22.869848 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:22.869816 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.837988 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:25.837950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dmv9g_b4e04167-625c-4d9c-b46e-34812688cf51/global-pull-secret-syncer/0.log" Sep 09 23:18:25.887486 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:25.887458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" Sep 09 23:18:26.027336 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:26.027309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-25.ec2.internal_fa185125bed916a8592295deab1ac091/haproxy/0.log" Sep 09 23:18:29.136143 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:29.136111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:29.922739 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:29.922705 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:18:29.922930 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:18:29.922884 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:18:30.537593 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:30.537540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6q5q8_4e02aebf-0377-49f8-a453-643ea03b59bd/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:32.508410 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:32.508377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-685c4d5c58-thw99_c012dd1a-5c5b-4e60-b60e-9ef072c29292/metrics-server/0.log" Sep 09 23:18:32.568214 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:32.568187 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4x_821de3ba-c191-444f-ac00-de83168ea3db/node-exporter/0.log" Sep 09 23:18:32.592590 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:32.592542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4x_821de3ba-c191-444f-ac00-de83168ea3db/kube-rbac-proxy/0.log" Sep 09 23:18:32.615872 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:32.615848 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6c4x_821de3ba-c191-444f-ac00-de83168ea3db/init-textfile/0.log" Sep 09 23:18:36.129407 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.129376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c6c5bcc5-kkzrn_3cec8bca-bb38-44cc-afe8-10c3f9da32b9/console/0.log" Sep 09 23:18:36.160198 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.160161 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-b48b6_949be171-a0cf-4809-98f3-b00cf6820a31/download-server/0.log" Sep 09 23:18:36.175870 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.175842 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb"] Sep 09 23:18:36.179115 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.179096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.181845 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.181821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5vzlx\"/\"openshift-service-ca.crt\"" Sep 09 23:18:36.181948 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.181825 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5vzlx\"/\"kube-root-ca.crt\"" Sep 09 23:18:36.182994 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.182977 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5vzlx\"/\"default-dockercfg-tghjq\"" Sep 09 23:18:36.188123 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.188076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb"] Sep 09 23:18:36.268501 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.268468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-lib-modules\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.268691 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.268530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v28dr\" (UniqueName: \"kubernetes.io/projected/482c00f3-0a40-4b80-9488-8e0bc59758c4-kube-api-access-v28dr\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.268691 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.268557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-sys\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.268691 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.268609 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-podres\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.268691 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.268639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-proc\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369530 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v28dr\" (UniqueName: \"kubernetes.io/projected/482c00f3-0a40-4b80-9488-8e0bc59758c4-kube-api-access-v28dr\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369646 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-sys\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369646 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-podres\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369646 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-proc\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369789 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-lib-modules\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369789 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369739 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-sys\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369789 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-proc\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369789 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-podres\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.369930 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.369832 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/482c00f3-0a40-4b80-9488-8e0bc59758c4-lib-modules\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.378029 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.378003 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v28dr\" (UniqueName: \"kubernetes.io/projected/482c00f3-0a40-4b80-9488-8e0bc59758c4-kube-api-access-v28dr\") pod \"perf-node-gather-daemonset-8grhb\" (UID: \"482c00f3-0a40-4b80-9488-8e0bc59758c4\") " pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.489050 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.489018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.761584 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.761549 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb"] Sep 09 23:18:36.762990 ip-10-0-142-25 kubenswrapper[2561]: W0909 23:18:36.762962 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod482c00f3_0a40_4b80_9488_8e0bc59758c4.slice/crio-582331e8a9686e55aa7081ca72cc53dfb334d4c9e60e16163ce55be5357eab71 WatchSource:0}: Error finding container 582331e8a9686e55aa7081ca72cc53dfb334d4c9e60e16163ce55be5357eab71: Status 404 returned error can't find the container with id 582331e8a9686e55aa7081ca72cc53dfb334d4c9e60e16163ce55be5357eab71 Sep 09 23:18:36.849249 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.849212 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" event={"ID":"482c00f3-0a40-4b80-9488-8e0bc59758c4","Type":"ContainerStarted","Data":"77f75f05f277f01d23f32430216cddad25f54f57f062132de95b029a9fd274ef"} Sep 09 23:18:36.849435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.849271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" event={"ID":"482c00f3-0a40-4b80-9488-8e0bc59758c4","Type":"ContainerStarted","Data":"582331e8a9686e55aa7081ca72cc53dfb334d4c9e60e16163ce55be5357eab71"} Sep 09 23:18:36.849435 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.849375 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:36.884739 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:36.884695 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" podStartSLOduration=0.884679879 podStartE2EDuration="884.679879ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:36.882661054 +0000 UTC m=+1156.440819048" watchObservedRunningTime="2026-09-09 23:18:36.884679879 +0000 UTC m=+1156.442837854" Sep 09 23:18:38.117090 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:38.117061 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mnfnq_ab69d037-2670-425d-a18c-b306d0ab6c99/dns/0.log" Sep 09 23:18:38.154243 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:38.154215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mnfnq_ab69d037-2670-425d-a18c-b306d0ab6c99/kube-rbac-proxy/0.log" Sep 09 23:18:38.248525 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:38.248497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpmns_5ecffe0f-bc84-4287-aec4-92c4992e1f14/dns-node-resolver/0.log" Sep 09 23:18:38.875935 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:38.875908 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzkxv_372ef220-706c-4c53-8249-ee2943d587ac/node-ca/0.log" Sep 09 23:18:39.787820 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:39.787779 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs_d824bcfa-bc67-426a-b21d-8e2c93bcb686/istio-proxy/0.log" Sep 09 23:18:39.837266 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:39.837234 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9f6hw_f70f5d09-2205-4994-9896-526e305083b7/discovery/0.log" Sep 09 23:18:40.652499 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:40.652470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hgsdj_d6e94f83-bb0c-42e6-9c16-6e696a6432c6/serve-healthcheck-canary/0.log" Sep 09 23:18:41.228963 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:41.228938 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlp7l_52e23bbd-2483-434e-9a59-1c6ec01fad66/kube-rbac-proxy/0.log" Sep 09 23:18:41.251671 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:41.251643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlp7l_52e23bbd-2483-434e-9a59-1c6ec01fad66/exporter/0.log" Sep 09 23:18:41.293614 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:41.293591 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rlp7l_52e23bbd-2483-434e-9a59-1c6ec01fad66/extractor/0.log" Sep 09 23:18:42.864400 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:42.864321 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5vzlx/perf-node-gather-daemonset-8grhb" Sep 09 23:18:43.541124 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:43.541095 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74dff5c4b5-7d2zv_f6a02502-3242-4d2e-8c0c-ebb9ff1eb093/manager/0.log" Sep 09 23:18:43.606985 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:43.606956 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7cpms_95504448-ed0f-4fec-bf66-c243a37feaf5/manager/0.log" Sep 09 23:18:43.762999 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:43.762973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d8796fc4-fvlsj_43074e25-cd86-4f77-9174-a9428cc4fc5f/manager/0.log" Sep 09 23:18:43.787273 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:43.787246 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d8796fc4-fvlsj_43074e25-cd86-4f77-9174-a9428cc4fc5f/copy-manifests/0.log" Sep 09 23:18:43.922158 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:43.922137 2561 scope.go:117] "RemoveContainer" containerID="87aa27bee9242369f387c895f6d52f25e9439280c0035d204a093d23eb422cf6" Sep 09 23:18:43.922517 ip-10-0-142-25 kubenswrapper[2561]: E0909 23:18:43.922316 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-7nrml_llm(d3e6179b-4ebc-434d-ab89-e29d52ba7729)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-7nrml" podUID="d3e6179b-4ebc-434d-ab89-e29d52ba7729" Sep 09 23:18:45.003327 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:45.003294 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c9946bf76-lvlw2_f7cbc338-4b06-417c-be2a-ee9a6b51299a/manager/0.log" Sep 09 23:18:46.521327 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:46.521241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs_d824bcfa-bc67-426a-b21d-8e2c93bcb686/istio-proxy/0.log" Sep 09 23:18:46.559464 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:46.559433 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9f6hw_f70f5d09-2205-4994-9896-526e305083b7/discovery/0.log" Sep 09 23:18:47.808454 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:47.808378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-llxgs_d824bcfa-bc67-426a-b21d-8e2c93bcb686/istio-proxy/0.log" Sep 09 23:18:47.849044 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:47.849013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9f6hw_f70f5d09-2205-4994-9896-526e305083b7/discovery/0.log" Sep 09 23:18:51.690094 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:51.690042 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8c244_6f689789-a67d-469f-adf1-7acb21823a55/kube-multus/0.log" Sep 09 23:18:52.024213 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.024183 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/kube-multus-additional-cni-plugins/0.log" Sep 09 23:18:52.051501 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.051477 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/egress-router-binary-copy/0.log" Sep 09 23:18:52.079459 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.079427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/cni-plugins/0.log" Sep 09 23:18:52.104619 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.104591 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/bond-cni-plugin/0.log" Sep 09 23:18:52.128321 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.128286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/routeoverride-cni/0.log" Sep 09 23:18:52.151475 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.151444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/whereabouts-cni-bincopy/0.log" Sep 09 23:18:52.174702 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.174675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbx29_a6c36a55-39eb-44b1-be70-e5b0772f2af0/whereabouts-cni/0.log" Sep 09 23:18:52.451994 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.451963 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n6mk7_f7353398-c9d2-4d2a-9af8-ed0922fd0449/network-metrics-daemon/0.log" Sep 09 23:18:52.472565 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:52.472544 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n6mk7_f7353398-c9d2-4d2a-9af8-ed0922fd0449/kube-rbac-proxy/0.log" Sep 09 23:18:53.521213 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.521184 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-controller/0.log" Sep 09 23:18:53.540238 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.540207 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/0.log" Sep 09 23:18:53.540238 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.540211 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovn-acl-logging/1.log" Sep 09 23:18:53.560551 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.560522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/kube-rbac-proxy-node/0.log" Sep 09 23:18:53.582508 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.582481 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:18:53.600524 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.600494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/northd/0.log" Sep 09 23:18:53.622530 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.622506 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/nbdb/0.log" Sep 09 23:18:53.644113 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.644092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/sbdb/0.log" Sep 09 23:18:53.685897 ip-10-0-142-25 kubenswrapper[2561]: I0909 23:18:53.685872 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftz28_7b6921d2-7735-4dd7-b586-048fcbeae660/ovnkube-controller/0.log"