Sep 19 01:37:17.858214 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 19 01:37:17.858224 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 19 01:37:17.858233 ip-10-0-137-224 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 19 01:37:17.858394 ip-10-0-137-224 systemd[1]: Failed to start Kubernetes Kubelet. Sep 19 01:37:27.880218 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 19 01:37:27.880237 ip-10-0-137-224 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d7b7baadae5f48e9b9b87528fca14b77 -- Sep 19 01:39:07.230049 ip-10-0-137-224 systemd[1]: Starting Kubernetes Kubelet... Sep 19 01:39:07.628398 ip-10-0-137-224 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:07.628398 ip-10-0-137-224 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 01:39:07.628398 ip-10-0-137-224 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:07.628398 ip-10-0-137-224 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 01:39:07.628398 ip-10-0-137-224 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:07.629065 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.628431 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 01:39:07.634545 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634527 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.634545 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634544 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634548 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634551 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634555 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634560 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634564 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634569 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634572 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634576 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634579 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634582 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634585 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634587 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634590 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634601 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634605 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634609 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634612 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.634609 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634615 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634618 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634622 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634625 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634629 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634632 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634635 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634637 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634640 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634643 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634645 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634648 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634651 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634653 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634656 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634658 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634661 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634664 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634666 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634669 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.635049 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634671 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634674 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634676 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634679 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634681 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634684 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634686 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634689 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634692 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634719 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634722 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634725 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634728 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634732 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634735 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634738 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634751 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634755 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634758 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634761 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.635682 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634764 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634767 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634770 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634773 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634776 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634779 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634782 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634784 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634787 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634789 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634792 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634795 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634797 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634802 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634806 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634809 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634811 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634815 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634817 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634820 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.636465 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634823 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634826 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634828 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634831 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634834 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634837 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634840 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634842 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634845 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634848 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634850 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634853 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634855 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634858 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634860 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634863 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634865 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634868 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634871 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.636977 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.634873 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637791 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637812 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637823 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637828 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637832 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637837 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637841 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637846 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637850 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637853 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637858 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637863 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637867 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637871 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.637894 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637875 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.637894 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638023 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638032 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638037 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638043 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638048 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638053 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638057 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638061 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638065 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638073 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638081 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638086 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638090 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638095 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638100 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638104 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638110 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.638583 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638114 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638119 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638124 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638128 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638133 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638138 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638145 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638151 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638155 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638159 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638163 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638168 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638172 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638176 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638180 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638185 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638191 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638195 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638199 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638203 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.639433 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638207 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638212 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638217 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638221 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638225 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638230 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638234 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638238 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638242 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638246 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638251 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638256 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638260 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638264 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638268 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638272 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638277 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638281 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638285 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638289 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.640320 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638294 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638298 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638302 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638306 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638310 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638317 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638321 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638326 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638331 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638336 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638340 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638345 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638350 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638354 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638359 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638363 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638368 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638372 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638376 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638380 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.641204 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638384 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638388 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638394 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638400 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638407 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.638413 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639061 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639079 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639086 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639090 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639096 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639100 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639105 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639110 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639114 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639119 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639123 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639127 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639131 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.641703 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639137 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639141 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639146 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639151 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639155 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639159 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639164 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639168 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639172 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639176 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639180 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639184 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639189 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639193 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639200 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639205 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639210 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639214 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639219 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.642272 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639224 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639228 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639232 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639236 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639240 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639244 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639248 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639252 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639256 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639260 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639265 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639269 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639273 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639278 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639282 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639287 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639291 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639299 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639304 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.642804 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639310 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639314 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639318 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639322 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639326 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639330 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639334 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639338 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639343 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639347 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639351 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639355 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639359 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639363 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639367 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639372 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639376 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639381 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639385 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639389 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.643311 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639393 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639397 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639402 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639406 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639410 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639413 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639419 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639423 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639428 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639432 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639436 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639440 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639445 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639449 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639453 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639457 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639461 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639466 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639471 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639475 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.644029 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639479 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639483 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639487 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639491 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639496 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639500 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639504 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.639508 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639619 2568 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639673 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639684 2568 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639691 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639698 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639704 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639711 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639718 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639723 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639729 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639735 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639757 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639763 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639768 2568 flags.go:64] FLAG: --cgroup-root="" Sep 19 01:39:07.644510 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639772 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639777 2568 flags.go:64] FLAG: --client-ca-file="" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639783 2568 flags.go:64] FLAG: --cloud-provider="external" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639788 2568 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639794 2568 flags.go:64] FLAG: --cluster-domain="" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639799 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639804 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639809 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639815 2568 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639822 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639826 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639832 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639837 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639842 2568 flags.go:64] FLAG: --contention-profiling="false" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639847 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639851 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639856 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639861 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639868 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639873 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639877 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639882 2568 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639887 2568 flags.go:64] FLAG: --enable-server="true" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639892 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639899 2568 flags.go:64] FLAG: --event-burst="100" Sep 19 01:39:07.645063 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639904 2568 flags.go:64] FLAG: --event-qps="50" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639909 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639914 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639921 2568 flags.go:64] FLAG: --eviction-hard="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639927 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639931 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639936 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639941 2568 flags.go:64] FLAG: --eviction-soft="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639946 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639951 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639956 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639961 2568 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639966 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639971 2568 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639976 2568 flags.go:64] FLAG: --feature-gates="" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639989 2568 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639994 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.639999 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640004 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640009 2568 flags.go:64] FLAG: --healthz-port="10248" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640014 2568 flags.go:64] FLAG: --help="false" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640019 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-224.ec2.internal" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640024 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640029 2568 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 01:39:07.645772 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640034 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640039 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640045 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640049 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640054 2568 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640059 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640064 2568 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640068 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640073 2568 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640078 2568 flags.go:64] FLAG: --kube-reserved="" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640084 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640089 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640094 2568 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640098 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640103 2568 flags.go:64] FLAG: --lock-file="" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640108 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640113 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640118 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640127 2568 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640132 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640137 2568 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640142 2568 flags.go:64] FLAG: --logging-format="text" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640147 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640153 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 01:39:07.646404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640157 2568 flags.go:64] FLAG: --manifest-url="" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640162 2568 flags.go:64] FLAG: --manifest-url-header="" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640169 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640174 2568 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640181 2568 flags.go:64] FLAG: --max-pods="110" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640185 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640190 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640197 2568 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640202 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640207 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640212 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640216 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640228 2568 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640233 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640237 2568 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640242 2568 flags.go:64] FLAG: --pod-cidr="" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640247 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640256 2568 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640261 2568 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640266 2568 flags.go:64] FLAG: --pods-per-core="0" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640271 2568 flags.go:64] FLAG: --port="10250" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640275 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640280 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-038489a672b2674a3" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640286 2568 flags.go:64] FLAG: --qos-reserved="" Sep 19 01:39:07.647079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640291 2568 flags.go:64] FLAG: --read-only-port="10255" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640295 2568 flags.go:64] FLAG: --register-node="true" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640300 2568 flags.go:64] FLAG: --register-with-taints="" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640306 2568 flags.go:64] FLAG: --registry-burst="10" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640312 2568 flags.go:64] FLAG: --registry-qps="5" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640317 2568 flags.go:64] FLAG: --reserved-cpus="" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640321 2568 flags.go:64] FLAG: --reserved-memory="" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640327 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640331 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640337 2568 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640341 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640346 2568 flags.go:64] FLAG: --runonce="false" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640350 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640356 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640361 2568 flags.go:64] FLAG: --seccomp-default="false" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640366 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640373 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640377 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640383 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640388 2568 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640392 2568 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640397 2568 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640402 2568 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640406 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640411 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 01:39:07.647687 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640416 2568 flags.go:64] FLAG: --system-cgroups="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640420 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640429 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640434 2568 flags.go:64] FLAG: --tls-cert-file="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640438 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640445 2568 flags.go:64] FLAG: --tls-min-version="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640450 2568 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640454 2568 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640459 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640464 2568 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640469 2568 flags.go:64] FLAG: --v="2" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640475 2568 flags.go:64] FLAG: --version="false" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640482 2568 flags.go:64] FLAG: --vmodule="" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640488 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.640494 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640686 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640693 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640698 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640703 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640708 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640715 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640721 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.648334 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640726 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640735 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640760 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640766 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640771 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640776 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640780 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640784 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640788 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640792 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640797 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640801 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640805 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640810 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640814 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640818 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640822 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640826 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640831 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.648980 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640835 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640839 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640844 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640848 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640853 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640857 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640861 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640866 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640870 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640874 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640879 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640883 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640888 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640892 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640898 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640902 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640907 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640911 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640915 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.649456 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640919 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640923 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640928 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640932 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640936 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640942 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640947 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640951 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640955 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640959 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640964 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640968 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640974 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640981 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640985 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640989 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640993 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.640998 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641003 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641007 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.649953 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641011 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641016 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641020 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641024 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641028 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641032 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641037 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641042 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641046 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641051 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641055 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641059 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641064 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641068 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641072 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641076 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641080 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641086 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641090 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641094 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.650470 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641098 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641102 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641106 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641111 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641115 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641120 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641124 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641128 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641132 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641136 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641141 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641145 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641150 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.641154 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.641823 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:07.651039 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650118 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650136 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650150 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650157 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650210 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650214 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650218 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650221 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650225 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650228 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650231 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650234 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650237 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650240 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650244 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650248 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650251 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650254 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650257 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.651428 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650261 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650264 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650268 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650271 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650274 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650276 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650279 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650282 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650285 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650287 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650290 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650293 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650296 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650299 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650303 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650306 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650308 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650311 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650314 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650316 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.651906 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650319 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650322 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650324 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650327 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650330 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650332 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650335 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650337 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650340 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650343 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650345 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650348 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650351 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650353 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650356 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650360 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650363 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650366 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650369 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.652393 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650372 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650375 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650377 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650380 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650383 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650385 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650388 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650391 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650395 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650398 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650400 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650403 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650406 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650408 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650411 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650414 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650416 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650419 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650421 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650424 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.652867 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650427 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650429 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650432 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650434 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650437 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650440 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650443 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650445 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650448 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650450 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650453 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650456 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650458 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650461 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650463 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650466 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650468 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650471 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650474 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650478 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.653347 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650481 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650484 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650488 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650490 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650493 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650498 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650610 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650614 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650617 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650620 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650623 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650626 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650629 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650632 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650635 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:07.653858 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650638 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650641 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650644 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650648 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650651 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650654 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650657 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650660 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650663 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650666 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650668 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650671 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650674 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650677 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650680 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650682 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650686 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650689 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650691 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:07.654234 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650694 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650697 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650700 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650702 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650705 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650708 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650710 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650713 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650716 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650718 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650721 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650723 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650726 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650729 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650731 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650734 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650736 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650739 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650756 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650760 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:07.654706 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650763 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650766 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650769 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650771 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650774 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650777 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650779 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650782 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650785 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650787 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650790 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650793 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650795 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650799 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650802 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650805 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650807 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650810 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650813 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650816 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:07.655302 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650818 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650821 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650823 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650826 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650829 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650831 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650834 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650836 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650839 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650841 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650844 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650847 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650849 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650852 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650854 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650857 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650860 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650862 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650865 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650867 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:07.655808 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650870 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650873 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650876 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650878 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650881 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650885 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650889 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650892 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650895 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650898 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:07.650902 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.650907 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.651018 2568 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.653330 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 01:39:07.656324 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.654272 2568 server.go:1019] "Starting client certificate rotation" Sep 19 01:39:07.656668 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.654376 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:07.656668 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.654413 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:07.657792 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.657779 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:07.658905 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.658887 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:07.670174 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.670148 2568 log.go:25] "Validated CRI v1 runtime API" Sep 19 01:39:07.672688 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.672659 2568 log.go:25] "Validated CRI v1 image API" Sep 19 01:39:07.673490 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.673476 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 01:39:07.676669 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.676649 2568 fs.go:135] Filesystem UUIDs: map[30f5244e-21e7-4fe3-a66e-a5eebb0fc5bf:/dev/nvme0n1p3 5ea026cd-d906-4ca6-a02a-6c54fd407a40:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 19 01:39:07.676727 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.676668 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 01:39:07.681838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.681716 2568 manager.go:216] Machine: {Timestamp:2026-09-19 01:39:07.680288952 +0000 UTC m=+0.338835489 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099007 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a12f70c105c7e64ea1eb22124ae17 SystemUUID:ec2a12f7-0c10-5c7e-64ea-1eb22124ae17 BootID:d7b7baad-ae5f-48e9-b9b8-7528fca14b77 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e0:3c:71:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e0:3c:71:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:6c:fd:ce:b7:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 01:39:07.681838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.681831 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 01:39:07.681959 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.681948 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 01:39:07.684663 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.684646 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:07.685534 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.685510 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 01:39:07.685706 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.685539 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 01:39:07.687077 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.687059 2568 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 01:39:07.687136 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.687082 2568 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 01:39:07.687136 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.687094 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:07.687923 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.687912 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:07.688011 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.688001 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 01:39:07.693548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693531 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:07.693672 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693663 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 01:39:07.693704 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693694 2568 kubelet.go:486] "Attempting to sync node with API server" Sep 19 01:39:07.693732 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693705 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 01:39:07.693732 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693723 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 01:39:07.693804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693736 2568 kubelet.go:398] "Adding apiserver pod source" Sep 19 01:39:07.693804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.693764 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 01:39:07.694157 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.694147 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:07.694198 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.694165 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:07.696932 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.696917 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 01:39:07.699861 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.699845 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 01:39:07.699966 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.699883 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 01:39:07.702158 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702145 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702167 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702178 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702187 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702199 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702208 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702227 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 01:39:07.702235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702235 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 01:39:07.702495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702245 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 01:39:07.702495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702295 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 01:39:07.702495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702321 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 01:39:07.702495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.702332 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 01:39:07.704173 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.704161 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 01:39:07.704239 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.704177 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 01:39:07.704391 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.704373 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 01:39:07.704424 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.704371 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 01:39:07.708069 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.708053 2568 server.go:1268] "Started kubelet" Sep 19 01:39:07.708186 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.708134 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 01:39:07.708237 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.708168 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 01:39:07.708279 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.708243 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 01:39:07.708982 ip-10-0-137-224 systemd[1]: Started Kubernetes Kubelet. Sep 19 01:39:07.710006 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.709984 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 01:39:07.710886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.710873 2568 server.go:310] "Adding debug handlers to kubelet server" Sep 19 01:39:07.713393 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.713318 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 01:39:07.716529 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.716505 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 01:39:07.719970 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.719954 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 01:39:07.720071 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.719975 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:07.720174 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.720161 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:07.720824 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.720805 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 01:39:07.720912 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.720827 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 01:39:07.720912 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.720807 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 01:39:07.720912 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.720904 2568 reconstruct.go:97] "Volume reconstruction finished" Sep 19 01:39:07.720912 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.720911 2568 reconciler.go:29] "Reconciler: start to sync state" Sep 19 01:39:07.721235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721211 2568 factory.go:55] Registering systemd factory Sep 19 01:39:07.721235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721233 2568 factory.go:223] Registration of the systemd container factory successfully Sep 19 01:39:07.721422 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.716522 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e28b2bf8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.708025848 +0000 UTC m=+0.366572383,LastTimestamp:2026-09-19 01:39:07.708025848 +0000 UTC m=+0.366572383,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.721520 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721503 2568 factory.go:153] Registering CRI-O factory Sep 19 01:39:07.721572 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721526 2568 factory.go:223] Registration of the crio container factory successfully Sep 19 01:39:07.721615 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721586 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 01:39:07.721917 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721899 2568 factory.go:103] Registering Raw factory Sep 19 01:39:07.722007 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.721956 2568 manager.go:1196] Started watching for new ooms in manager Sep 19 01:39:07.722110 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.722086 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 19 01:39:07.722167 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.722139 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 19 01:39:07.722489 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.722476 2568 manager.go:349] Starting recovery of all containers Sep 19 01:39:07.728079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.728040 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 01:39:07.732158 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.732133 2568 manager.go:354] Recovery completed Sep 19 01:39:07.737816 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.737804 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.739909 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.739889 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.739982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.739938 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.739982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.739955 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.740658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.740634 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 01:39:07.740658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.740649 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 01:39:07.740793 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.740676 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:07.740793 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.740651 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.741494 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.741472 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bc9lm" Sep 19 01:39:07.741601 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.741587 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.741693 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.741616 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.741693 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.741627 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.747815 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.747735 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e471d685 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.739920005 +0000 UTC m=+0.398466550,LastTimestamp:2026-09-19 01:39:07.739920005 +0000 UTC m=+0.398466550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.749368 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.749354 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bc9lm" Sep 19 01:39:07.752170 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.752099 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e4723e7c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.73994662 +0000 UTC m=+0.398493157,LastTimestamp:2026-09-19 01:39:07.73994662 +0000 UTC m=+0.398493157,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.756117 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.756059 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e4727a63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.739961955 +0000 UTC m=+0.398508493,LastTimestamp:2026-09-19 01:39:07.739961955 +0000 UTC m=+0.398508493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.761620 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.761439 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-224.ec2.internal.18d69532e471d685\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e471d685 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.739920005 +0000 UTC m=+0.398466550,LastTimestamp:2026-09-19 01:39:07.741601685 +0000 UTC m=+0.400148226,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.767849 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.767791 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-224.ec2.internal.18d69532e4723e7c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e4723e7c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.73994662 +0000 UTC m=+0.398493157,LastTimestamp:2026-09-19 01:39:07.74162145 +0000 UTC m=+0.400167986,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.770337 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.770276 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-224.ec2.internal.18d69532e4727a63\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18d69532e4727a63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-09-19 01:39:07.739961955 +0000 UTC m=+0.398508493,LastTimestamp:2026-09-19 01:39:07.741630453 +0000 UTC m=+0.400176988,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Sep 19 01:39:07.821141 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.821099 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.866169 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.866226 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.866248 2568 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.866355 2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.868168 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.885476 2568 policy_none.go:49] "None policy: Start" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.885494 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 01:39:07.886437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.885505 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 01:39:07.887636 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.887623 2568 policy_none.go:47] "Start" Sep 19 01:39:07.921415 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.921395 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:07.924395 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.924381 2568 manager.go:337] "Starting Device Plugin manager" Sep 19 01:39:07.924504 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.924419 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 01:39:07.924504 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.924430 2568 server.go:87] "Starting device plugin registration server" Sep 19 01:39:07.924683 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.924671 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 01:39:07.924724 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.924687 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 01:39:07.925349 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.925212 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 01:39:07.925349 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.925300 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 01:39:07.925349 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.925307 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 01:39:07.925544 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.925400 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 01:39:07.925544 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.925438 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:07.936661 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.936623 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-224.ec2.internal\" not found" node="ip-10-0-137-224.ec2.internal" Sep 19 01:39:07.967436 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.966741 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal"] Sep 19 01:39:07.967541 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.967485 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.968486 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.968465 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.968595 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.968493 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.968595 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.968504 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.970820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.970807 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.970960 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.970944 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:07.971040 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.970980 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.971564 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971546 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.971658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971571 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.971658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971546 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.971658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971580 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.971658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971605 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.971658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.971622 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.973677 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.973664 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:07.973738 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.973687 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:07.974360 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.974347 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:07.974422 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.974371 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:07.974422 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:07.974384 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:07.989262 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.989244 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-224.ec2.internal\" not found" node="ip-10-0-137-224.ec2.internal" Sep 19 01:39:07.993717 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:07.993698 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-224.ec2.internal\" not found" node="ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.022210 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.022182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.022210 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.022213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.022384 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.022229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88ce1435fe9a8f35b60fb0b4eb4027b3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"88ce1435fe9a8f35b60fb0b4eb4027b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.025306 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.025281 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:08.026262 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.026247 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:08.026341 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.026272 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:08.026341 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.026282 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:08.026341 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.026311 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.034469 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.034453 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.034523 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.034476 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-224.ec2.internal\": node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.066594 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.066565 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.123389 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123358 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.123389 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.123542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88ce1435fe9a8f35b60fb0b4eb4027b3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"88ce1435fe9a8f35b60fb0b4eb4027b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.123542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.123542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/842de114e309d805f75b03ee0bfa1e98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"842de114e309d805f75b03ee0bfa1e98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.123542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.123507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88ce1435fe9a8f35b60fb0b4eb4027b3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"88ce1435fe9a8f35b60fb0b4eb4027b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.167636 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.167589 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.268227 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.268204 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.293403 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.293367 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.297371 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.297353 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.368906 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.368869 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.472485 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.472410 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Sep 19 01:39:08.538623 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.538600 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:08.623390 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.623361 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.635515 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.635480 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:08.637076 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.637061 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Sep 19 01:39:08.651327 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.651307 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:08.654716 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.654703 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 01:39:08.654847 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.654829 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 01:39:08.694472 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.694435 2568 apiserver.go:52] "Watching apiserver" Sep 19 01:39:08.710758 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.710735 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 01:39:08.711097 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.711076 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal","openshift-multus/multus-5wsq6","openshift-network-operator/iptables-alerter-nqx2g","openshift-ovn-kubernetes/ovnkube-node-lvxxl","kube-system/konnectivity-agent-n6vgf","openshift-cluster-node-tuning-operator/tuned-dh4gx","openshift-dns/node-resolver-qbb2w","openshift-image-registry/node-ca-f6stw","openshift-multus/multus-additional-cni-plugins-tkcjl","openshift-multus/network-metrics-daemon-8tb72","openshift-network-diagnostics/network-check-target-vz7wf","kube-system/global-pull-secret-syncer-9pvs7"] Sep 19 01:39:08.712185 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.712169 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:08.713758 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.713732 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.715874 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.715854 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 01:39:08.715981 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.715964 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.716119 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.716096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.716185 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.716161 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.716410 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.716388 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnrd5\"" Sep 19 01:39:08.718206 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718181 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.718333 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.718731 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718699 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 01:39:08.718875 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718853 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7nk92\"" Sep 19 01:39:08.718995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718881 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 01:39:08.718995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.718910 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.720080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720062 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:08.720815 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720650 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9b26m\"" Sep 19 01:39:08.720815 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720701 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.720815 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720722 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.720815 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.721144 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.720988 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 01:39:08.724393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.723916 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.724393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724228 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.724393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724252 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 01:39:08.724393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 01:39:08.724393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724298 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sdnwr\"" Sep 19 01:39:08.724674 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.724674 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.724485 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 01:39:08.725074 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.725040 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 01:39:08.727193 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.727265 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-k8s-cni-cncf-io\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727265 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-kubelet\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727340 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-systemd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727340 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-ovn\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727340 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-env-overrides\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727448 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe9dfbaf-0aff-4883-b719-470e07409f83-agent-certs\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.727448 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727390 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.727448 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-system-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727448 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-kubelet\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfvj\" (UniqueName: \"kubernetes.io/projected/95c077db-29de-40d2-b06e-03ddb26dd30b-kube-api-access-znfvj\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-cnibin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9188dd72-2422-47b7-a113-5b7fcaac2efa-iptables-alerter-script\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-systemd-units\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-node-log\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c077db-29de-40d2-b06e-03ddb26dd30b-ovn-node-metrics-cert\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-socket-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727695 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt86w\" (UniqueName: \"kubernetes.io/projected/99b8b5ca-2b63-4847-85d9-09c62a086a30-kube-api-access-xt86w\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-conf-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-multus-daemon-config\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-netns\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-var-lib-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727875 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-log-socket\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-bin\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-device-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.727986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.727982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-socket-dir-parent\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-netns\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728044 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9188dd72-2422-47b7-a113-5b7fcaac2efa-host-slash\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728074 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-slash\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-etc-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-script-lib\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728220 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-registration-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728263 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tctzc\"" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsqq\" (UniqueName: \"kubernetes.io/projected/d93945fa-9288-42d1-8faa-659efc846315-kube-api-access-6wsqq\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728331 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-sys-fs\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728353 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-cni-binary-copy\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-bin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-hostroot\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.728412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-multus-certs\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-etc-kubernetes\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6smf\" (UniqueName: \"kubernetes.io/projected/9188dd72-2422-47b7-a113-5b7fcaac2efa-kube-api-access-c6smf\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-multus\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728577 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-netd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-config\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.729110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.728649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe9dfbaf-0aff-4883-b719-470e07409f83-konnectivity-ca\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.729916 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.729899 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.729971 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.729926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.730201 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.730186 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cgqzl\"" Sep 19 01:39:08.730287 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.730272 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.732213 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.732195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.732686 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.732667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mfgw6\"" Sep 19 01:39:08.732877 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.732862 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.732961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.732865 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.733935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.733919 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:08.734593 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.734581 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.736960 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.736944 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.737049 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.737027 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:08.739382 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.739366 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:08.739454 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.739424 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:08.740643 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.740625 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 01:39:08.740798 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.740784 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 01:39:08.740865 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.740811 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 01:39:08.741666 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.741650 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 01:39:08.741898 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.741882 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.741977 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.741929 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:08.763104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.763075 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 01:39:08.763673 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.763655 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7hnj\"" Sep 19 01:39:08.775653 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.775624 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rfz4b\"" Sep 19 01:39:08.822758 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.822716 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 01:39:08.826456 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.826428 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bsllg" Sep 19 01:39:08.829459 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-systemd-units\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.829579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-node-log\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.829579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.829579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-sys\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.829579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829533 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w727\" (UniqueName: \"kubernetes.io/projected/c74e56a7-e39e-4231-86c2-995ad1999453-kube-api-access-4w727\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.829579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.829562 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-systemd-units\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830062 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830038 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-node-log\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-kubelet-config\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.830197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-socket-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.830197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt86w\" (UniqueName: \"kubernetes.io/projected/99b8b5ca-2b63-4847-85d9-09c62a086a30-kube-api-access-xt86w\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.830197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-log-socket\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830241 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-log-socket\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-bin\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-dbus\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-netns\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830351 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-bin\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830365 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-socket-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9188dd72-2422-47b7-a113-5b7fcaac2efa-host-slash\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-etc-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830418 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-netns\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9188dd72-2422-47b7-a113-5b7fcaac2efa-host-slash\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-run\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-tmp\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-etc-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.830478 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-registration-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-registration-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsqq\" (UniqueName: \"kubernetes.io/projected/d93945fa-9288-42d1-8faa-659efc846315-kube-api-access-6wsqq\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830621 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-hosts-file\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830692 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-sys-fs\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830710 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-cni-binary-copy\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-bin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-multus-certs\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-etc-kubernetes\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830830 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-sys-fs\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-etc-kubernetes\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830839 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-bin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830843 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-multus-certs\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-config\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe9dfbaf-0aff-4883-b719-470e07409f83-konnectivity-ca\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.830905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68129407-7656-423e-8380-71c6ba7d6484-host\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.831320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjjb\" (UniqueName: \"kubernetes.io/projected/63da4117-a15e-487a-83d7-d93420580186-kube-api-access-wwjjb\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-systemd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-env-overrides\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-modprobe-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-systemd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831205 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-system-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfvj\" (UniqueName: \"kubernetes.io/projected/95c077db-29de-40d2-b06e-03ddb26dd30b-kube-api-access-znfvj\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-system-cni-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks2hz\" (UniqueName: \"kubernetes.io/projected/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-kube-api-access-ks2hz\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68129407-7656-423e-8380-71c6ba7d6484-serviceca\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-system-cni-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-cnibin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.832350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831448 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-cni-binary-copy\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831475 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe9dfbaf-0aff-4883-b719-470e07409f83-konnectivity-ca\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9188dd72-2422-47b7-a113-5b7fcaac2efa-iptables-alerter-script\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831558 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-cnibin\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831566 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-env-overrides\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831589 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-config\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831530 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c077db-29de-40d2-b06e-03ddb26dd30b-ovn-node-metrics-cert\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-conf\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-cnibin\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-kubernetes\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-conf-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-multus-daemon-config\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-netns\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831930 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-conf-dir\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-var-lib-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-systemd\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.831977 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-netns\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-var-lib-kubelet\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832016 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-var-lib-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/68129407-7656-423e-8380-71c6ba7d6484-kube-api-access-cbz2k\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832018 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-device-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832057 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9188dd72-2422-47b7-a113-5b7fcaac2efa-iptables-alerter-script\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-socket-dir-parent\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-slash\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-script-lib\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-multus-socket-dir-parent\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832149 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-device-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysconfig\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832186 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-slash\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.833785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qf5\" (UniqueName: \"kubernetes.io/projected/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-kube-api-access-k6qf5\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-tuned\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832361 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832421 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d93945fa-9288-42d1-8faa-659efc846315-multus-daemon-config\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832429 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-hostroot\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832528 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-hostroot\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6smf\" (UniqueName: \"kubernetes.io/projected/9188dd72-2422-47b7-a113-5b7fcaac2efa-kube-api-access-c6smf\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832617 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95c077db-29de-40d2-b06e-03ddb26dd30b-ovnkube-script-lib\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832638 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-openvswitch\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.832599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-lib-modules\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-multus\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-netd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833203 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-tmp-dir\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.834519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833251 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-cni-multus\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-k8s-cni-cncf-io\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-cni-netd\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833332 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99b8b5ca-2b63-4847-85d9-09c62a086a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833312 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-run-k8s-cni-cncf-io\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-kubelet\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-ovn\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe9dfbaf-0aff-4883-b719-470e07409f83-agent-certs\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833443 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d93945fa-9288-42d1-8faa-659efc846315-host-var-lib-kubelet\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-host\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833457 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-run-ovn\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-kubelet\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.835502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.833582 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c077db-29de-40d2-b06e-03ddb26dd30b-host-kubelet\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.836214 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.836021 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95c077db-29de-40d2-b06e-03ddb26dd30b-ovn-node-metrics-cert\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.839151 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.839120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe9dfbaf-0aff-4883-b719-470e07409f83-agent-certs\") pod \"konnectivity-agent-n6vgf\" (UID: \"fe9dfbaf-0aff-4883-b719-470e07409f83\") " pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:08.839480 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.839463 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bsllg" Sep 19 01:39:08.846014 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.845986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6smf\" (UniqueName: \"kubernetes.io/projected/9188dd72-2422-47b7-a113-5b7fcaac2efa-kube-api-access-c6smf\") pod \"iptables-alerter-nqx2g\" (UID: \"9188dd72-2422-47b7-a113-5b7fcaac2efa\") " pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:08.846105 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.846038 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt86w\" (UniqueName: \"kubernetes.io/projected/99b8b5ca-2b63-4847-85d9-09c62a086a30-kube-api-access-xt86w\") pod \"aws-ebs-csi-driver-node-zg7nc\" (UID: \"99b8b5ca-2b63-4847-85d9-09c62a086a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:08.846243 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.846223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsqq\" (UniqueName: \"kubernetes.io/projected/d93945fa-9288-42d1-8faa-659efc846315-kube-api-access-6wsqq\") pod \"multus-5wsq6\" (UID: \"d93945fa-9288-42d1-8faa-659efc846315\") " pod="openshift-multus/multus-5wsq6" Sep 19 01:39:08.846705 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.846684 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfvj\" (UniqueName: \"kubernetes.io/projected/95c077db-29de-40d2-b06e-03ddb26dd30b-kube-api-access-znfvj\") pod \"ovnkube-node-lvxxl\" (UID: \"95c077db-29de-40d2-b06e-03ddb26dd30b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:08.850504 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.850484 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:08.889370 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.889323 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 01:34:07 +0000 UTC" deadline="2028-02-12 16:56:09.527589465 +0000 UTC" Sep 19 01:39:08.889370 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.889366 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12279h17m0.63822609s" Sep 19 01:39:08.933763 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.933763 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933793 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-kubernetes\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-systemd\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-var-lib-kubelet\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/68129407-7656-423e-8380-71c6ba7d6484-kube-api-access-cbz2k\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysconfig\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.933969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933955 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qf5\" (UniqueName: \"kubernetes.io/projected/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-kube-api-access-k6qf5\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934003 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-kubernetes\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934007 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-tuned\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934011 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-var-lib-kubelet\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933964 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysconfig\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.933939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-systemd\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.934276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-lib-modules\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.934340 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934399 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-tmp-dir\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.934416 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:09.434390613 +0000 UTC m=+2.092937155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-host\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934506 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-lib-modules\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-sys\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w727\" (UniqueName: \"kubernetes.io/projected/c74e56a7-e39e-4231-86c2-995ad1999453-kube-api-access-4w727\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-host\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934593 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-tmp-dir\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-kubelet-config\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-dbus\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.934644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934649 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934627 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-sys\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-run\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-kubelet-config\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-tmp\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934709 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-run\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-hosts-file\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68129407-7656-423e-8380-71c6ba7d6484-host\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934719 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8754f9ed-a37f-47ae-8fee-3b4724488700-dbus\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934775 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-hosts-file\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjjb\" (UniqueName: \"kubernetes.io/projected/63da4117-a15e-487a-83d7-d93420580186-kube-api-access-wwjjb\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934826 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68129407-7656-423e-8380-71c6ba7d6484-host\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-modprobe-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks2hz\" (UniqueName: \"kubernetes.io/projected/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-kube-api-access-ks2hz\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68129407-7656-423e-8380-71c6ba7d6484-serviceca\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-system-cni-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934951 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-modprobe-d\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.935535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.934993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-conf\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-system-cni-dir\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-cnibin\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935039 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.935070 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.935117 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:09.43510162 +0000 UTC m=+2.093648169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935160 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74e56a7-e39e-4231-86c2-995ad1999453-cnibin\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935161 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-sysctl-conf\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935314 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68129407-7656-423e-8380-71c6ba7d6484-serviceca\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.936455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.935548 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74e56a7-e39e-4231-86c2-995ad1999453-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.936957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.936936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-tmp\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.936999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.936966 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-etc-tuned\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.947607 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.947584 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:08.947735 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.947614 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:08.947735 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.947630 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:08.947735 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:08.947698 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:09.447678494 +0000 UTC m=+2.106225034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:08.949495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.949462 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/68129407-7656-423e-8380-71c6ba7d6484-kube-api-access-cbz2k\") pod \"node-ca-f6stw\" (UID: \"68129407-7656-423e-8380-71c6ba7d6484\") " pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:08.949612 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.949516 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w727\" (UniqueName: \"kubernetes.io/projected/c74e56a7-e39e-4231-86c2-995ad1999453-kube-api-access-4w727\") pod \"multus-additional-cni-plugins-tkcjl\" (UID: \"c74e56a7-e39e-4231-86c2-995ad1999453\") " pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:08.949673 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.949664 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjjb\" (UniqueName: \"kubernetes.io/projected/63da4117-a15e-487a-83d7-d93420580186-kube-api-access-wwjjb\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:08.949812 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.949779 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qf5\" (UniqueName: \"kubernetes.io/projected/ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f-kube-api-access-k6qf5\") pod \"node-resolver-qbb2w\" (UID: \"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f\") " pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:08.949969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:08.949952 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks2hz\" (UniqueName: \"kubernetes.io/projected/29e409df-1d2b-4378-a983-3bfe6f7a3c4e-kube-api-access-ks2hz\") pod \"tuned-dh4gx\" (UID: \"29e409df-1d2b-4378-a983-3bfe6f7a3c4e\") " pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:08.995976 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:08.995944 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842de114e309d805f75b03ee0bfa1e98.slice/crio-601d8556226054c5d690e926b51a461abe968697cab7dc07936da522852d6b02 WatchSource:0}: Error finding container 601d8556226054c5d690e926b51a461abe968697cab7dc07936da522852d6b02: Status 404 returned error can't find the container with id 601d8556226054c5d690e926b51a461abe968697cab7dc07936da522852d6b02 Sep 19 01:39:09.003982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.003956 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:39:09.026301 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.026281 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ce1435fe9a8f35b60fb0b4eb4027b3.slice/crio-09e9dd2883475ab7e0f2428fc1c76b7759d208e5ef5561a8b1829ea7a88f0368 WatchSource:0}: Error finding container 09e9dd2883475ab7e0f2428fc1c76b7759d208e5ef5561a8b1829ea7a88f0368: Status 404 returned error can't find the container with id 09e9dd2883475ab7e0f2428fc1c76b7759d208e5ef5561a8b1829ea7a88f0368 Sep 19 01:39:09.044914 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.044895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" Sep 19 01:39:09.053083 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.053060 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b8b5ca_2b63_4847_85d9_09c62a086a30.slice/crio-f2e5978782ad19a36e9452c37c7814eb4f75f567a37eb0768ae855098cd503e5 WatchSource:0}: Error finding container f2e5978782ad19a36e9452c37c7814eb4f75f567a37eb0768ae855098cd503e5: Status 404 returned error can't find the container with id f2e5978782ad19a36e9452c37c7814eb4f75f567a37eb0768ae855098cd503e5 Sep 19 01:39:09.065917 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.065896 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5wsq6" Sep 19 01:39:09.074417 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.074393 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93945fa_9288_42d1_8faa_659efc846315.slice/crio-5302f18fe898500a52ae4649288c4d79e06a98670c9ca315587b025c0027c6a2 WatchSource:0}: Error finding container 5302f18fe898500a52ae4649288c4d79e06a98670c9ca315587b025c0027c6a2: Status 404 returned error can't find the container with id 5302f18fe898500a52ae4649288c4d79e06a98670c9ca315587b025c0027c6a2 Sep 19 01:39:09.088967 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.088947 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqx2g" Sep 19 01:39:09.096724 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.096702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:09.096900 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.096879 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9188dd72_2422_47b7_a113_5b7fcaac2efa.slice/crio-f1d40cc99051b4e3073e36f0606195f1b0edd0181f6f12d17c93c943c3503b62 WatchSource:0}: Error finding container f1d40cc99051b4e3073e36f0606195f1b0edd0181f6f12d17c93c943c3503b62: Status 404 returned error can't find the container with id f1d40cc99051b4e3073e36f0606195f1b0edd0181f6f12d17c93c943c3503b62 Sep 19 01:39:09.102176 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.102157 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:09.105165 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.105141 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c077db_29de_40d2_b06e_03ddb26dd30b.slice/crio-8f11dd25c81668a98e4d115a3bc24317bc69e6e0ce4ff649915d01a751e29f58 WatchSource:0}: Error finding container 8f11dd25c81668a98e4d115a3bc24317bc69e6e0ce4ff649915d01a751e29f58: Status 404 returned error can't find the container with id 8f11dd25c81668a98e4d115a3bc24317bc69e6e0ce4ff649915d01a751e29f58 Sep 19 01:39:09.108164 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.108148 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:09.116355 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.116336 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9dfbaf_0aff_4883_b719_470e07409f83.slice/crio-217a0b27c926f4806317451134e7f15425b2fb15fe0a05b7783dcf0b5d31a1f0 WatchSource:0}: Error finding container 217a0b27c926f4806317451134e7f15425b2fb15fe0a05b7783dcf0b5d31a1f0: Status 404 returned error can't find the container with id 217a0b27c926f4806317451134e7f15425b2fb15fe0a05b7783dcf0b5d31a1f0 Sep 19 01:39:09.123714 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.123689 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" Sep 19 01:39:09.130845 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.130815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbb2w" Sep 19 01:39:09.131711 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.131687 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e409df_1d2b_4378_a983_3bfe6f7a3c4e.slice/crio-bf641a19922ffcd0c73f13d0d841243de2b80db7ab476de750540c4df7f4f382 WatchSource:0}: Error finding container bf641a19922ffcd0c73f13d0d841243de2b80db7ab476de750540c4df7f4f382: Status 404 returned error can't find the container with id bf641a19922ffcd0c73f13d0d841243de2b80db7ab476de750540c4df7f4f382 Sep 19 01:39:09.137800 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.137773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6stw" Sep 19 01:39:09.140434 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.140413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4a4af0_5c0d_4a72_85ef_2e34118c0b0f.slice/crio-3a3a1fe31d2ab19f8c6fd255383b4fd90598d74ff54cd7d2927eab63c59626cc WatchSource:0}: Error finding container 3a3a1fe31d2ab19f8c6fd255383b4fd90598d74ff54cd7d2927eab63c59626cc: Status 404 returned error can't find the container with id 3a3a1fe31d2ab19f8c6fd255383b4fd90598d74ff54cd7d2927eab63c59626cc Sep 19 01:39:09.146861 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.146840 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68129407_7656_423e_8380_71c6ba7d6484.slice/crio-d478d1309eb2417db8f82b5af84d4808ddc90f2f72bce365b3f9651928f0d1bc WatchSource:0}: Error finding container d478d1309eb2417db8f82b5af84d4808ddc90f2f72bce365b3f9651928f0d1bc: Status 404 returned error can't find the container with id d478d1309eb2417db8f82b5af84d4808ddc90f2f72bce365b3f9651928f0d1bc Sep 19 01:39:09.160737 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.160721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" Sep 19 01:39:09.169945 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:09.169921 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74e56a7_e39e_4231_86c2_995ad1999453.slice/crio-7ec9259e861871658177e1e1a026a8d4f96adc95e9b626693d2a0fbfdca9c407 WatchSource:0}: Error finding container 7ec9259e861871658177e1e1a026a8d4f96adc95e9b626693d2a0fbfdca9c407: Status 404 returned error can't find the container with id 7ec9259e861871658177e1e1a026a8d4f96adc95e9b626693d2a0fbfdca9c407 Sep 19 01:39:09.171645 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.171629 2568 kuberuntime_manager.go:1459] "Unhandled Error" err="init container egress-router-binary-copy start failed in pod multus-additional-cni-plugins-tkcjl_openshift-multus(c74e56a7-e39e-4231-86c2-995ad1999453): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 19 01:39:09.171704 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.171662 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" podUID="c74e56a7-e39e-4231-86c2-995ad1999453" Sep 19 01:39:09.437574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.437538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:09.437788 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.437589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:09.437788 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.437678 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:09.437788 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.437728 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:10.437714659 +0000 UTC m=+3.096261184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:09.437788 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.437678 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:09.437788 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.437760 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:10.437752696 +0000 UTC m=+3.096299220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:09.538951 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.538910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:09.539121 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.539096 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:09.539168 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.539123 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:09.539168 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.539135 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:09.539256 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.539195 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:10.539179722 +0000 UTC m=+3.197726247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:09.843965 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.843433 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:09 +0000 UTC" deadline="2028-06-11 04:12:06.605299194 +0000 UTC" Sep 19 01:39:09.843965 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.843483 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15146h32m56.761820878s" Sep 19 01:39:09.895421 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.895356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerStarted","Data":"7ec9259e861871658177e1e1a026a8d4f96adc95e9b626693d2a0fbfdca9c407"} Sep 19 01:39:09.901029 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:09.900997 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" podUID="c74e56a7-e39e-4231-86c2-995ad1999453" Sep 19 01:39:09.912766 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.912721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbb2w" event={"ID":"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f","Type":"ContainerStarted","Data":"3a3a1fe31d2ab19f8c6fd255383b4fd90598d74ff54cd7d2927eab63c59626cc"} Sep 19 01:39:09.926912 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.926871 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6vgf" event={"ID":"fe9dfbaf-0aff-4883-b719-470e07409f83","Type":"ContainerStarted","Data":"217a0b27c926f4806317451134e7f15425b2fb15fe0a05b7783dcf0b5d31a1f0"} Sep 19 01:39:09.957468 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.957424 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqx2g" event={"ID":"9188dd72-2422-47b7-a113-5b7fcaac2efa","Type":"ContainerStarted","Data":"f1d40cc99051b4e3073e36f0606195f1b0edd0181f6f12d17c93c943c3503b62"} Sep 19 01:39:09.990839 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:09.987601 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5wsq6" event={"ID":"d93945fa-9288-42d1-8faa-659efc846315","Type":"ContainerStarted","Data":"5302f18fe898500a52ae4649288c4d79e06a98670c9ca315587b025c0027c6a2"} Sep 19 01:39:10.001014 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.000948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" event={"ID":"99b8b5ca-2b63-4847-85d9-09c62a086a30","Type":"ContainerStarted","Data":"f2e5978782ad19a36e9452c37c7814eb4f75f567a37eb0768ae855098cd503e5"} Sep 19 01:39:10.009650 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.009612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" event={"ID":"88ce1435fe9a8f35b60fb0b4eb4027b3","Type":"ContainerStarted","Data":"09e9dd2883475ab7e0f2428fc1c76b7759d208e5ef5561a8b1829ea7a88f0368"} Sep 19 01:39:10.023088 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.023007 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"842de114e309d805f75b03ee0bfa1e98","Type":"ContainerStarted","Data":"601d8556226054c5d690e926b51a461abe968697cab7dc07936da522852d6b02"} Sep 19 01:39:10.041154 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.041112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6stw" event={"ID":"68129407-7656-423e-8380-71c6ba7d6484","Type":"ContainerStarted","Data":"d478d1309eb2417db8f82b5af84d4808ddc90f2f72bce365b3f9651928f0d1bc"} Sep 19 01:39:10.057027 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.056934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" event={"ID":"29e409df-1d2b-4378-a983-3bfe6f7a3c4e","Type":"ContainerStarted","Data":"bf641a19922ffcd0c73f13d0d841243de2b80db7ab476de750540c4df7f4f382"} Sep 19 01:39:10.068455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.068359 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"8f11dd25c81668a98e4d115a3bc24317bc69e6e0ce4ff649915d01a751e29f58"} Sep 19 01:39:10.421358 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.421103 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.448791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.448859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.449001 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.449067 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:12.449043785 +0000 UTC m=+5.107590316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.449465 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:10.449564 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.449516 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:12.449500485 +0000 UTC m=+5.108047017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:10.549758 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.549720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:10.549980 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.549911 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:10.549980 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.549937 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:10.549980 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.549950 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:10.550159 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.550016 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:12.549995895 +0000 UTC m=+5.208542422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:10.844565 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.844417 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:09 +0000 UTC" deadline="2028-07-04 22:55:25.76655254 +0000 UTC" Sep 19 01:39:10.844565 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.844483 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15717h16m14.922074094s" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.867555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.867706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.867808 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.867888 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:10.868264 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:10.868445 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:10.868373 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:12.463684 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.463640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:12.464169 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.463711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:12.464169 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.463867 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:12.464169 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.463932 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:16.463913939 +0000 UTC m=+9.122460464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:12.464368 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.464349 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:12.464419 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.464405 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:16.464389731 +0000 UTC m=+9.122936261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:12.564304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.564262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:12.564480 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.564446 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:12.564480 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.564465 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:12.564480 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.564478 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:12.564634 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.564536 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:16.564517186 +0000 UTC m=+9.223063711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.867263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.867397 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.867485 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.867391 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:12.867543 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:12.867770 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:12.867615 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:14.866823 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:14.866795 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:14.867284 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:14.866840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:14.867284 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:14.866910 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:14.867284 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:14.866948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:14.867284 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:14.867070 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:14.867613 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:14.867564 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:16.497679 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.497644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:16.498112 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.497715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:16.498112 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.497799 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:16.498112 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.497845 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:16.498112 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.497871 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:24.497852069 +0000 UTC m=+17.156398598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:16.498112 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.497909 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:24.497890389 +0000 UTC m=+17.156436912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:16.598149 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.598106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:16.598325 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.598296 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:16.598325 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.598321 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:16.598445 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.598333 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:16.598445 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.598392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:24.598370856 +0000 UTC m=+17.256917378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:16.867047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.866842 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:16.867245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.866847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:16.867245 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.867151 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:16.867362 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.867242 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:16.867362 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:16.866867 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:16.867362 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:16.867345 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:18.867108 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:18.867065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:18.867108 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:18.867095 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:18.867625 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:18.867095 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:18.867625 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:18.867191 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:18.867625 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:18.867297 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:18.867625 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:18.867406 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:20.866918 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:20.866878 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:20.867397 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:20.867000 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:20.867397 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:20.867003 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:20.867397 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:20.867017 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:20.867397 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:20.867115 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:20.867397 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:20.867191 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:22.866617 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:22.866577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:22.866617 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:22.866614 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:22.867131 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:22.866619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:22.867131 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:22.866703 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:22.867131 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:22.866829 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:22.867131 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:22.866922 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:24.553404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.553367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:24.553844 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.553418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:24.553844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.553526 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:24.553844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.553542 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:24.553844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.553597 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.55358062 +0000 UTC m=+33.212127147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:24.553844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.553614 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.553607909 +0000 UTC m=+33.212154432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:24.654730 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.654623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:24.654923 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.654820 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:24.654923 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.654850 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:24.654923 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.654865 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:24.655064 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.654936 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.654916458 +0000 UTC m=+33.313462983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:24.866532 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.866454 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:24.866821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.866454 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:24.866821 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.866585 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:24.866821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:24.866454 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:24.866821 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.866641 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:24.866821 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:24.866727 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:26.866638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:26.866605 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:26.867105 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:26.866610 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:26.867105 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:26.866610 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:26.867105 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:26.866838 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:26.867105 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:26.866702 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:26.867105 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:26.866862 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:28.112589 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.112154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" event={"ID":"99b8b5ca-2b63-4847-85d9-09c62a086a30","Type":"ContainerStarted","Data":"5ec86a380183ce3825a1894a9fe5915fc7e82f046c6207ec0d1c9e4fc44d24d0"} Sep 19 01:39:28.113858 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.113830 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" event={"ID":"88ce1435fe9a8f35b60fb0b4eb4027b3","Type":"ContainerStarted","Data":"cf188198c4e31e134ec6e7f3c3f6dbdcc98e4ec4df174ad82d749ca02bfb00b1"} Sep 19 01:39:28.115501 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.115473 2568 generic.go:356] "Generic (PLEG): container finished" podID="842de114e309d805f75b03ee0bfa1e98" containerID="e150cda81b8287e63d1e93215db792b619b969ebfa810839f616dd0da248cb14" exitCode=0 Sep 19 01:39:28.115613 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.115561 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"842de114e309d805f75b03ee0bfa1e98","Type":"ContainerDied","Data":"e150cda81b8287e63d1e93215db792b619b969ebfa810839f616dd0da248cb14"} Sep 19 01:39:28.117261 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.117201 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6stw" event={"ID":"68129407-7656-423e-8380-71c6ba7d6484","Type":"ContainerStarted","Data":"cf55466057ef0a5b48c621f29cb836d457a6288fd5f6d1632dc2cb9bdd321749"} Sep 19 01:39:28.118886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.118861 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" event={"ID":"29e409df-1d2b-4378-a983-3bfe6f7a3c4e","Type":"ContainerStarted","Data":"3f8a603d2307c42360ba6b311178a2cbb67e575c627b940f223cb92cdd408d06"} Sep 19 01:39:28.122220 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"e2481270d738ccf3e2a771dfd17bfd5e301d33db65db6ab87a0348ae1380caa2"} Sep 19 01:39:28.122331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"bf6421381ea82b24475223b63fe037f5aebaf5e3d13dd0aee096c7b6ef7d935e"} Sep 19 01:39:28.122331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122306 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"4aa3316e7cf4bf7cd3938f5dea00527bd9383b104d46bfdcea8d1a53b5420cf8"} Sep 19 01:39:28.122433 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"465e1d583fbf59d9069e48be9064db8de2c297fa5fe468c4846e85837fa5f42d"} Sep 19 01:39:28.122433 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122387 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"4e2940175a8264c23996edea73b4d717794d75b8a9b3076bfadb59649b0f8650"} Sep 19 01:39:28.122433 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.122421 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"0adb8c542fc7a1f0c73e0988ca8edc149adb49103b4cf361a0933631168f933a"} Sep 19 01:39:28.123797 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.123730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbb2w" event={"ID":"ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f","Type":"ContainerStarted","Data":"f85b9ea3701b01718b5c113de9e2f565aa16b77451d85c2e6c9f7b74d909d00f"} Sep 19 01:39:28.125349 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.125326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6vgf" event={"ID":"fe9dfbaf-0aff-4883-b719-470e07409f83","Type":"ContainerStarted","Data":"e680832e2a8df5b9fcf3ae836dd7110ee4d945698f45e2de9ab7811f187054f3"} Sep 19 01:39:28.127016 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.126987 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5wsq6" event={"ID":"d93945fa-9288-42d1-8faa-659efc846315","Type":"ContainerStarted","Data":"85e7fb7aa0b6ff9ef24f8b5c84c73b404692513434123b301cc8d0ef59cfbf5f"} Sep 19 01:39:28.127163 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.127124 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" podStartSLOduration=20.127113345 podStartE2EDuration="20.127113345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.126617421 +0000 UTC m=+20.785163969" watchObservedRunningTime="2026-09-19 01:39:28.127113345 +0000 UTC m=+20.785659889" Sep 19 01:39:28.155434 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.155383 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dh4gx" podStartSLOduration=2.110294941 podStartE2EDuration="20.155364713s" totalImagesPullingTime="18.045069772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.15478969 +0000 UTC m=+20.813336242" watchObservedRunningTime="2026-09-19 01:39:28.155364713 +0000 UTC m=+20.813911258" Sep 19 01:39:28.168790 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.168733 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbb2w" podStartSLOduration=2.132224612 podStartE2EDuration="20.1687129s" totalImagesPullingTime="18.036488288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.168288184 +0000 UTC m=+20.826834728" watchObservedRunningTime="2026-09-19 01:39:28.1687129 +0000 UTC m=+20.827259446" Sep 19 01:39:28.185481 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.185426 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n6vgf" podStartSLOduration=6.227330008 podStartE2EDuration="20.185408898s" totalImagesPullingTime="13.95807889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.184653435 +0000 UTC m=+20.843199978" watchObservedRunningTime="2026-09-19 01:39:28.185408898 +0000 UTC m=+20.843955444" Sep 19 01:39:28.198976 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.198933 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f6stw" podStartSLOduration=2.215769261 podStartE2EDuration="20.198915314s" totalImagesPullingTime="17.983146053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.198400042 +0000 UTC m=+20.856946586" watchObservedRunningTime="2026-09-19 01:39:28.198915314 +0000 UTC m=+20.857461858" Sep 19 01:39:28.214806 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.214734 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5wsq6" podStartSLOduration=1.986843055 podStartE2EDuration="20.214720539s" totalImagesPullingTime="18.227877484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:28.213965419 +0000 UTC m=+20.872511974" watchObservedRunningTime="2026-09-19 01:39:28.214720539 +0000 UTC m=+20.873267085" Sep 19 01:39:28.867313 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.867290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:28.867432 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.867396 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:28.867432 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:28.867398 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:28.867432 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:28.867412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:28.867613 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:28.867516 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:28.867613 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:28.867596 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:29.132467 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.132377 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="2249dca1de7d949082f5e74592c2d55f4316c9e3dcc6bf789164d8c98a2db867" exitCode=0 Sep 19 01:39:29.133286 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.132461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"2249dca1de7d949082f5e74592c2d55f4316c9e3dcc6bf789164d8c98a2db867"} Sep 19 01:39:29.134775 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.134735 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqx2g" event={"ID":"9188dd72-2422-47b7-a113-5b7fcaac2efa","Type":"ContainerStarted","Data":"5ef53c7a5988011997f66f0e48580b534ea89c989e1d40a1c6c2188a5c8a1efd"} Sep 19 01:39:29.137042 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.136991 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"842de114e309d805f75b03ee0bfa1e98","Type":"ContainerStarted","Data":"9276ed202d13492b9e319c9b9ce05b94b36c3cdd61845a810dc25c6723094375"} Sep 19 01:39:29.219994 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.219944 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" podStartSLOduration=21.219930102 podStartE2EDuration="21.219930102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:29.219627628 +0000 UTC m=+21.878174172" watchObservedRunningTime="2026-09-19 01:39:29.219930102 +0000 UTC m=+21.878476646" Sep 19 01:39:29.220151 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.220091 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nqx2g" podStartSLOduration=3.186905974 podStartE2EDuration="21.220084674s" totalImagesPullingTime="18.0331787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:29.194519524 +0000 UTC m=+21.853066077" watchObservedRunningTime="2026-09-19 01:39:29.220084674 +0000 UTC m=+21.878631220" Sep 19 01:39:29.331855 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.331831 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 01:39:29.936293 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.936187 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T01:39:29.331851776Z","UUID":"8ca963bb-66a9-444e-9729-37b6492ebef7","Handler":null,"Name":"","Endpoint":""} Sep 19 01:39:29.938682 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.938655 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 01:39:29.938828 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:29.938704 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 01:39:30.143735 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.143526 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"f6592b6cdda8cba273abed2a80a2b06ebb26311048d6999d0152eb38d6c5cecb"} Sep 19 01:39:30.145711 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.145681 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" event={"ID":"99b8b5ca-2b63-4847-85d9-09c62a086a30","Type":"ContainerStarted","Data":"fc5b58a84957f510b3349cb395c1c8da6d4f4e5b305157a2e2e0ce3134d60c2d"} Sep 19 01:39:30.867306 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.867265 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:30.867306 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.867301 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:30.867574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.867304 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:30.867574 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:30.867368 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:30.867574 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:30.867523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:30.867703 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:30.867626 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:30.903905 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.903877 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:30.904404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:30.904383 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:31.150161 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:31.150131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" event={"ID":"99b8b5ca-2b63-4847-85d9-09c62a086a30","Type":"ContainerStarted","Data":"03eef160910552522590fce59e52070b2c01559fcfbbadb938a9c18ff37b3a57"} Sep 19 01:39:31.150552 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:31.150360 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:31.150833 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:31.150817 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n6vgf" Sep 19 01:39:31.169683 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:31.169629 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg7nc" podStartSLOduration=2.612078084 podStartE2EDuration="23.169612621s" totalImagesPullingTime="20.557534537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:31.169257061 +0000 UTC m=+23.827803609" watchObservedRunningTime="2026-09-19 01:39:31.169612621 +0000 UTC m=+23.828159165" Sep 19 01:39:32.159079 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:32.159000 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" event={"ID":"95c077db-29de-40d2-b06e-03ddb26dd30b","Type":"ContainerStarted","Data":"0162781db5cb117f4154461c360312f2680e099a297ee04892a4c24eb0334d7e"} Sep 19 01:39:32.192615 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:32.192563 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" podStartSLOduration=6.099252896 podStartE2EDuration="24.192538601s" totalImagesPullingTime="18.093285705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:32.192311988 +0000 UTC m=+24.850858534" watchObservedRunningTime="2026-09-19 01:39:32.192538601 +0000 UTC m=+24.851085146" Sep 19 01:39:32.866995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:32.866957 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:32.867278 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:32.866957 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:32.867278 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:32.867087 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:32.867278 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:32.866957 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:32.867278 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:32.867160 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:32.867278 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:32.867231 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:33.161621 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:33.161594 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 01:39:33.162200 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:33.162173 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:33.162331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:33.162252 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:33.179670 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:33.179643 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:33.180090 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:33.180074 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:34.164098 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.163922 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 01:39:34.279293 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.279255 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9pvs7"] Sep 19 01:39:34.279444 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.279382 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:34.279492 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:34.279470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:34.282057 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.282034 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tb72"] Sep 19 01:39:34.282188 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.282130 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:34.282247 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:34.282219 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:34.293303 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.293280 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vz7wf"] Sep 19 01:39:34.293409 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:34.293367 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:34.293473 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:34.293449 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:35.167836 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.167799 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="9c6c75b37933cd2f457bf50de82cb4a78d627b615077c826d80a769379cfaf43" exitCode=0 Sep 19 01:39:35.168500 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.167884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"9c6c75b37933cd2f457bf50de82cb4a78d627b615077c826d80a769379cfaf43"} Sep 19 01:39:35.168500 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.167990 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 01:39:35.867364 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.867325 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:35.867550 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.867331 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:35.867550 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:35.867459 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:35.867550 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:35.867334 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:35.867550 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:35.867523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:35.867730 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:35.867597 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:36.575033 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:36.575004 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:39:37.180887 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:37.180604 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="3ec37c868232ed51e24f5074c4b83d03ef80a18852289c684d30477269dc5a39" exitCode=0 Sep 19 01:39:37.180887 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:37.180675 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"3ec37c868232ed51e24f5074c4b83d03ef80a18852289c684d30477269dc5a39"} Sep 19 01:39:37.867590 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:37.867554 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:37.868058 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:37.867634 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:37.868058 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:37.867647 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:37.868058 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:37.867741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:37.868058 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:37.867736 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:37.868058 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:37.867828 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:39.187488 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:39.187457 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="d709413e5bb3002eee8a25b6fcf5d666aa82c9f8e419f0d29d2a5aa4f373c1d9" exitCode=0 Sep 19 01:39:39.187856 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:39.187523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"d709413e5bb3002eee8a25b6fcf5d666aa82c9f8e419f0d29d2a5aa4f373c1d9"} Sep 19 01:39:39.866787 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:39.866735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:39.866957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:39.866735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:39.866957 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:39.866876 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tb72" podUID="63da4117-a15e-487a-83d7-d93420580186" Sep 19 01:39:39.866957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:39.866886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:39.867121 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:39.866978 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9pvs7" podUID="8754f9ed-a37f-47ae-8fee-3b4724488700" Sep 19 01:39:39.867121 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:39.867069 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vz7wf" podUID="cd0e3804-6ba9-4cc0-98b4-a64237b341b0" Sep 19 01:39:40.143274 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.143249 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeReady" Sep 19 01:39:40.143394 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.143384 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 01:39:40.198489 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.198457 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:39:40.223829 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.223797 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rsdtw"] Sep 19 01:39:40.223982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.223892 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.226650 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.226627 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49x4x\"" Sep 19 01:39:40.226789 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.226628 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 19 01:39:40.227028 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.227010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 19 01:39:40.227106 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.227038 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 19 01:39:40.235683 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.235664 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bqn4n"] Sep 19 01:39:40.235823 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.235799 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.235906 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.235821 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 19 01:39:40.240468 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.240452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 01:39:40.240952 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.240921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:39:40.241709 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.241693 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 01:39:40.257219 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.257191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:39:40.257330 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.257229 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rsdtw"] Sep 19 01:39:40.257330 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.257312 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.260172 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.260157 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 01:39:40.260572 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.260556 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-898pj\"" Sep 19 01:39:40.260996 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.260975 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 01:39:40.261155 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.261136 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 01:39:40.266583 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266686 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s898p\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266686 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266632 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266686 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266852 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266852 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266852 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.266986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.266865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.292850 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.292821 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqn4n"] Sep 19 01:39:40.367842 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.367802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.367848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.368068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.367888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-tmp-dir\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.368068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.367929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.367984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368009 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-config-volume\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368195 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s898p\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjvqn\" (UniqueName: \"kubernetes.io/projected/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-kube-api-access-zjvqn\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88ece72f-fa62-4e0c-af9f-314535fed31c-cert\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.368290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368283 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m8kz\" (UniqueName: \"kubernetes.io/projected/88ece72f-fa62-4e0c-af9f-314535fed31c-kube-api-access-2m8kz\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.368364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.368455 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.368472 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:40.368566 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.368535 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.868515614 +0000 UTC m=+33.527062143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:40.369419 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.369362 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.369576 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.369556 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.372688 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.372663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.372688 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.372680 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.385056 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.385005 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.387347 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.387324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s898p\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.469331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.469331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-tmp-dir\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-config-volume\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjvqn\" (UniqueName: \"kubernetes.io/projected/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-kube-api-access-zjvqn\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88ece72f-fa62-4e0c-af9f-314535fed31c-cert\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m8kz\" (UniqueName: \"kubernetes.io/projected/88ece72f-fa62-4e0c-af9f-314535fed31c-kube-api-access-2m8kz\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.469443 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:40.469553 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.469528 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:39:40.969506535 +0000 UTC m=+33.628053075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:39:40.469869 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.469829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-tmp-dir\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.470037 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.470014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-config-volume\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.471783 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.471767 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88ece72f-fa62-4e0c-af9f-314535fed31c-cert\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.478622 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.478597 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjvqn\" (UniqueName: \"kubernetes.io/projected/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-kube-api-access-zjvqn\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.479447 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.479429 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m8kz\" (UniqueName: \"kubernetes.io/projected/88ece72f-fa62-4e0c-af9f-314535fed31c-kube-api-access-2m8kz\") pod \"ingress-canary-bqn4n\" (UID: \"88ece72f-fa62-4e0c-af9f-314535fed31c\") " pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.526215 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.526183 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n6vgf_fe9dfbaf-0aff-4883-b719-470e07409f83/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:40.567273 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.567231 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqn4n" Sep 19 01:39:40.570591 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.570559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:40.570705 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.570611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:40.570768 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.570716 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:40.570768 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.570727 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:40.570844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.570805 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:12.570785732 +0000 UTC m=+65.229332258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:40.570844 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.570822 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret podName:8754f9ed-a37f-47ae-8fee-3b4724488700 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:12.570814219 +0000 UTC m=+65.229360743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret") pod "global-pull-secret-syncer-9pvs7" (UID: "8754f9ed-a37f-47ae-8fee-3b4724488700") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:40.622784 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.622724 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-n6vgf_fe9dfbaf-0aff-4883-b719-470e07409f83/konnectivity-agent/0.log" limit=1024 Sep 19 01:39:40.672040 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.671311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:40.672040 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.671564 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:40.672040 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.671583 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:40.672040 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.671596 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xnc4h for pod openshift-network-diagnostics/network-check-target-vz7wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:40.672040 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.671656 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h podName:cd0e3804-6ba9-4cc0-98b4-a64237b341b0 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:12.671637353 +0000 UTC m=+65.330183895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnc4h" (UniqueName: "kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h") pod "network-check-target-vz7wf" (UID: "cd0e3804-6ba9-4cc0-98b4-a64237b341b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:40.873413 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.873375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:40.873574 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.873530 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:40.873574 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.873549 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:40.873655 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.873614 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:39:41.873594995 +0000 UTC m=+34.532141532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:40.886641 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.886603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqn4n"] Sep 19 01:39:40.890784 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:39:40.890756 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ece72f_fa62_4e0c_af9f_314535fed31c.slice/crio-8a1b3b82859beb64a17b28b4880a5a8834c1a6c0e4d99430db288787fba82ee0 WatchSource:0}: Error finding container 8a1b3b82859beb64a17b28b4880a5a8834c1a6c0e4d99430db288787fba82ee0: Status 404 returned error can't find the container with id 8a1b3b82859beb64a17b28b4880a5a8834c1a6c0e4d99430db288787fba82ee0 Sep 19 01:39:40.974183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:40.974098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:40.974375 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.974249 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:40.974375 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:40.974319 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:39:41.974300164 +0000 UTC m=+34.632846690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:39:41.194504 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.194471 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqn4n" event={"ID":"88ece72f-fa62-4e0c-af9f-314535fed31c","Type":"ContainerStarted","Data":"8a1b3b82859beb64a17b28b4880a5a8834c1a6c0e4d99430db288787fba82ee0"} Sep 19 01:39:41.867493 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.867329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:39:41.867942 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.867529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:39:41.868070 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.868048 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:39:41.871841 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.871821 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 01:39:41.871935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.871873 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:39:41.871935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.871927 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:39:41.873107 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.873086 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 01:39:41.873297 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.873269 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:39:41.873297 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.873285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:39:41.881586 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.881567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:41.881680 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:41.881661 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:41.881680 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:41.881672 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:41.881811 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:41.881718 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:39:43.881702039 +0000 UTC m=+36.540248564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:41.982068 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:41.982033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:41.982257 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:41.982186 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:41.982257 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:41.982255 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:39:43.98223625 +0000 UTC m=+36.640782795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:39:43.897574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:43.897270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:43.898051 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:43.897427 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:43.898051 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:43.897629 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:43.898051 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:43.897703 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:39:47.89768223 +0000 UTC m=+40.556228769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:43.997961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:43.997922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:43.998130 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:43.998110 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:43.998199 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:43.998187 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:39:47.998170367 +0000 UTC m=+40.656716890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:39:46.208203 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:46.208164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqn4n" event={"ID":"88ece72f-fa62-4e0c-af9f-314535fed31c","Type":"ContainerStarted","Data":"14d8ce4f529bb094aefeb60b0dd841b7a8081a49802dc50aa09a891938f4b0ad"} Sep 19 01:39:46.210900 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:46.210874 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="fcfe6fde68bd2ab7ccea75838c59ccc7b3416d5f58cbb2ccfd1137dbb7a5097b" exitCode=0 Sep 19 01:39:46.211007 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:46.210933 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"fcfe6fde68bd2ab7ccea75838c59ccc7b3416d5f58cbb2ccfd1137dbb7a5097b"} Sep 19 01:39:46.224999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:46.224961 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bqn4n" podStartSLOduration=1.8114468339999998 podStartE2EDuration="6.224947356s" totalImagesPullingTime="4.413500522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:46.22479789 +0000 UTC m=+38.883344435" watchObservedRunningTime="2026-09-19 01:39:46.224947356 +0000 UTC m=+38.883493879" Sep 19 01:39:47.216037 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:47.216006 2568 generic.go:356] "Generic (PLEG): container finished" podID="c74e56a7-e39e-4231-86c2-995ad1999453" containerID="d4794aea7867466ceaf483d0b3eaf0a65e74acd1e8d07c850f79e9b0d1c40cce" exitCode=0 Sep 19 01:39:47.216487 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:47.216071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerDied","Data":"d4794aea7867466ceaf483d0b3eaf0a65e74acd1e8d07c850f79e9b0d1c40cce"} Sep 19 01:39:47.925595 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:47.925554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:47.925781 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:47.925726 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:47.925781 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:47.925759 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:47.925864 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:47.925814 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:39:55.925798323 +0000 UTC m=+48.584344846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:48.026853 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:48.026819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:48.027017 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:48.026942 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:48.027017 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:48.026990 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:39:56.02697767 +0000 UTC m=+48.685524194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:39:48.223163 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:48.223078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" event={"ID":"c74e56a7-e39e-4231-86c2-995ad1999453","Type":"ContainerStarted","Data":"2f775f3d293af7bae65c07532fc7abc78a4e6d5b85122104c2c13bbd0afda3cb"} Sep 19 01:39:48.244341 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:48.244207 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tkcjl" podStartSLOduration=4.115882198 podStartE2EDuration="40.244187801s" totalImagesPullingTime="36.128305603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-19 01:39:48.24363958 +0000 UTC m=+40.902186126" watchObservedRunningTime="2026-09-19 01:39:48.244187801 +0000 UTC m=+40.902734346" Sep 19 01:39:55.983284 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:55.983238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:39:55.983680 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:55.983363 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:39:55.983680 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:55.983375 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:39:55.983680 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:55.983424 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:40:11.983410982 +0000 UTC m=+64.641957505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:39:56.083726 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:39:56.083686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:39:56.083871 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:56.083855 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:56.083928 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:39:56.083917 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:12.083899946 +0000 UTC m=+64.742446481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:40:06.591411 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:06.591379 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvxxl" Sep 19 01:40:12.008860 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.008816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:40:12.009289 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.008976 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:12.009289 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.008995 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-587ff867d4-krdvn: secret "image-registry-tls" not found Sep 19 01:40:12.009289 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.009052 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls podName:1c082193-0138-4893-9500-4615c4dd560a nodeName:}" failed. No retries permitted until 2026-09-19 01:40:44.00903549 +0000 UTC m=+96.667582018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls") pod "image-registry-587ff867d4-krdvn" (UID: "1c082193-0138-4893-9500-4615c4dd560a") : secret "image-registry-tls" not found Sep 19 01:40:12.109844 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.109809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:12.109981 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.109962 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:12.110038 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.110028 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls podName:3d5ae99a-4069-43d9-94fe-9cc85200ee3b nodeName:}" failed. No retries permitted until 2026-09-19 01:40:44.110010776 +0000 UTC m=+96.768557311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls") pod "dns-default-rsdtw" (UID: "3d5ae99a-4069-43d9-94fe-9cc85200ee3b") : secret "dns-default-metrics-tls" not found Sep 19 01:40:12.612756 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.612713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:40:12.612940 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.612792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:40:12.614966 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.614942 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:40:12.615033 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.614985 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:40:12.623884 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.623868 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 19 01:40:12.623929 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:12.623920 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs podName:63da4117-a15e-487a-83d7-d93420580186 nodeName:}" failed. No retries permitted until 2026-09-19 01:41:16.623906549 +0000 UTC m=+129.282453072 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs") pod "network-metrics-daemon-8tb72" (UID: "63da4117-a15e-487a-83d7-d93420580186") : secret "metrics-daemon-secret" not found Sep 19 01:40:12.626765 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.626730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8754f9ed-a37f-47ae-8fee-3b4724488700-original-pull-secret\") pod \"global-pull-secret-syncer-9pvs7\" (UID: \"8754f9ed-a37f-47ae-8fee-3b4724488700\") " pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:40:12.714057 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.714018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:40:12.716433 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.716413 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 01:40:12.728112 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.728083 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 01:40:12.738301 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.738279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnc4h\" (UniqueName: \"kubernetes.io/projected/cd0e3804-6ba9-4cc0-98b4-a64237b341b0-kube-api-access-xnc4h\") pod \"network-check-target-vz7wf\" (UID: \"cd0e3804-6ba9-4cc0-98b4-a64237b341b0\") " pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:40:12.781948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.781915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9pvs7" Sep 19 01:40:12.790701 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.790676 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:40:12.799573 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:12.799552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:40:13.054936 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:13.054897 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9pvs7"] Sep 19 01:40:13.059580 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:13.059552 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8754f9ed_a37f_47ae_8fee_3b4724488700.slice/crio-5008385f0761e44df58c622064e7e07b6a78b64d5912916895cbcd2262f14263 WatchSource:0}: Error finding container 5008385f0761e44df58c622064e7e07b6a78b64d5912916895cbcd2262f14263: Status 404 returned error can't find the container with id 5008385f0761e44df58c622064e7e07b6a78b64d5912916895cbcd2262f14263 Sep 19 01:40:13.074898 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:13.074866 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vz7wf"] Sep 19 01:40:13.078700 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:13.078672 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0e3804_6ba9_4cc0_98b4_a64237b341b0.slice/crio-67aa8f67b716bdc6798a3067c183a60d050b77f10ee7b675c1bb3acc6bb3333d WatchSource:0}: Error finding container 67aa8f67b716bdc6798a3067c183a60d050b77f10ee7b675c1bb3acc6bb3333d: Status 404 returned error can't find the container with id 67aa8f67b716bdc6798a3067c183a60d050b77f10ee7b675c1bb3acc6bb3333d Sep 19 01:40:13.278083 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:13.278042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vz7wf" event={"ID":"cd0e3804-6ba9-4cc0-98b4-a64237b341b0","Type":"ContainerStarted","Data":"67aa8f67b716bdc6798a3067c183a60d050b77f10ee7b675c1bb3acc6bb3333d"} Sep 19 01:40:13.279168 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:13.279144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9pvs7" event={"ID":"8754f9ed-a37f-47ae-8fee-3b4724488700","Type":"ContainerStarted","Data":"5008385f0761e44df58c622064e7e07b6a78b64d5912916895cbcd2262f14263"} Sep 19 01:40:15.503869 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.503835 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr"] Sep 19 01:40:15.509568 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.509533 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.512588 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.512563 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 19 01:40:15.513381 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.513352 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.513505 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.513361 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.513774 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.513738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rclch\"" Sep 19 01:40:15.521190 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.521171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr"] Sep 19 01:40:15.536640 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.536610 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbxd\" (UniqueName: \"kubernetes.io/projected/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-kube-api-access-mjbxd\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.536821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.536655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.604556 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.604520 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-8p9m8"] Sep 19 01:40:15.607826 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.607798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.610382 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.610349 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 19 01:40:15.610515 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.610447 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.610576 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.610539 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qhsdb\"" Sep 19 01:40:15.610645 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.610552 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.611864 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.610917 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 19 01:40:15.617887 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.617676 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 19 01:40:15.625607 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.625589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-8p9m8"] Sep 19 01:40:15.637853 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.637822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-tmp\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.637977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.637870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.637977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.637940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbxd\" (UniqueName: \"kubernetes.io/projected/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-kube-api-access-mjbxd\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.637977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.637968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.638142 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.637992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.638142 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.638020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rglrd\" (UniqueName: \"kubernetes.io/projected/a5eb925e-f985-46e6-9d54-c26fa265e35c-kube-api-access-rglrd\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.638250 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.638164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-snapshots\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.638250 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.638207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eb925e-f985-46e6-9d54-c26fa265e35c-serving-cert\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.638250 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:15.638163 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 19 01:40:15.638391 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:15.638311 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls podName:cf7435b1-b52f-4b20-bbcf-bb873e2814f7 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.138287381 +0000 UTC m=+68.796833908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-q9dcr" (UID: "cf7435b1-b52f-4b20-bbcf-bb873e2814f7") : secret "samples-operator-tls" not found Sep 19 01:40:15.659895 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.659838 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbxd\" (UniqueName: \"kubernetes.io/projected/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-kube-api-access-mjbxd\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:15.739002 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.738963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-tmp\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739188 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739188 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739099 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739188 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rglrd\" (UniqueName: \"kubernetes.io/projected/a5eb925e-f985-46e6-9d54-c26fa265e35c-kube-api-access-rglrd\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739188 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-snapshots\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739392 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739210 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eb925e-f985-46e6-9d54-c26fa265e35c-serving-cert\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.739601 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.739578 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-tmp\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.740230 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.740191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.740335 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.740234 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a5eb925e-f985-46e6-9d54-c26fa265e35c-snapshots\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.740454 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.740398 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5eb925e-f985-46e6-9d54-c26fa265e35c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.742358 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.742335 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5eb925e-f985-46e6-9d54-c26fa265e35c-serving-cert\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.749642 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.749613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rglrd\" (UniqueName: \"kubernetes.io/projected/a5eb925e-f985-46e6-9d54-c26fa265e35c-kube-api-access-rglrd\") pod \"insights-operator-6f9c644dd9-8p9m8\" (UID: \"a5eb925e-f985-46e6-9d54-c26fa265e35c\") " pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:15.920345 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:15.920294 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" Sep 19 01:40:16.142625 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:16.142565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:16.142832 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:16.142686 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 19 01:40:16.142832 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:16.142822 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls podName:cf7435b1-b52f-4b20-bbcf-bb873e2814f7 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.142799624 +0000 UTC m=+69.801346161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-q9dcr" (UID: "cf7435b1-b52f-4b20-bbcf-bb873e2814f7") : secret "samples-operator-tls" not found Sep 19 01:40:16.557407 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:16.557318 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-8p9m8"] Sep 19 01:40:17.150538 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:17.150500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:17.150736 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:17.150673 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 19 01:40:17.150809 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:17.150758 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls podName:cf7435b1-b52f-4b20-bbcf-bb873e2814f7 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.150730022 +0000 UTC m=+71.809276545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-q9dcr" (UID: "cf7435b1-b52f-4b20-bbcf-bb873e2814f7") : secret "samples-operator-tls" not found Sep 19 01:40:17.726419 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:17.726383 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eb925e_f985_46e6_9d54_c26fa265e35c.slice/crio-2287bada9b77d53a476f671ad1609f6af99a725f124c4953b7f51049cb0c83a4 WatchSource:0}: Error finding container 2287bada9b77d53a476f671ad1609f6af99a725f124c4953b7f51049cb0c83a4: Status 404 returned error can't find the container with id 2287bada9b77d53a476f671ad1609f6af99a725f124c4953b7f51049cb0c83a4 Sep 19 01:40:18.293609 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.293570 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9pvs7" event={"ID":"8754f9ed-a37f-47ae-8fee-3b4724488700","Type":"ContainerStarted","Data":"8cdd5f368e90d128cb5347457785b51bd5cce38bc882f6d9b1f9b9bb520a4e6d"} Sep 19 01:40:18.294846 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.294815 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" event={"ID":"a5eb925e-f985-46e6-9d54-c26fa265e35c","Type":"ContainerStarted","Data":"2287bada9b77d53a476f671ad1609f6af99a725f124c4953b7f51049cb0c83a4"} Sep 19 01:40:18.296139 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.296121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vz7wf" event={"ID":"cd0e3804-6ba9-4cc0-98b4-a64237b341b0","Type":"ContainerStarted","Data":"be595a6c10c763b9f2b6e6a7cacc3e29bc046356ca6e82678f95ec15d21e12e1"} Sep 19 01:40:18.296248 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.296237 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:40:18.308964 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.308922 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9pvs7" podStartSLOduration=65.590874995 podStartE2EDuration="1m10.308910614s" totalImagesPullingTime="4.718035619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:18.308612578 +0000 UTC m=+70.967159123" watchObservedRunningTime="2026-09-19 01:40:18.308910614 +0000 UTC m=+70.967457156" Sep 19 01:40:18.322589 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:18.322543 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vz7wf" podStartSLOduration=67.056437307 podStartE2EDuration="1m10.322531254s" totalImagesPullingTime="3.266093947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:18.322112911 +0000 UTC m=+70.980659456" watchObservedRunningTime="2026-09-19 01:40:18.322531254 +0000 UTC m=+70.981077799" Sep 19 01:40:19.165831 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:19.165787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:19.166220 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:19.165959 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 19 01:40:19.166220 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:19.166038 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls podName:cf7435b1-b52f-4b20-bbcf-bb873e2814f7 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.166019962 +0000 UTC m=+75.824566488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-q9dcr" (UID: "cf7435b1-b52f-4b20-bbcf-bb873e2814f7") : secret "samples-operator-tls" not found Sep 19 01:40:20.302406 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.302368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" event={"ID":"a5eb925e-f985-46e6-9d54-c26fa265e35c","Type":"ContainerStarted","Data":"19885dc3e5f4d0beee519da90903c8b98e85beb6ec43be2a819ec7ca74efa956"} Sep 19 01:40:20.320253 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.320203 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" podStartSLOduration=2.94887233 podStartE2EDuration="5.320187108s" totalImagesPullingTime="2.371314778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:20.318903635 +0000 UTC m=+72.977450182" watchObservedRunningTime="2026-09-19 01:40:20.320187108 +0000 UTC m=+72.978733653" Sep 19 01:40:20.929807 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.929773 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdbl"] Sep 19 01:40:20.933285 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.933248 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:20.936045 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.936021 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 01:40:20.936151 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.936023 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 01:40:20.936151 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.936032 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg5n6\"" Sep 19 01:40:20.945413 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.945393 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdbl"] Sep 19 01:40:20.980405 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.980380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx4db\" (UniqueName: \"kubernetes.io/projected/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-api-access-sx4db\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:20.980548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.980427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-data-volume\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:20.980548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.980445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:20.980639 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.980560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-crio-socket\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:20.980639 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:20.980588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081607 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081552 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-crio-socket\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081607 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081607 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx4db\" (UniqueName: \"kubernetes.io/projected/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-api-access-sx4db\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-data-volume\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.081705 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-crio-socket\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.081723 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.081772 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.081820 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.581798703 +0000 UTC m=+74.240345240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.081935 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.081839 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.581829937 +0000 UTC m=+74.240376469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : configmap "kube-rbac-proxy" not found Sep 19 01:40:21.082160 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.082037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-data-volume\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.093776 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.093735 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx4db\" (UniqueName: \"kubernetes.io/projected/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-api-access-sx4db\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.587010 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.586967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.587461 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:21.587054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:21.587461 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.587115 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.587461 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.587144 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.587461 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.587200 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.587176657 +0000 UTC m=+75.245723194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : configmap "kube-rbac-proxy" not found Sep 19 01:40:21.587461 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:21.587221 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.587211171 +0000 UTC m=+75.245757696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.595849 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:22.595809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:22.596329 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:22.595891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:22.596329 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:22.595962 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:22.596329 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:22.595981 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.596329 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:22.596033 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.596020001 +0000 UTC m=+77.254566524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.596329 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:22.596047 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.596040912 +0000 UTC m=+77.254587434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : configmap "kube-rbac-proxy" not found Sep 19 01:40:23.202299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:23.202262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:23.202473 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:23.202412 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 19 01:40:23.202515 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:23.202474 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls podName:cf7435b1-b52f-4b20-bbcf-bb873e2814f7 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.20245833 +0000 UTC m=+83.861004852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-q9dcr" (UID: "cf7435b1-b52f-4b20-bbcf-bb873e2814f7") : secret "samples-operator-tls" not found Sep 19 01:40:23.904305 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:23.904275 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbb2w_ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f/dns-node-resolver/0.log" Sep 19 01:40:24.504466 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:24.504434 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6stw_68129407-7656-423e-8380-71c6ba7d6484/node-ca/0.log" Sep 19 01:40:24.612304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:24.612275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:24.612447 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:24.612328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:24.612447 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:24.612401 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:24.612447 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:24.612420 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:24.612540 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:24.612462 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.612445465 +0000 UTC m=+81.270991990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : configmap "kube-rbac-proxy" not found Sep 19 01:40:24.612540 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:24.612475 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.612469489 +0000 UTC m=+81.271016012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:25.302218 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:25.302189 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqn4n_88ece72f-fa62-4e0c-af9f-314535fed31c/serve-healthcheck-canary/0.log" Sep 19 01:40:28.643922 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:28.643879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:28.644383 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:28.644018 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:28.644383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:28.644069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:28.644383 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:28.644090 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.64406883 +0000 UTC m=+89.302615357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : configmap "kube-rbac-proxy" not found Sep 19 01:40:28.644383 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:28.644158 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:28.644383 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:28.644207 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.644196264 +0000 UTC m=+89.302742787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:31.265961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:31.265813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:31.268233 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:31.268212 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf7435b1-b52f-4b20-bbcf-bb873e2814f7-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-q9dcr\" (UID: \"cf7435b1-b52f-4b20-bbcf-bb873e2814f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:31.421477 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:31.421443 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" Sep 19 01:40:31.690841 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:31.690807 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr"] Sep 19 01:40:32.330996 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:32.330954 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" event={"ID":"cf7435b1-b52f-4b20-bbcf-bb873e2814f7","Type":"ContainerStarted","Data":"dcfff1c4e054ee4cc15f9f581e0bb3bae27f61ed4ee743671c909eb79ebf15bf"} Sep 19 01:40:34.338965 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:34.338922 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" event={"ID":"cf7435b1-b52f-4b20-bbcf-bb873e2814f7","Type":"ContainerStarted","Data":"5f741c91069aa14040024f1f521eec65e6dcb579b319785d097c8dab7dff83ee"} Sep 19 01:40:34.339407 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:34.338988 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" event={"ID":"cf7435b1-b52f-4b20-bbcf-bb873e2814f7","Type":"ContainerStarted","Data":"f73d014afb5d81d37f12a1d6f90f752517726ee752dbdfb7dd35b626e5de285f"} Sep 19 01:40:34.357246 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:34.357191 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-q9dcr" podStartSLOduration=17.209047693 podStartE2EDuration="19.357174451s" totalImagesPullingTime="2.148126758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:34.355666618 +0000 UTC m=+87.014213164" watchObservedRunningTime="2026-09-19 01:40:34.357174451 +0000 UTC m=+87.015721042" Sep 19 01:40:36.711162 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:36.711117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:36.711580 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:36.711179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:36.711580 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:36.711275 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.711580 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:40:36.711344 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls podName:66d8c6ae-3f2c-46f4-b077-8f37a851ee26 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:52.711327775 +0000 UTC m=+105.369874298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdbl" (UID: "66d8c6ae-3f2c-46f4-b077-8f37a851ee26") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.711712 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:36.711614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:44.071033 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.070986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:40:44.073367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.073342 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"image-registry-587ff867d4-krdvn\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:40:44.138509 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.138476 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49x4x\"" Sep 19 01:40:44.146520 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.146498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:40:44.171890 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.171865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:44.173987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.173960 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5ae99a-4069-43d9-94fe-9cc85200ee3b-metrics-tls\") pod \"dns-default-rsdtw\" (UID: \"3d5ae99a-4069-43d9-94fe-9cc85200ee3b\") " pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:44.420066 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.420032 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:40:44.423582 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:44.423553 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c082193_0138_4893_9500_4615c4dd560a.slice/crio-40c36084484a331fbded1853bd024bf3673339eefc0586700cbf0003f2442c9d WatchSource:0}: Error finding container 40c36084484a331fbded1853bd024bf3673339eefc0586700cbf0003f2442c9d: Status 404 returned error can't find the container with id 40c36084484a331fbded1853bd024bf3673339eefc0586700cbf0003f2442c9d Sep 19 01:40:44.447913 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.447888 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:40:44.455480 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.455452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:44.726620 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:44.726553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rsdtw"] Sep 19 01:40:44.730839 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:44.730807 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ae99a_4069_43d9_94fe_9cc85200ee3b.slice/crio-c2a6bde2f735c909f15240d3cac73493d2d1cb6bddbd7c42dccefb9ec490d1ae WatchSource:0}: Error finding container c2a6bde2f735c909f15240d3cac73493d2d1cb6bddbd7c42dccefb9ec490d1ae: Status 404 returned error can't find the container with id c2a6bde2f735c909f15240d3cac73493d2d1cb6bddbd7c42dccefb9ec490d1ae Sep 19 01:40:45.371982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:45.371947 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rsdtw" event={"ID":"3d5ae99a-4069-43d9-94fe-9cc85200ee3b","Type":"ContainerStarted","Data":"c2a6bde2f735c909f15240d3cac73493d2d1cb6bddbd7c42dccefb9ec490d1ae"} Sep 19 01:40:45.373441 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:45.373419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" event={"ID":"1c082193-0138-4893-9500-4615c4dd560a","Type":"ContainerStarted","Data":"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21"} Sep 19 01:40:45.373548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:45.373460 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" event={"ID":"1c082193-0138-4893-9500-4615c4dd560a","Type":"ContainerStarted","Data":"40c36084484a331fbded1853bd024bf3673339eefc0586700cbf0003f2442c9d"} Sep 19 01:40:45.373596 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:45.373548 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:40:45.397853 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:45.397808 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" podStartSLOduration=97.39779306 podStartE2EDuration="1m37.39779306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:45.396741421 +0000 UTC m=+98.055287966" watchObservedRunningTime="2026-09-19 01:40:45.39779306 +0000 UTC m=+98.056339606" Sep 19 01:40:47.381590 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:47.381546 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rsdtw" event={"ID":"3d5ae99a-4069-43d9-94fe-9cc85200ee3b","Type":"ContainerStarted","Data":"e2f9c04e7288a2c20a05e727c3883ee6cfa631eb85d44f4c2b256f999b859440"} Sep 19 01:40:47.381992 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:47.381613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rsdtw" event={"ID":"3d5ae99a-4069-43d9-94fe-9cc85200ee3b","Type":"ContainerStarted","Data":"21532b6db36035b70708db4a737abf8b7c0473eb3f6ecfc72862e2afc08175f7"} Sep 19 01:40:47.381992 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:47.381699 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:47.403067 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:47.403015 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rsdtw" podStartSLOduration=65.702282002 podStartE2EDuration="1m7.40299891s" totalImagesPullingTime="1.700716908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:47.402211325 +0000 UTC m=+100.060757870" watchObservedRunningTime="2026-09-19 01:40:47.40299891 +0000 UTC m=+100.061545457" Sep 19 01:40:49.301762 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:49.301716 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vz7wf" Sep 19 01:40:51.240926 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.240893 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz"] Sep 19 01:40:51.263028 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.262995 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.266507 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.266472 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 19 01:40:51.266636 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.266480 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 19 01:40:51.266831 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.266481 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 19 01:40:51.270579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.267453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 19 01:40:51.270579 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.269763 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz"] Sep 19 01:40:51.292506 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.292476 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg"] Sep 19 01:40:51.312690 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.312665 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.315892 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.315872 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 19 01:40:51.316480 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.316457 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 19 01:40:51.316563 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.316542 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 19 01:40:51.316651 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.316633 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 19 01:40:51.331720 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.331692 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg"] Sep 19 01:40:51.425796 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68c5c69-3825-4cc7-988d-b82eb812e014-tmp\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.425796 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e68c5c69-3825-4cc7-988d-b82eb812e014-klusterlet-config\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnls\" (UniqueName: \"kubernetes.io/projected/0b3ac5e0-da02-4143-a500-b536576f840f-kube-api-access-mrnls\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.425995 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.425991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c44j\" (UniqueName: \"kubernetes.io/projected/e68c5c69-3825-4cc7-988d-b82eb812e014-kube-api-access-6c44j\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.426180 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.426019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3ac5e0-da02-4143-a500-b536576f840f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.526984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3ac5e0-da02-4143-a500-b536576f840f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68c5c69-3825-4cc7-988d-b82eb812e014-tmp\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.527060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527062 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e68c5c69-3825-4cc7-988d-b82eb812e014-klusterlet-config\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.527304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527225 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnls\" (UniqueName: \"kubernetes.io/projected/0b3ac5e0-da02-4143-a500-b536576f840f-kube-api-access-mrnls\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.527485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c44j\" (UniqueName: \"kubernetes.io/projected/e68c5c69-3825-4cc7-988d-b82eb812e014-kube-api-access-6c44j\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.527485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527427 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e68c5c69-3825-4cc7-988d-b82eb812e014-tmp\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.527973 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.527917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3ac5e0-da02-4143-a500-b536576f840f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.529837 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.529810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.529965 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.529920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.530031 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.530000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-ca\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.530073 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.530036 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ac5e0-da02-4143-a500-b536576f840f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.530107 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.530089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e68c5c69-3825-4cc7-988d-b82eb812e014-klusterlet-config\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.541851 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.541830 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c44j\" (UniqueName: \"kubernetes.io/projected/e68c5c69-3825-4cc7-988d-b82eb812e014-kube-api-access-6c44j\") pod \"klusterlet-addon-workmgr-bbfcbf4bf-hhbhz\" (UID: \"e68c5c69-3825-4cc7-988d-b82eb812e014\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.541949 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.541925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnls\" (UniqueName: \"kubernetes.io/projected/0b3ac5e0-da02-4143-a500-b536576f840f-kube-api-access-mrnls\") pod \"cluster-proxy-proxy-agent-64dc69f786-67fvg\" (UID: \"0b3ac5e0-da02-4143-a500-b536576f840f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.577946 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.577922 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:51.641682 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.641612 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" Sep 19 01:40:51.847642 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.847570 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz"] Sep 19 01:40:51.850672 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:51.850639 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68c5c69_3825_4cc7_988d_b82eb812e014.slice/crio-0b50870e5ef806136d20671cef6bca14ba458793c00510770a02737772aef720 WatchSource:0}: Error finding container 0b50870e5ef806136d20671cef6bca14ba458793c00510770a02737772aef720: Status 404 returned error can't find the container with id 0b50870e5ef806136d20671cef6bca14ba458793c00510770a02737772aef720 Sep 19 01:40:51.919155 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:51.919118 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg"] Sep 19 01:40:51.922683 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:40:51.922657 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b3ac5e0_da02_4143_a500_b536576f840f.slice/crio-a9d31a1eb62392ec01836348e59ecfcab2d6f2c0e871818ce1058a980068fe2b WatchSource:0}: Error finding container a9d31a1eb62392ec01836348e59ecfcab2d6f2c0e871818ce1058a980068fe2b: Status 404 returned error can't find the container with id a9d31a1eb62392ec01836348e59ecfcab2d6f2c0e871818ce1058a980068fe2b Sep 19 01:40:52.397309 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:52.397270 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" event={"ID":"0b3ac5e0-da02-4143-a500-b536576f840f","Type":"ContainerStarted","Data":"a9d31a1eb62392ec01836348e59ecfcab2d6f2c0e871818ce1058a980068fe2b"} Sep 19 01:40:52.398470 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:52.398451 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" event={"ID":"e68c5c69-3825-4cc7-988d-b82eb812e014","Type":"ContainerStarted","Data":"0b50870e5ef806136d20671cef6bca14ba458793c00510770a02737772aef720"} Sep 19 01:40:52.738887 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:52.738858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:52.741090 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:52.741058 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d8c6ae-3f2c-46f4-b077-8f37a851ee26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdbl\" (UID: \"66d8c6ae-3f2c-46f4-b077-8f37a851ee26\") " pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:52.741856 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:52.741840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwdbl" Sep 19 01:40:53.019866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:53.019836 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdbl"] Sep 19 01:40:53.413921 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:53.413877 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdbl" event={"ID":"66d8c6ae-3f2c-46f4-b077-8f37a851ee26","Type":"ContainerStarted","Data":"f7b9a5930e4134618f8c214f0fa15f6d8b9dee148641577252a07202e8c15891"} Sep 19 01:40:53.414393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:53.413955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdbl" event={"ID":"66d8c6ae-3f2c-46f4-b077-8f37a851ee26","Type":"ContainerStarted","Data":"30601d71a12475eb8486d62b318e46fe5a66bad39b8e426c75874e378a4b5ce3"} Sep 19 01:40:57.386882 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:57.386851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rsdtw" Sep 19 01:40:58.437994 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.437955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" event={"ID":"0b3ac5e0-da02-4143-a500-b536576f840f","Type":"ContainerStarted","Data":"7f867732830f419f39eda6d371f255897c662bd22fcfb1ba7868ea7a0b7bd119"} Sep 19 01:40:58.438496 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.438007 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" event={"ID":"0b3ac5e0-da02-4143-a500-b536576f840f","Type":"ContainerStarted","Data":"5ca8c3c78cd6e1ce0b36cd5f68a064602468b03c2f7d29097759363e07b9785f"} Sep 19 01:40:58.438496 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.438027 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" event={"ID":"0b3ac5e0-da02-4143-a500-b536576f840f","Type":"ContainerStarted","Data":"302aca1011a679e4e5cae3259020ca379e6c860aaba181df3de2e269c221f57f"} Sep 19 01:40:58.439875 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.439845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" event={"ID":"e68c5c69-3825-4cc7-988d-b82eb812e014","Type":"ContainerStarted","Data":"299b10a896bc74527e5243b4673ecb50f70452b443f48aa801de5e284a94face"} Sep 19 01:40:58.440027 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.440008 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:58.442265 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.442244 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" Sep 19 01:40:58.442451 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.442414 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdbl" event={"ID":"66d8c6ae-3f2c-46f4-b077-8f37a851ee26","Type":"ContainerStarted","Data":"4d1fb2cffc10661a4cb8dabb8c1581b7fb4a04c6b97ff1ca7a25b0e341a89b9e"} Sep 19 01:40:58.457304 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.457237 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64dc69f786-67fvg" podStartSLOduration=1.565426552 podStartE2EDuration="7.457216862s" totalImagesPullingTime="5.89179031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:58.456503034 +0000 UTC m=+111.115049583" watchObservedRunningTime="2026-09-19 01:40:58.457216862 +0000 UTC m=+111.115763408" Sep 19 01:40:58.474148 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:58.474096 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bbfcbf4bf-hhbhz" podStartSLOduration=1.5135689700000001 podStartE2EDuration="7.474080329s" totalImagesPullingTime="5.960511359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:58.472726623 +0000 UTC m=+111.131273167" watchObservedRunningTime="2026-09-19 01:40:58.474080329 +0000 UTC m=+111.132626873" Sep 19 01:40:59.448236 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:59.448196 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdbl" event={"ID":"66d8c6ae-3f2c-46f4-b077-8f37a851ee26","Type":"ContainerStarted","Data":"1d65b96b8e63b9dff77c0340f1cff1f646388e9a28340678c76af10c1a30d55a"} Sep 19 01:40:59.467545 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:40:59.467494 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lwdbl" podStartSLOduration=33.608932569 podStartE2EDuration="39.467480231s" totalImagesPullingTime="5.858547662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:40:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:59.4669581 +0000 UTC m=+112.125504648" watchObservedRunningTime="2026-09-19 01:40:59.467480231 +0000 UTC m=+112.126026794" Sep 19 01:41:04.151473 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.151436 2568 patch_prober.go:28] interesting pod/image-registry-587ff867d4-krdvn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 19 01:41:04.151890 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.151492 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" podUID="1c082193-0138-4893-9500-4615c4dd560a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 01:41:04.754205 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.754172 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xxkjs"] Sep 19 01:41:04.757400 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.757379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.759694 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.759669 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sl9pg\"" Sep 19 01:41:04.760665 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.760644 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 01:41:04.761048 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.761034 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 01:41:04.761860 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.761842 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 01:41:04.762070 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.762054 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 01:41:04.762681 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.762648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 01:41:04.762681 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.762669 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 01:41:04.938055 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-wtmp\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938055 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938072 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-tls\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-metrics-client-ca\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-sys\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6pqs\" (UniqueName: \"kubernetes.io/projected/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-kube-api-access-l6pqs\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-textfile\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:04.938266 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:04.938227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-root\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039394 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-sys\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039394 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6pqs\" (UniqueName: \"kubernetes.io/projected/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-kube-api-access-l6pqs\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039405 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-sys\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-textfile\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039493 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-root\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-wtmp\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-tls\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-metrics-client-ca\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-root\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039714 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-wtmp\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.039943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.039810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-textfile\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.040270 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.040246 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-metrics-client-ca\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.040270 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.040267 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.041940 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.041922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-tls\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.042020 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.041948 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.050401 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.050374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6pqs\" (UniqueName: \"kubernetes.io/projected/1bb73331-1294-41c9-9f72-3b6f1b17d5c8-kube-api-access-l6pqs\") pod \"node-exporter-xxkjs\" (UID: \"1bb73331-1294-41c9-9f72-3b6f1b17d5c8\") " pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.066296 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.066256 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxkjs" Sep 19 01:41:05.078683 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:41:05.078659 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb73331_1294_41c9_9f72_3b6f1b17d5c8.slice/crio-a0642f67d0e0b515be3f51062ecb0bc2f6f5ae9643abd5b9b485e49e109a48bb WatchSource:0}: Error finding container a0642f67d0e0b515be3f51062ecb0bc2f6f5ae9643abd5b9b485e49e109a48bb: Status 404 returned error can't find the container with id a0642f67d0e0b515be3f51062ecb0bc2f6f5ae9643abd5b9b485e49e109a48bb Sep 19 01:41:05.467640 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:05.467608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxkjs" event={"ID":"1bb73331-1294-41c9-9f72-3b6f1b17d5c8","Type":"ContainerStarted","Data":"a0642f67d0e0b515be3f51062ecb0bc2f6f5ae9643abd5b9b485e49e109a48bb"} Sep 19 01:41:06.381567 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:06.381492 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:41:06.472361 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:06.472324 2568 generic.go:356] "Generic (PLEG): container finished" podID="1bb73331-1294-41c9-9f72-3b6f1b17d5c8" containerID="3ed32d3fb7674adaac43d4b81d58d63d1df22450d538ab85e2e53d96da80c978" exitCode=0 Sep 19 01:41:06.472836 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:06.472369 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxkjs" event={"ID":"1bb73331-1294-41c9-9f72-3b6f1b17d5c8","Type":"ContainerDied","Data":"3ed32d3fb7674adaac43d4b81d58d63d1df22450d538ab85e2e53d96da80c978"} Sep 19 01:41:07.477381 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:07.477333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxkjs" event={"ID":"1bb73331-1294-41c9-9f72-3b6f1b17d5c8","Type":"ContainerStarted","Data":"63cb29b632ae23cf43e6ccf2fc92607b24232664f52d9e36b8e359e4edd5e794"} Sep 19 01:41:07.477804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:07.477442 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxkjs" event={"ID":"1bb73331-1294-41c9-9f72-3b6f1b17d5c8","Type":"ContainerStarted","Data":"2c9f3fad4c42cbc8a6b3dc4027bc30737875c272b56d79f3954fcd675bdce74f"} Sep 19 01:41:07.499174 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:07.499126 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xxkjs" podStartSLOduration=2.4550031900000002 podStartE2EDuration="3.499113457s" totalImagesPullingTime="983.144925ms" totalInitContainerRuntime="60.965342ms" isStatefulPod=true podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:07.498026931 +0000 UTC m=+120.156573476" watchObservedRunningTime="2026-09-19 01:41:07.499113457 +0000 UTC m=+120.157660001" Sep 19 01:41:09.491719 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.491683 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q"] Sep 19 01:41:09.498956 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.498932 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.501013 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.500988 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 19 01:41:09.501152 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.501046 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rcl25\"" Sep 19 01:41:09.503347 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.503324 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q"] Sep 19 01:41:09.675795 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.675737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdp2j\" (UniqueName: \"kubernetes.io/projected/826f1b10-d8ff-454c-83b7-80f905128397-kube-api-access-xdp2j\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.675948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.675825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/826f1b10-d8ff-454c-83b7-80f905128397-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.776945 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.776856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdp2j\" (UniqueName: \"kubernetes.io/projected/826f1b10-d8ff-454c-83b7-80f905128397-kube-api-access-xdp2j\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.776945 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.776909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/826f1b10-d8ff-454c-83b7-80f905128397-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.779215 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.779187 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/826f1b10-d8ff-454c-83b7-80f905128397-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.784497 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.784472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdp2j\" (UniqueName: \"kubernetes.io/projected/826f1b10-d8ff-454c-83b7-80f905128397-kube-api-access-xdp2j\") pod \"monitoring-plugin-5984459ff8-fqp7q\" (UID: \"826f1b10-d8ff-454c-83b7-80f905128397\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:09.808416 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:09.808392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:10.080669 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:10.080597 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q"] Sep 19 01:41:10.083916 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:41:10.083891 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826f1b10_d8ff_454c_83b7_80f905128397.slice/crio-940586376ee61800dd393bffad8581da96233cd6aa94b081eed8b8d40857bcca WatchSource:0}: Error finding container 940586376ee61800dd393bffad8581da96233cd6aa94b081eed8b8d40857bcca: Status 404 returned error can't find the container with id 940586376ee61800dd393bffad8581da96233cd6aa94b081eed8b8d40857bcca Sep 19 01:41:10.488620 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:10.488584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" event={"ID":"826f1b10-d8ff-454c-83b7-80f905128397","Type":"ContainerStarted","Data":"940586376ee61800dd393bffad8581da96233cd6aa94b081eed8b8d40857bcca"} Sep 19 01:41:12.497874 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:12.497842 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" event={"ID":"826f1b10-d8ff-454c-83b7-80f905128397","Type":"ContainerStarted","Data":"c6f5c78b932284c2c48f12b747a8e3051e2b9dfc5feea5d702134e09a51dd09a"} Sep 19 01:41:12.498323 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:12.498044 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:12.502972 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:12.502948 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" Sep 19 01:41:12.513691 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:12.513625 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-fqp7q" podStartSLOduration=2.101414067 podStartE2EDuration="3.513609015s" totalImagesPullingTime="1.412194948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:12.513374511 +0000 UTC m=+125.171921048" watchObservedRunningTime="2026-09-19 01:41:12.513609015 +0000 UTC m=+125.172155561" Sep 19 01:41:13.953468 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:13.953431 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:41:16.723766 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:16.723686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:41:16.726044 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:16.726011 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63da4117-a15e-487a-83d7-d93420580186-metrics-certs\") pod \"network-metrics-daemon-8tb72\" (UID: \"63da4117-a15e-487a-83d7-d93420580186\") " pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:41:16.996527 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:16.996445 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:41:17.005364 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:17.005334 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tb72" Sep 19 01:41:17.299779 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:17.299679 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tb72"] Sep 19 01:41:17.302688 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:41:17.302655 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63da4117_a15e_487a_83d7_d93420580186.slice/crio-76358a81779aaf2383b3a90d6628a339194bb67f0a14f8260f1a7f0ef3bba445 WatchSource:0}: Error finding container 76358a81779aaf2383b3a90d6628a339194bb67f0a14f8260f1a7f0ef3bba445: Status 404 returned error can't find the container with id 76358a81779aaf2383b3a90d6628a339194bb67f0a14f8260f1a7f0ef3bba445 Sep 19 01:41:17.516033 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:17.515998 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tb72" event={"ID":"63da4117-a15e-487a-83d7-d93420580186","Type":"ContainerStarted","Data":"76358a81779aaf2383b3a90d6628a339194bb67f0a14f8260f1a7f0ef3bba445"} Sep 19 01:41:18.520417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:18.520389 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tb72" event={"ID":"63da4117-a15e-487a-83d7-d93420580186","Type":"ContainerStarted","Data":"d4acd1e69250419d9a97e8bdaa50c712aa66b869bf761eaa9bd52b4a934ce638"} Sep 19 01:41:19.525053 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:19.525020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tb72" event={"ID":"63da4117-a15e-487a-83d7-d93420580186","Type":"ContainerStarted","Data":"7d93e67a4054921929b1be816cb9dd3510ae5ca0c38b4dc747c29c0ff0834dbd"} Sep 19 01:41:19.544319 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:19.544270 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8tb72" podStartSLOduration=130.489842135 podStartE2EDuration="2m11.544251902s" totalImagesPullingTime="1.054409767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:19.543225239 +0000 UTC m=+132.201771785" watchObservedRunningTime="2026-09-19 01:41:19.544251902 +0000 UTC m=+132.202798447" Sep 19 01:41:38.973819 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:38.973771 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" podUID="1c082193-0138-4893-9500-4615c4dd560a" containerName="registry" containerID="cri-o://c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21" gracePeriod=30 Sep 19 01:41:39.215258 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.215234 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:41:39.289638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289541 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s898p\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289585 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289611 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289653 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289684 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289712 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289737 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.289948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.289802 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca\") pod \"1c082193-0138-4893-9500-4615c4dd560a\" (UID: \"1c082193-0138-4893-9500-4615c4dd560a\") " Sep 19 01:41:39.290208 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.290178 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:39.290361 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.290340 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:39.292287 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.292249 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:39.292440 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.292417 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p" (OuterVolumeSpecName: "kube-api-access-s898p") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "kube-api-access-s898p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:39.292440 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.292422 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:39.292534 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.292515 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:39.292595 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.292575 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:39.306870 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.306834 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1c082193-0138-4893-9500-4615c4dd560a" (UID: "1c082193-0138-4893-9500-4615c4dd560a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:41:39.391052 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391018 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-trusted-ca\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391052 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391043 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s898p\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-kube-api-access-s898p\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391052 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391057 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-bound-sa-token\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391069 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-installation-pull-secrets\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391078 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c082193-0138-4893-9500-4615c4dd560a-ca-trust-extracted\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391086 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c082193-0138-4893-9500-4615c4dd560a-registry-certificates\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391094 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c082193-0138-4893-9500-4615c4dd560a-registry-tls\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.391269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.391105 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c082193-0138-4893-9500-4615c4dd560a-image-registry-private-configuration\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:41:39.597804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.597697 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c082193-0138-4893-9500-4615c4dd560a" containerID="c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21" exitCode=0 Sep 19 01:41:39.597804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.597775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" event={"ID":"1c082193-0138-4893-9500-4615c4dd560a","Type":"ContainerDied","Data":"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21"} Sep 19 01:41:39.597987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.597842 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" event={"ID":"1c082193-0138-4893-9500-4615c4dd560a","Type":"ContainerDied","Data":"40c36084484a331fbded1853bd024bf3673339eefc0586700cbf0003f2442c9d"} Sep 19 01:41:39.597987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.597778 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587ff867d4-krdvn" Sep 19 01:41:39.597987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.597862 2568 scope.go:117] "RemoveContainer" containerID="c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21" Sep 19 01:41:39.606050 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.606032 2568 scope.go:117] "RemoveContainer" containerID="c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21" Sep 19 01:41:39.606330 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:41:39.606311 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21\": container with ID starting with c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21 not found: ID does not exist" containerID="c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21" Sep 19 01:41:39.606380 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.606339 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21"} err="failed to get container status \"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21\": rpc error: code = NotFound desc = could not find container \"c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21\": container with ID starting with c09b68e4bfe2cfae6dbe9839ee0af1202e6515f3357ede37edb15a84c2866e21 not found: ID does not exist" Sep 19 01:41:39.618163 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.618135 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:41:39.622715 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.622696 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-587ff867d4-krdvn"] Sep 19 01:41:39.872934 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:39.872847 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c082193-0138-4893-9500-4615c4dd560a" path="/var/lib/kubelet/pods/1c082193-0138-4893-9500-4615c4dd560a/volumes" Sep 19 01:41:40.603101 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:40.603068 2568 generic.go:356] "Generic (PLEG): container finished" podID="a5eb925e-f985-46e6-9d54-c26fa265e35c" containerID="19885dc3e5f4d0beee519da90903c8b98e85beb6ec43be2a819ec7ca74efa956" exitCode=0 Sep 19 01:41:40.603571 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:40.603147 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" event={"ID":"a5eb925e-f985-46e6-9d54-c26fa265e35c","Type":"ContainerDied","Data":"19885dc3e5f4d0beee519da90903c8b98e85beb6ec43be2a819ec7ca74efa956"} Sep 19 01:41:40.603645 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:40.603567 2568 scope.go:117] "RemoveContainer" containerID="19885dc3e5f4d0beee519da90903c8b98e85beb6ec43be2a819ec7ca74efa956" Sep 19 01:41:41.354314 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:41.354287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqn4n_88ece72f-fa62-4e0c-af9f-314535fed31c/serve-healthcheck-canary/0.log" Sep 19 01:41:41.609540 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:41:41.609457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-8p9m8" event={"ID":"a5eb925e-f985-46e6-9d54-c26fa265e35c","Type":"ContainerStarted","Data":"1d0345a93d2d755f63c71357902c71331e3c38454025f22cd348c7bab275f012"} Sep 19 01:44:07.739886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:07.739855 2568 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 01:44:39.639174 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.639131 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574"] Sep 19 01:44:39.641587 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.639488 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c082193-0138-4893-9500-4615c4dd560a" containerName="registry" Sep 19 01:44:39.641587 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.639509 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c082193-0138-4893-9500-4615c4dd560a" containerName="registry" Sep 19 01:44:39.641587 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.639577 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c082193-0138-4893-9500-4615c4dd560a" containerName="registry" Sep 19 01:44:39.642453 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.642433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.645331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.645311 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 01:44:39.645603 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.645585 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 01:44:39.645884 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.645871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lmrcz\"" Sep 19 01:44:39.653161 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.653138 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574"] Sep 19 01:44:39.730499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.730448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.730676 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.730542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k297w\" (UniqueName: \"kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.730676 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.730608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.831782 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.831716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.831961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.831824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k297w\" (UniqueName: \"kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.831961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.831867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.832198 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.832176 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.832239 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.832189 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.840738 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.840705 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k297w\" (UniqueName: \"kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:39.951495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:39.951462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:40.222535 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:40.222452 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574"] Sep 19 01:44:40.226873 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:44:40.226843 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfa338d_7bbf_4525_b393_260e430b6fbe.slice/crio-8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6 WatchSource:0}: Error finding container 8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6: Status 404 returned error can't find the container with id 8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6 Sep 19 01:44:40.228756 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:40.228725 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:44:41.207544 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:41.207499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" event={"ID":"2bfa338d-7bbf-4525-b393-260e430b6fbe","Type":"ContainerStarted","Data":"8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6"} Sep 19 01:44:47.231882 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:47.231845 2568 generic.go:356] "Generic (PLEG): container finished" podID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerID="9c2f1b7ab39f8d30587d5078c561dd392ecf945426ed25cd5276d33b8778cecc" exitCode=0 Sep 19 01:44:47.232283 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:47.231936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" event={"ID":"2bfa338d-7bbf-4525-b393-260e430b6fbe","Type":"ContainerDied","Data":"9c2f1b7ab39f8d30587d5078c561dd392ecf945426ed25cd5276d33b8778cecc"} Sep 19 01:44:50.245116 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:50.245073 2568 generic.go:356] "Generic (PLEG): container finished" podID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerID="0f71fee1d7dd9c87d7afd06abee1c5bfb9d9b9ed766b4dda3330ee1b4104edbb" exitCode=0 Sep 19 01:44:50.245492 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:50.245138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" event={"ID":"2bfa338d-7bbf-4525-b393-260e430b6fbe","Type":"ContainerDied","Data":"0f71fee1d7dd9c87d7afd06abee1c5bfb9d9b9ed766b4dda3330ee1b4104edbb"} Sep 19 01:44:57.277528 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:57.277437 2568 generic.go:356] "Generic (PLEG): container finished" podID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerID="611a74edfb71eb36eb729f2646a68a185b918894d22859facdb26cab259a2cf6" exitCode=0 Sep 19 01:44:57.277867 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:57.277522 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" event={"ID":"2bfa338d-7bbf-4525-b393-260e430b6fbe","Type":"ContainerDied","Data":"611a74edfb71eb36eb729f2646a68a185b918894d22859facdb26cab259a2cf6"} Sep 19 01:44:58.407257 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.407221 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:44:58.574699 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.574607 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle\") pod \"2bfa338d-7bbf-4525-b393-260e430b6fbe\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " Sep 19 01:44:58.574699 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.574650 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util\") pod \"2bfa338d-7bbf-4525-b393-260e430b6fbe\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " Sep 19 01:44:58.574944 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.574707 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k297w\" (UniqueName: \"kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w\") pod \"2bfa338d-7bbf-4525-b393-260e430b6fbe\" (UID: \"2bfa338d-7bbf-4525-b393-260e430b6fbe\") " Sep 19 01:44:58.575362 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.575337 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle" (OuterVolumeSpecName: "bundle") pod "2bfa338d-7bbf-4525-b393-260e430b6fbe" (UID: "2bfa338d-7bbf-4525-b393-260e430b6fbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:44:58.576881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.576851 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w" (OuterVolumeSpecName: "kube-api-access-k297w") pod "2bfa338d-7bbf-4525-b393-260e430b6fbe" (UID: "2bfa338d-7bbf-4525-b393-260e430b6fbe"). InnerVolumeSpecName "kube-api-access-k297w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:44:58.578696 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.578673 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util" (OuterVolumeSpecName: "util") pod "2bfa338d-7bbf-4525-b393-260e430b6fbe" (UID: "2bfa338d-7bbf-4525-b393-260e430b6fbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:44:58.675367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.675319 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:44:58.675367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.675358 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfa338d-7bbf-4525-b393-260e430b6fbe-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:44:58.675367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:58.675367 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k297w\" (UniqueName: \"kubernetes.io/projected/2bfa338d-7bbf-4525-b393-260e430b6fbe-kube-api-access-k297w\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:44:59.285927 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:59.285888 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" event={"ID":"2bfa338d-7bbf-4525-b393-260e430b6fbe","Type":"ContainerDied","Data":"8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6"} Sep 19 01:44:59.286088 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:59.285942 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ac800ff590a228c652c35d6d3b05b5d957870e416e7b904a3c6db5071dc1fa6" Sep 19 01:44:59.286088 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:44:59.285958 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754045574" Sep 19 01:45:03.179214 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179185 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg"] Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179435 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="util" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179445 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="util" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179464 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="pull" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179469 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="pull" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179475 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="extract" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179480 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="extract" Sep 19 01:45:03.179557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.179517 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfa338d-7bbf-4525-b393-260e430b6fbe" containerName="extract" Sep 19 01:45:03.230811 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.230781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg"] Sep 19 01:45:03.230938 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.230882 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.233210 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.233189 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 19 01:45:03.233734 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.233719 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qhgl2\"" Sep 19 01:45:03.233966 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.233951 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:45:03.406481 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.406445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dcw\" (UniqueName: \"kubernetes.io/projected/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-kube-api-access-v6dcw\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.406667 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.406520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.507661 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.507571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dcw\" (UniqueName: \"kubernetes.io/projected/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-kube-api-access-v6dcw\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.507661 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.507652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.508054 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.508033 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.517200 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.517177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dcw\" (UniqueName: \"kubernetes.io/projected/e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387-kube-api-access-v6dcw\") pod \"cert-manager-operator-controller-manager-55c444bf86-6g9gg\" (UID: \"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.539129 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.539103 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" Sep 19 01:45:03.837971 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:03.837896 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg"] Sep 19 01:45:03.841728 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:03.841703 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dd19d4_6eb4_4183_ace5_fe6d5c8f8387.slice/crio-a980d9bf378340a852e318afe3d00117b9cc5bd4d84ce30beff33265e8eaa446 WatchSource:0}: Error finding container a980d9bf378340a852e318afe3d00117b9cc5bd4d84ce30beff33265e8eaa446: Status 404 returned error can't find the container with id a980d9bf378340a852e318afe3d00117b9cc5bd4d84ce30beff33265e8eaa446 Sep 19 01:45:04.305502 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:04.305463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" event={"ID":"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387","Type":"ContainerStarted","Data":"a980d9bf378340a852e318afe3d00117b9cc5bd4d84ce30beff33265e8eaa446"} Sep 19 01:45:06.314597 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:06.314554 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" event={"ID":"e0dd19d4-6eb4-4183-ace5-fe6d5c8f8387","Type":"ContainerStarted","Data":"f938c6a38d976cf3c7dfd988ab8a5dcc66829a677043946bf732d7cd41902cdd"} Sep 19 01:45:06.350338 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:06.350269 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6g9gg" podStartSLOduration=1.328219733 podStartE2EDuration="3.350250389s" totalImagesPullingTime="2.022030656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:06.347894555 +0000 UTC m=+359.006441100" watchObservedRunningTime="2026-09-19 01:45:06.350250389 +0000 UTC m=+359.008796935" Sep 19 01:45:07.044129 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.044092 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq"] Sep 19 01:45:07.046218 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.046195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.049618 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.049589 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lmrcz\"" Sep 19 01:45:07.050065 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.050045 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 01:45:07.050156 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.050055 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 01:45:07.075173 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.075137 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq"] Sep 19 01:45:07.235125 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.235084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvx94\" (UniqueName: \"kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.235125 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.235131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.235330 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.235154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.335599 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.335515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvx94\" (UniqueName: \"kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.335599 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.335569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.335599 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.335592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.336110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.335946 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.336110 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.335977 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.351149 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.351121 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvx94\" (UniqueName: \"kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.354859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:07.646860 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:07.646779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq"] Sep 19 01:45:07.651524 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:07.651496 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e WatchSource:0}: Error finding container ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e: Status 404 returned error can't find the container with id ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e Sep 19 01:45:08.322804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:08.322770 2568 generic.go:356] "Generic (PLEG): container finished" podID="0830e2d2-6e13-427c-af6b-97065e137eed" containerID="1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d" exitCode=0 Sep 19 01:45:08.322989 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:08.322831 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" event={"ID":"0830e2d2-6e13-427c-af6b-97065e137eed","Type":"ContainerDied","Data":"1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d"} Sep 19 01:45:08.322989 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:08.322866 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" event={"ID":"0830e2d2-6e13-427c-af6b-97065e137eed","Type":"ContainerStarted","Data":"ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e"} Sep 19 01:45:08.662430 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:08.662399 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:10.637739 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.637658 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vllqz"] Sep 19 01:45:10.639562 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.639547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.642491 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.642470 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wbtnl\"" Sep 19 01:45:10.642728 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.642713 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 19 01:45:10.643218 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.643201 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 19 01:45:10.655672 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.655645 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vllqz"] Sep 19 01:45:10.762152 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.762112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.762152 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.762157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlx84\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-kube-api-access-tlx84\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.863451 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.863414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.863451 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.863452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlx84\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-kube-api-access-tlx84\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.873640 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.873604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.873811 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.873789 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlx84\" (UniqueName: \"kubernetes.io/projected/4c4df3af-6030-44bf-9ecc-f35932ea8193-kube-api-access-tlx84\") pod \"cert-manager-cainjector-559cdd8c87-vllqz\" (UID: \"4c4df3af-6030-44bf-9ecc-f35932ea8193\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:10.948600 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:10.948556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" Sep 19 01:45:11.231526 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:11.231438 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vllqz"] Sep 19 01:45:11.235248 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:11.235222 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c4df3af_6030_44bf_9ecc_f35932ea8193.slice/crio-1322743fde36c6ad5b0dbb7d1515b2dbc056930f4f52715cfbf98e9674c279c8 WatchSource:0}: Error finding container 1322743fde36c6ad5b0dbb7d1515b2dbc056930f4f52715cfbf98e9674c279c8: Status 404 returned error can't find the container with id 1322743fde36c6ad5b0dbb7d1515b2dbc056930f4f52715cfbf98e9674c279c8 Sep 19 01:45:11.335867 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:11.335832 2568 generic.go:356] "Generic (PLEG): container finished" podID="0830e2d2-6e13-427c-af6b-97065e137eed" containerID="8e7e49c91814ea83dbb8832382a9ca47edb9df80de6f3e6f42aec4766f8332ab" exitCode=0 Sep 19 01:45:11.336047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:11.335924 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" event={"ID":"0830e2d2-6e13-427c-af6b-97065e137eed","Type":"ContainerDied","Data":"8e7e49c91814ea83dbb8832382a9ca47edb9df80de6f3e6f42aec4766f8332ab"} Sep 19 01:45:11.337162 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:11.337130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" event={"ID":"4c4df3af-6030-44bf-9ecc-f35932ea8193","Type":"ContainerStarted","Data":"1322743fde36c6ad5b0dbb7d1515b2dbc056930f4f52715cfbf98e9674c279c8"} Sep 19 01:45:12.345014 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:12.344974 2568 generic.go:356] "Generic (PLEG): container finished" podID="0830e2d2-6e13-427c-af6b-97065e137eed" containerID="01933b3047cddcb8edfa7dc76d2ef911de6a8d0b4f5f9c8d65c0fae3bfdeb002" exitCode=0 Sep 19 01:45:12.345464 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:12.345089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" event={"ID":"0830e2d2-6e13-427c-af6b-97065e137eed","Type":"ContainerDied","Data":"01933b3047cddcb8edfa7dc76d2ef911de6a8d0b4f5f9c8d65c0fae3bfdeb002"} Sep 19 01:45:13.991373 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:13.991348 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:14.089420 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.089390 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle\") pod \"0830e2d2-6e13-427c-af6b-97065e137eed\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " Sep 19 01:45:14.089563 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.089435 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvx94\" (UniqueName: \"kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94\") pod \"0830e2d2-6e13-427c-af6b-97065e137eed\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " Sep 19 01:45:14.089563 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.089466 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util\") pod \"0830e2d2-6e13-427c-af6b-97065e137eed\" (UID: \"0830e2d2-6e13-427c-af6b-97065e137eed\") " Sep 19 01:45:14.089877 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.089841 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle" (OuterVolumeSpecName: "bundle") pod "0830e2d2-6e13-427c-af6b-97065e137eed" (UID: "0830e2d2-6e13-427c-af6b-97065e137eed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:14.091445 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.091423 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94" (OuterVolumeSpecName: "kube-api-access-dvx94") pod "0830e2d2-6e13-427c-af6b-97065e137eed" (UID: "0830e2d2-6e13-427c-af6b-97065e137eed"). InnerVolumeSpecName "kube-api-access-dvx94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:45:14.096086 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.096047 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util" (OuterVolumeSpecName: "util") pod "0830e2d2-6e13-427c-af6b-97065e137eed" (UID: "0830e2d2-6e13-427c-af6b-97065e137eed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:14.190594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.190558 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:14.190594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.190588 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0830e2d2-6e13-427c-af6b-97065e137eed-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:14.190594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.190598 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvx94\" (UniqueName: \"kubernetes.io/projected/0830e2d2-6e13-427c-af6b-97065e137eed-kube-api-access-dvx94\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:14.355303 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.355207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" event={"ID":"4c4df3af-6030-44bf-9ecc-f35932ea8193","Type":"ContainerStarted","Data":"03a86fdcaf55eaac2d0760f104aacde6e49b4fdfa8c71275471616483793549f"} Sep 19 01:45:14.357237 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.357213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" event={"ID":"0830e2d2-6e13-427c-af6b-97065e137eed","Type":"ContainerDied","Data":"ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e"} Sep 19 01:45:14.357367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.357251 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce2e506e29c09badba1cff237d84a3814d92f9e9557b7addb64cff2e3d522f1e" Sep 19 01:45:14.357367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.357259 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w8kq" Sep 19 01:45:14.371738 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:14.371693 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vllqz" podStartSLOduration=1.600549969 podStartE2EDuration="4.371678477s" totalImagesPullingTime="2.771128508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:14.371024369 +0000 UTC m=+367.029570915" watchObservedRunningTime="2026-09-19 01:45:14.371678477 +0000 UTC m=+367.030225022" Sep 19 01:45:15.726661 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:15.726630 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:18.669998 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:18.669963 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:20.515899 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.515865 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj"] Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516102 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="util" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516112 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="util" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516126 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="extract" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516131 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="extract" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="pull" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516145 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="pull" Sep 19 01:45:20.516299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.516193 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0830e2d2-6e13-427c-af6b-97065e137eed" containerName="extract" Sep 19 01:45:20.518337 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.518321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.520968 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.520947 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 19 01:45:20.521722 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.521704 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-54cnq\"" Sep 19 01:45:20.521828 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.521704 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:45:20.532031 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.532008 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj"] Sep 19 01:45:20.533919 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.533899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e660a85e-cdc1-47af-937f-87f6690a9400-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.533982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.533927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74qm\" (UniqueName: \"kubernetes.io/projected/e660a85e-cdc1-47af-937f-87f6690a9400-kube-api-access-s74qm\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.634363 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.634329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e660a85e-cdc1-47af-937f-87f6690a9400-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.634363 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.634361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74qm\" (UniqueName: \"kubernetes.io/projected/e660a85e-cdc1-47af-937f-87f6690a9400-kube-api-access-s74qm\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.634710 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.634690 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e660a85e-cdc1-47af-937f-87f6690a9400-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.642904 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.642876 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74qm\" (UniqueName: \"kubernetes.io/projected/e660a85e-cdc1-47af-937f-87f6690a9400-kube-api-access-s74qm\") pod \"openshift-lws-operator-fd8ccff4c-9trrj\" (UID: \"e660a85e-cdc1-47af-937f-87f6690a9400\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:20.826830 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:20.826734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" Sep 19 01:45:21.094193 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:21.094107 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj"] Sep 19 01:45:21.097341 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:21.097317 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode660a85e_cdc1_47af_937f_87f6690a9400.slice/crio-519236f851268aad6722f463e06349baaa3f7c2f83cd0e5a975274d15379b6e1 WatchSource:0}: Error finding container 519236f851268aad6722f463e06349baaa3f7c2f83cd0e5a975274d15379b6e1: Status 404 returned error can't find the container with id 519236f851268aad6722f463e06349baaa3f7c2f83cd0e5a975274d15379b6e1 Sep 19 01:45:21.385243 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:21.385156 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" event={"ID":"e660a85e-cdc1-47af-937f-87f6690a9400","Type":"ContainerStarted","Data":"519236f851268aad6722f463e06349baaa3f7c2f83cd0e5a975274d15379b6e1"} Sep 19 01:45:23.396424 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:23.396327 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" event={"ID":"e660a85e-cdc1-47af-937f-87f6690a9400","Type":"ContainerStarted","Data":"e6294d3208661d6ae15475fedbe7e358304a98c8c77e9fc94355c6310d9c0181"} Sep 19 01:45:23.422590 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:23.422531 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9trrj" podStartSLOduration=1.506855924 podStartE2EDuration="3.422514266s" totalImagesPullingTime="1.915658342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:23.421410313 +0000 UTC m=+376.079956873" watchObservedRunningTime="2026-09-19 01:45:23.422514266 +0000 UTC m=+376.081060811" Sep 19 01:45:26.270142 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.270105 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x"] Sep 19 01:45:26.273507 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.273488 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.280290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.280256 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 01:45:26.280290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.280284 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 01:45:26.281043 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.281024 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lmrcz\"" Sep 19 01:45:26.294294 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.294261 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x"] Sep 19 01:45:26.381332 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.381289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.381332 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.381342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8tx4\" (UniqueName: \"kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.381564 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.381379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.482481 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.482450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.482638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.482505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.482638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.482560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8tx4\" (UniqueName: \"kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.483012 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.482979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.483081 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.483007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.493969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.493940 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8tx4\" (UniqueName: \"kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.582581 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.582494 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:26.859395 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:26.859369 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x"] Sep 19 01:45:26.861880 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:26.861851 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2440939f_8347_4521_aee2_8dcac64ac328.slice/crio-c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6 WatchSource:0}: Error finding container c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6: Status 404 returned error can't find the container with id c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6 Sep 19 01:45:27.414635 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:27.414601 2568 generic.go:356] "Generic (PLEG): container finished" podID="2440939f-8347-4521-aee2-8dcac64ac328" containerID="07087fcd0a3bf2806e533d3fbfcd89dd7470c346dc12c6a572dbbf9832172914" exitCode=0 Sep 19 01:45:27.415042 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:27.414672 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" event={"ID":"2440939f-8347-4521-aee2-8dcac64ac328","Type":"ContainerDied","Data":"07087fcd0a3bf2806e533d3fbfcd89dd7470c346dc12c6a572dbbf9832172914"} Sep 19 01:45:27.415042 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:27.414714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" event={"ID":"2440939f-8347-4521-aee2-8dcac64ac328","Type":"ContainerStarted","Data":"c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6"} Sep 19 01:45:28.420651 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:28.420613 2568 generic.go:356] "Generic (PLEG): container finished" podID="2440939f-8347-4521-aee2-8dcac64ac328" containerID="c38b21915424de6beb92eb6d1e8487bbb7f98ef705a17f993fbb2ae474eeeae8" exitCode=0 Sep 19 01:45:28.421075 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:28.420698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" event={"ID":"2440939f-8347-4521-aee2-8dcac64ac328","Type":"ContainerDied","Data":"c38b21915424de6beb92eb6d1e8487bbb7f98ef705a17f993fbb2ae474eeeae8"} Sep 19 01:45:28.701736 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:28.701703 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:29.427288 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:29.427250 2568 generic.go:356] "Generic (PLEG): container finished" podID="2440939f-8347-4521-aee2-8dcac64ac328" containerID="1ca9b8927e91a0ade85962dab208805fda8728e0ac6385e74059781b1ea65adb" exitCode=0 Sep 19 01:45:29.427646 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:29.427297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" event={"ID":"2440939f-8347-4521-aee2-8dcac64ac328","Type":"ContainerDied","Data":"1ca9b8927e91a0ade85962dab208805fda8728e0ac6385e74059781b1ea65adb"} Sep 19 01:45:30.554827 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.554801 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:30.617546 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.617511 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle\") pod \"2440939f-8347-4521-aee2-8dcac64ac328\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " Sep 19 01:45:30.617546 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.617562 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util\") pod \"2440939f-8347-4521-aee2-8dcac64ac328\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " Sep 19 01:45:30.617839 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.617590 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8tx4\" (UniqueName: \"kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4\") pod \"2440939f-8347-4521-aee2-8dcac64ac328\" (UID: \"2440939f-8347-4521-aee2-8dcac64ac328\") " Sep 19 01:45:30.618380 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.618347 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle" (OuterVolumeSpecName: "bundle") pod "2440939f-8347-4521-aee2-8dcac64ac328" (UID: "2440939f-8347-4521-aee2-8dcac64ac328"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:30.619693 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.619661 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4" (OuterVolumeSpecName: "kube-api-access-q8tx4") pod "2440939f-8347-4521-aee2-8dcac64ac328" (UID: "2440939f-8347-4521-aee2-8dcac64ac328"). InnerVolumeSpecName "kube-api-access-q8tx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:45:30.622952 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.622927 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util" (OuterVolumeSpecName: "util") pod "2440939f-8347-4521-aee2-8dcac64ac328" (UID: "2440939f-8347-4521-aee2-8dcac64ac328"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:30.711575 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:30.711488 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:30.719016 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.718991 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:30.719099 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.719020 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2440939f-8347-4521-aee2-8dcac64ac328-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:30.719099 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:30.719030 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8tx4\" (UniqueName: \"kubernetes.io/projected/2440939f-8347-4521-aee2-8dcac64ac328-kube-api-access-q8tx4\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:31.437989 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:31.437960 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" Sep 19 01:45:31.437989 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:31.437974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq472x" event={"ID":"2440939f-8347-4521-aee2-8dcac64ac328","Type":"ContainerDied","Data":"c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6"} Sep 19 01:45:31.438236 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:31.438015 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4d3cc72ec72f4afaab8c7ad230d66b20f0b050979ab841da6584436ac17dbe6" Sep 19 01:45:36.682617 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:36.682580 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:36.683110 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:36.682691 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:38.709474 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:38.709430 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:43.114814 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.114774 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z"] Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115039 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="pull" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115049 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="pull" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115062 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="util" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115067 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="util" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115073 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="extract" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115078 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="extract" Sep 19 01:45:43.115194 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.115130 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2440939f-8347-4521-aee2-8dcac64ac328" containerName="extract" Sep 19 01:45:43.120364 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.120348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.123548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.123495 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 01:45:43.123800 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.123774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlcdh\"" Sep 19 01:45:43.123933 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.123883 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 01:45:43.124176 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.124160 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 01:45:43.124281 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.124264 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 01:45:43.141727 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.141700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z"] Sep 19 01:45:43.217221 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.217185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.217221 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.217223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.217417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.217245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.217417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.217295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.217417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.217374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9q2s\" (UniqueName: \"kubernetes.io/projected/774cc4d4-f8e0-4062-bfe0-74d186385fc9-kube-api-access-g9q2s\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.312397 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.312357 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld"] Sep 19 01:45:43.316397 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.316370 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.318093 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.318228 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.318228 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.318228 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.318390 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318276 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9q2s\" (UniqueName: \"kubernetes.io/projected/774cc4d4-f8e0-4062-bfe0-74d186385fc9-kube-api-access-g9q2s\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.318517 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.318493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.319047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.319001 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lmrcz\"" Sep 19 01:45:43.319047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.319013 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 01:45:43.319239 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.319150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 01:45:43.321057 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.321030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/774cc4d4-f8e0-4062-bfe0-74d186385fc9-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.321176 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.321139 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.321276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.321259 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/774cc4d4-f8e0-4062-bfe0-74d186385fc9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.325615 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.325595 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9q2s\" (UniqueName: \"kubernetes.io/projected/774cc4d4-f8e0-4062-bfe0-74d186385fc9-kube-api-access-g9q2s\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-pqg5z\" (UID: \"774cc4d4-f8e0-4062-bfe0-74d186385fc9\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.330691 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.330672 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld"] Sep 19 01:45:43.419003 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.418974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.419167 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.419046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47q89\" (UniqueName: \"kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.419167 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.419073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.429957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.429924 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:43.519581 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.519550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.519740 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.519608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47q89\" (UniqueName: \"kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.519740 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.519628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.519956 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.519930 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.519956 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.519941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.529275 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.529252 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47q89\" (UniqueName: \"kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.639089 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.639055 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:43.707932 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.707902 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z"] Sep 19 01:45:43.712008 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:43.711978 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774cc4d4_f8e0_4062_bfe0_74d186385fc9.slice/crio-b36feac5393000206101a63ec651ec9fc1b8ea791aec976ee8657b6048a62674 WatchSource:0}: Error finding container b36feac5393000206101a63ec651ec9fc1b8ea791aec976ee8657b6048a62674: Status 404 returned error can't find the container with id b36feac5393000206101a63ec651ec9fc1b8ea791aec976ee8657b6048a62674 Sep 19 01:45:43.912102 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:43.911954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld"] Sep 19 01:45:43.914522 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:45:43.914493 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5940e131_8b63_40d1_af63_394cc19fb7ce.slice/crio-d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4 WatchSource:0}: Error finding container d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4: Status 404 returned error can't find the container with id d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4 Sep 19 01:45:44.496494 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:44.496450 2568 generic.go:356] "Generic (PLEG): container finished" podID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerID="949360640cb9ac149a0c79e3092df2cdba25529b1a69b8456271c1d592ee85a0" exitCode=0 Sep 19 01:45:44.496977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:44.496595 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" event={"ID":"5940e131-8b63-40d1-af63-394cc19fb7ce","Type":"ContainerDied","Data":"949360640cb9ac149a0c79e3092df2cdba25529b1a69b8456271c1d592ee85a0"} Sep 19 01:45:44.496977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:44.496644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" event={"ID":"5940e131-8b63-40d1-af63-394cc19fb7ce","Type":"ContainerStarted","Data":"d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4"} Sep 19 01:45:44.498959 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:44.498929 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" event={"ID":"774cc4d4-f8e0-4062-bfe0-74d186385fc9","Type":"ContainerStarted","Data":"b36feac5393000206101a63ec651ec9fc1b8ea791aec976ee8657b6048a62674"} Sep 19 01:45:45.732390 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:45.732358 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:47.514280 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:47.514242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" event={"ID":"774cc4d4-f8e0-4062-bfe0-74d186385fc9","Type":"ContainerStarted","Data":"4b33c4bfc1f10c5c1050d01d1b8163bea3af484172c93398edf9d5f32f04f3d7"} Sep 19 01:45:47.516084 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:47.516060 2568 generic.go:356] "Generic (PLEG): container finished" podID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerID="589a751d79353094f0ae93e86642d2017f3491e413331e7bc59c608006859d7b" exitCode=0 Sep 19 01:45:47.516190 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:47.516118 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" event={"ID":"5940e131-8b63-40d1-af63-394cc19fb7ce","Type":"ContainerDied","Data":"589a751d79353094f0ae93e86642d2017f3491e413331e7bc59c608006859d7b"} Sep 19 01:45:48.522104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:48.522070 2568 generic.go:356] "Generic (PLEG): container finished" podID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerID="e476d34ee4cfa78945b82ddefd486d056b7a1715a950dd80b30568b868abec94" exitCode=0 Sep 19 01:45:48.522536 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:48.522158 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" event={"ID":"5940e131-8b63-40d1-af63-394cc19fb7ce","Type":"ContainerDied","Data":"e476d34ee4cfa78945b82ddefd486d056b7a1715a950dd80b30568b868abec94"} Sep 19 01:45:48.523740 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:48.523718 2568 generic.go:356] "Generic (PLEG): container finished" podID="774cc4d4-f8e0-4062-bfe0-74d186385fc9" containerID="4b33c4bfc1f10c5c1050d01d1b8163bea3af484172c93398edf9d5f32f04f3d7" exitCode=0 Sep 19 01:45:48.523830 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:48.523773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" event={"ID":"774cc4d4-f8e0-4062-bfe0-74d186385fc9","Type":"ContainerDied","Data":"4b33c4bfc1f10c5c1050d01d1b8163bea3af484172c93398edf9d5f32f04f3d7"} Sep 19 01:45:48.716902 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:48.716870 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:45:49.530105 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.530069 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" event={"ID":"774cc4d4-f8e0-4062-bfe0-74d186385fc9","Type":"ContainerStarted","Data":"5e9674d10278928f8c0baeb2806cf1e8c27ab557b968e3d41107e94905abf896"} Sep 19 01:45:49.556146 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.556032 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" podStartSLOduration=2.07087649 podStartE2EDuration="6.556010229s" totalImagesPullingTime="3.431857516s" totalInitContainerRuntime="1.053276223s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:49.554928212 +0000 UTC m=+402.213474758" watchObservedRunningTime="2026-09-19 01:45:49.556010229 +0000 UTC m=+402.214556774" Sep 19 01:45:49.657554 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.657526 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:49.769570 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.769537 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util\") pod \"5940e131-8b63-40d1-af63-394cc19fb7ce\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " Sep 19 01:45:49.769722 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.769581 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47q89\" (UniqueName: \"kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89\") pod \"5940e131-8b63-40d1-af63-394cc19fb7ce\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " Sep 19 01:45:49.769722 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.769602 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle\") pod \"5940e131-8b63-40d1-af63-394cc19fb7ce\" (UID: \"5940e131-8b63-40d1-af63-394cc19fb7ce\") " Sep 19 01:45:49.772341 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.772311 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle" (OuterVolumeSpecName: "bundle") pod "5940e131-8b63-40d1-af63-394cc19fb7ce" (UID: "5940e131-8b63-40d1-af63-394cc19fb7ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:49.773708 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.773689 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89" (OuterVolumeSpecName: "kube-api-access-47q89") pod "5940e131-8b63-40d1-af63-394cc19fb7ce" (UID: "5940e131-8b63-40d1-af63-394cc19fb7ce"). InnerVolumeSpecName "kube-api-access-47q89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:45:49.774665 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.774645 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util" (OuterVolumeSpecName: "util") pod "5940e131-8b63-40d1-af63-394cc19fb7ce" (UID: "5940e131-8b63-40d1-af63-394cc19fb7ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:45:49.870536 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.870452 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:49.870536 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.870477 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47q89\" (UniqueName: \"kubernetes.io/projected/5940e131-8b63-40d1-af63-394cc19fb7ce-kube-api-access-47q89\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:49.870536 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:49.870487 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5940e131-8b63-40d1-af63-394cc19fb7ce-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:45:50.536150 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:50.536118 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" Sep 19 01:45:50.536554 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:50.536147 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hfdld" event={"ID":"5940e131-8b63-40d1-af63-394cc19fb7ce","Type":"ContainerDied","Data":"d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4"} Sep 19 01:45:50.536554 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:50.536222 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d76b286d08a382ed6b761f37cd5e10095ba1fa7a0afcb6f6907493bc395f66a4" Sep 19 01:45:50.536554 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:45:50.536507 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:45:58.751085 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:45:58.751050 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:46:00.688227 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:46:00.688189 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0830e2d2_6e13_427c_af6b_97065e137eed.slice/crio-1ba27f3b11bdc388ed23e64b4c00a8393963d3fb6f0522250e482016f14c899d.scope\": RecentStats: unable to find data in memory cache]" Sep 19 01:46:01.543894 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:01.543861 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-pqg5z" Sep 19 01:46:04.069592 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.069552 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k"] Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.069942 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="extract" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.069963 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="extract" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.069983 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="util" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.069992 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="util" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.070010 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="pull" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.070018 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="pull" Sep 19 01:46:04.070080 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.070077 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5940e131-8b63-40d1-af63-394cc19fb7ce" containerName="extract" Sep 19 01:46:04.073252 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.073232 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.076352 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.076330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 01:46:04.076816 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.076797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 19 01:46:04.076907 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.076864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 19 01:46:04.076907 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.076879 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 01:46:04.076907 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.076863 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qfvlb\"" Sep 19 01:46:04.094102 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.094072 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k"] Sep 19 01:46:04.176317 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.176278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80890caa-57e9-4fd5-93cd-56027d47130c-tmp\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.176465 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.176346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80890caa-57e9-4fd5-93cd-56027d47130c-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.176465 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.176404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txrhn\" (UniqueName: \"kubernetes.io/projected/80890caa-57e9-4fd5-93cd-56027d47130c-kube-api-access-txrhn\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.278971 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.278920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80890caa-57e9-4fd5-93cd-56027d47130c-tmp\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.279179 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.279027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80890caa-57e9-4fd5-93cd-56027d47130c-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.279179 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.279075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txrhn\" (UniqueName: \"kubernetes.io/projected/80890caa-57e9-4fd5-93cd-56027d47130c-kube-api-access-txrhn\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.285477 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.285444 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80890caa-57e9-4fd5-93cd-56027d47130c-tmp\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.286727 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.286707 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80890caa-57e9-4fd5-93cd-56027d47130c-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.298132 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.298109 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txrhn\" (UniqueName: \"kubernetes.io/projected/80890caa-57e9-4fd5-93cd-56027d47130c-kube-api-access-txrhn\") pod \"kube-auth-proxy-54ff584cbc-4s44k\" (UID: \"80890caa-57e9-4fd5-93cd-56027d47130c\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.382290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.382205 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" Sep 19 01:46:04.671206 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:04.671172 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k"] Sep 19 01:46:04.674341 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:04.674314 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80890caa_57e9_4fd5_93cd_56027d47130c.slice/crio-5165d68cc8ee87f26c0b393b84d2d3aff9119e58172dc4380554457cef90ed85 WatchSource:0}: Error finding container 5165d68cc8ee87f26c0b393b84d2d3aff9119e58172dc4380554457cef90ed85: Status 404 returned error can't find the container with id 5165d68cc8ee87f26c0b393b84d2d3aff9119e58172dc4380554457cef90ed85 Sep 19 01:46:05.606365 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:05.606291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" event={"ID":"80890caa-57e9-4fd5-93cd-56027d47130c","Type":"ContainerStarted","Data":"5165d68cc8ee87f26c0b393b84d2d3aff9119e58172dc4380554457cef90ed85"} Sep 19 01:46:07.229624 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.229591 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:07.233147 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.233126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.240007 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.239974 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 19 01:46:07.240007 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.239987 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 19 01:46:07.240007 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.240009 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 19 01:46:07.240268 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.240049 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 19 01:46:07.240268 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.240128 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-th665\"" Sep 19 01:46:07.264697 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.264664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:07.410326 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410474 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410474 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410474 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410474 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jm9\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410474 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.410628 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.410497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511277 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511586 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.511586 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.511419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jm9\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.512201 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.512156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.514155 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.514107 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.514262 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.514243 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.514316 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.514300 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.514357 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.514306 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.531170 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.531138 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jm9\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.545628 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.545602 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-25rs4\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:07.618294 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.618260 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" event={"ID":"80890caa-57e9-4fd5-93cd-56027d47130c","Type":"ContainerStarted","Data":"f1caace89d7d1164d9763dcdd9c113081252856d426daa14d6a33bcc26557d45"} Sep 19 01:46:07.654331 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.654281 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-4s44k" podStartSLOduration=0.877856645 podStartE2EDuration="3.654263074s" totalImagesPullingTime="2.776406429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:07.654247062 +0000 UTC m=+420.312793607" watchObservedRunningTime="2026-09-19 01:46:07.654263074 +0000 UTC m=+420.312809619" Sep 19 01:46:07.847274 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.847194 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-th665\"" Sep 19 01:46:07.854836 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:07.854812 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:08.147636 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:08.147548 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:08.151595 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:08.151567 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4382416f_ab0d_4ca3_8900_d6963d276802.slice/crio-96aff803309eef9b541ae3d31bd6a616e7de1b5278708f152161dbdfe48f703d WatchSource:0}: Error finding container 96aff803309eef9b541ae3d31bd6a616e7de1b5278708f152161dbdfe48f703d: Status 404 returned error can't find the container with id 96aff803309eef9b541ae3d31bd6a616e7de1b5278708f152161dbdfe48f703d Sep 19 01:46:08.623385 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:08.623294 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" event={"ID":"4382416f-ab0d-4ca3-8900-d6963d276802","Type":"ContainerStarted","Data":"96aff803309eef9b541ae3d31bd6a616e7de1b5278708f152161dbdfe48f703d"} Sep 19 01:46:10.687633 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:10.687591 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 19 01:46:10.687964 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:10.687702 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 19 01:46:11.637672 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:11.637637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" event={"ID":"4382416f-ab0d-4ca3-8900-d6963d276802","Type":"ContainerStarted","Data":"bb675d0fb117a845875aa1cd5e1e21ebf8a27cab27022858e4049f0254b93251"} Sep 19 01:46:11.637864 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:11.637848 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:11.639608 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:11.639580 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-25rs4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 19 01:46:11.639713 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:11.639644 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 01:46:11.660519 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:11.660472 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" podStartSLOduration=2.126678085 podStartE2EDuration="4.660458031s" totalImagesPullingTime="2.533779946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:11.657996442 +0000 UTC m=+424.316542989" watchObservedRunningTime="2026-09-19 01:46:11.660458031 +0000 UTC m=+424.319004576" Sep 19 01:46:12.642568 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:12.642536 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:14.817974 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.817940 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t4tm"] Sep 19 01:46:14.821148 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.821131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:14.825005 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.824985 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 19 01:46:14.825137 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.825015 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fgkbf\"" Sep 19 01:46:14.840484 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.840449 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t4tm"] Sep 19 01:46:14.975503 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.975467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2f2p\" (UniqueName: \"kubernetes.io/projected/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-kube-api-access-k2f2p\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:14.975503 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:14.975508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.076062 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.075980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.076204 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.076067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2f2p\" (UniqueName: \"kubernetes.io/projected/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-kube-api-access-k2f2p\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.076204 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:46:15.076127 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 19 01:46:15.076204 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:46:15.076199 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert podName:2c781f6a-19a5-4ff4-af7e-99a2b2bc112d nodeName:}" failed. No retries permitted until 2026-09-19 01:46:15.57618062 +0000 UTC m=+428.234727149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert") pod "odh-model-controller-7998c67dc4-9t4tm" (UID: "2c781f6a-19a5-4ff4-af7e-99a2b2bc112d") : secret "odh-model-controller-webhook-cert" not found Sep 19 01:46:15.084928 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.084898 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2f2p\" (UniqueName: \"kubernetes.io/projected/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-kube-api-access-k2f2p\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.545093 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.545060 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nzwpb"] Sep 19 01:46:15.548286 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.548265 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.559877 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.559857 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 19 01:46:15.560114 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.560096 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-k2m8w\"" Sep 19 01:46:15.567770 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.567728 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nzwpb"] Sep 19 01:46:15.580048 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.580025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.580181 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.580065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblkg\" (UniqueName: \"kubernetes.io/projected/6e555694-01ac-403f-a8b8-b593df6642ef-kube-api-access-lblkg\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.580181 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.580096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.582479 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.582453 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c781f6a-19a5-4ff4-af7e-99a2b2bc112d-cert\") pod \"odh-model-controller-7998c67dc4-9t4tm\" (UID: \"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:15.680673 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.680638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lblkg\" (UniqueName: \"kubernetes.io/projected/6e555694-01ac-403f-a8b8-b593df6642ef-kube-api-access-lblkg\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.680860 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.680774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.680917 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:46:15.680860 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 19 01:46:15.680960 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:46:15.680934 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs podName:6e555694-01ac-403f-a8b8-b593df6642ef nodeName:}" failed. No retries permitted until 2026-09-19 01:46:16.180911556 +0000 UTC m=+428.839458079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs") pod "model-serving-api-54d89bd5fc-nzwpb" (UID: "6e555694-01ac-403f-a8b8-b593df6642ef") : secret "model-serving-api-tls" not found Sep 19 01:46:15.700490 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.700458 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblkg\" (UniqueName: \"kubernetes.io/projected/6e555694-01ac-403f-a8b8-b593df6642ef-kube-api-access-lblkg\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:15.731054 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:15.731021 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:16.000927 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.000799 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t4tm"] Sep 19 01:46:16.003040 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:16.003016 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c781f6a_19a5_4ff4_af7e_99a2b2bc112d.slice/crio-e860a9f8eb8696a5ef28fec613b6c05e82fe5cf6d370c0fb9e3068a46225ffbe WatchSource:0}: Error finding container e860a9f8eb8696a5ef28fec613b6c05e82fe5cf6d370c0fb9e3068a46225ffbe: Status 404 returned error can't find the container with id e860a9f8eb8696a5ef28fec613b6c05e82fe5cf6d370c0fb9e3068a46225ffbe Sep 19 01:46:16.183439 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.183403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:16.185720 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.185698 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e555694-01ac-403f-a8b8-b593df6642ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-nzwpb\" (UID: \"6e555694-01ac-403f-a8b8-b593df6642ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:16.458247 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.458210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:16.660804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.660765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" event={"ID":"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d","Type":"ContainerStarted","Data":"e860a9f8eb8696a5ef28fec613b6c05e82fe5cf6d370c0fb9e3068a46225ffbe"} Sep 19 01:46:16.742170 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:16.742060 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nzwpb"] Sep 19 01:46:16.744654 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:16.744623 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e555694_01ac_403f_a8b8_b593df6642ef.slice/crio-c22c6ad35ea94349c4e43051e7fd661e3b085e44049cc5ef3ddad4152573ed1c WatchSource:0}: Error finding container c22c6ad35ea94349c4e43051e7fd661e3b085e44049cc5ef3ddad4152573ed1c: Status 404 returned error can't find the container with id c22c6ad35ea94349c4e43051e7fd661e3b085e44049cc5ef3ddad4152573ed1c Sep 19 01:46:17.667699 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:17.667655 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" event={"ID":"6e555694-01ac-403f-a8b8-b593df6642ef","Type":"ContainerStarted","Data":"c22c6ad35ea94349c4e43051e7fd661e3b085e44049cc5ef3ddad4152573ed1c"} Sep 19 01:46:19.682415 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.682375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" event={"ID":"2c781f6a-19a5-4ff4-af7e-99a2b2bc112d","Type":"ContainerStarted","Data":"3d5f716758c6bcb7127c821964a23742cfa32afa4a2ed8836b0744603509b6a1"} Sep 19 01:46:19.682885 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.682526 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:19.683871 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.683846 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" event={"ID":"6e555694-01ac-403f-a8b8-b593df6642ef","Type":"ContainerStarted","Data":"aeeb63c6102b99335e37f77bbaa04e50b35efd8b65b8d0970aafe7ebe09aca9f"} Sep 19 01:46:19.683989 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.683960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:46:19.700570 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.700520 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" podStartSLOduration=2.614717989 podStartE2EDuration="5.70047168s" totalImagesPullingTime="3.085753691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:19.698954681 +0000 UTC m=+432.357501225" watchObservedRunningTime="2026-09-19 01:46:19.70047168 +0000 UTC m=+432.359018224" Sep 19 01:46:19.717299 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:19.717251 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" podStartSLOduration=2.379348764 podStartE2EDuration="4.717236544s" totalImagesPullingTime="2.33788778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:19.715778632 +0000 UTC m=+432.374325178" watchObservedRunningTime="2026-09-19 01:46:19.717236544 +0000 UTC m=+432.375783089" Sep 19 01:46:25.856976 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.856947 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr"] Sep 19 01:46:25.859647 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.859629 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:25.867127 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.867108 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tp2pz\"" Sep 19 01:46:25.867239 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.867161 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 19 01:46:25.903123 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.903084 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr"] Sep 19 01:46:25.904608 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.904586 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7"] Sep 19 01:46:25.907234 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.907217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:25.909998 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.909982 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q2qfl\"" Sep 19 01:46:25.910420 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.910403 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 19 01:46:25.927685 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.927660 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7"] Sep 19 01:46:25.950047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.950017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277b1b5f-c31f-495c-af24-96baca837c31-cert\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:25.950164 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:25.950054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sszs\" (UniqueName: \"kubernetes.io/projected/277b1b5f-c31f-495c-af24-96baca837c31-kube-api-access-8sszs\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.050700 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.050662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.050901 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.050708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lvx\" (UniqueName: \"kubernetes.io/projected/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-kube-api-access-t5lvx\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.050901 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.050762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277b1b5f-c31f-495c-af24-96baca837c31-cert\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.050901 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.050871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sszs\" (UniqueName: \"kubernetes.io/projected/277b1b5f-c31f-495c-af24-96baca837c31-kube-api-access-8sszs\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.053184 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.053156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/277b1b5f-c31f-495c-af24-96baca837c31-cert\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.081120 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.081085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sszs\" (UniqueName: \"kubernetes.io/projected/277b1b5f-c31f-495c-af24-96baca837c31-kube-api-access-8sszs\") pod \"kserve-controller-manager-d6f4b65b8-7bjzr\" (UID: \"277b1b5f-c31f-495c-af24-96baca837c31\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.151314 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.151286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.151427 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.151329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lvx\" (UniqueName: \"kubernetes.io/projected/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-kube-api-access-t5lvx\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.153575 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.153546 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.169587 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.169565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:26.184868 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.184850 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lvx\" (UniqueName: \"kubernetes.io/projected/aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f-kube-api-access-t5lvx\") pod \"llmisvc-controller-manager-777c6bd7d5-6bxk7\" (UID: \"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.217071 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.216815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:26.478988 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.478945 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr"] Sep 19 01:46:26.481112 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:26.481077 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277b1b5f_c31f_495c_af24_96baca837c31.slice/crio-963520834c914bc07de73b16b0800a6fb17bd80c2223fcbcbd2427f90141606c WatchSource:0}: Error finding container 963520834c914bc07de73b16b0800a6fb17bd80c2223fcbcbd2427f90141606c: Status 404 returned error can't find the container with id 963520834c914bc07de73b16b0800a6fb17bd80c2223fcbcbd2427f90141606c Sep 19 01:46:26.525470 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.525435 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7"] Sep 19 01:46:26.528455 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:46:26.528421 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa93fbb3_1f50_4c71_8bf3_5efad8fbc39f.slice/crio-c0b41d73dc3fa9e849d4483fc1d3c4b93c5ddcdfa5a5ecccbfda6b17bea6d5a0 WatchSource:0}: Error finding container c0b41d73dc3fa9e849d4483fc1d3c4b93c5ddcdfa5a5ecccbfda6b17bea6d5a0: Status 404 returned error can't find the container with id c0b41d73dc3fa9e849d4483fc1d3c4b93c5ddcdfa5a5ecccbfda6b17bea6d5a0 Sep 19 01:46:26.587688 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.587651 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:26.587883 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.587852 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" containerName="discovery" containerID="cri-o://bb675d0fb117a845875aa1cd5e1e21ebf8a27cab27022858e4049f0254b93251" gracePeriod=30 Sep 19 01:46:26.715941 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.715906 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" event={"ID":"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f","Type":"ContainerStarted","Data":"c0b41d73dc3fa9e849d4483fc1d3c4b93c5ddcdfa5a5ecccbfda6b17bea6d5a0"} Sep 19 01:46:26.717176 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.717147 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" event={"ID":"277b1b5f-c31f-495c-af24-96baca837c31","Type":"ContainerStarted","Data":"963520834c914bc07de73b16b0800a6fb17bd80c2223fcbcbd2427f90141606c"} Sep 19 01:46:26.718969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.718945 2568 generic.go:356] "Generic (PLEG): container finished" podID="4382416f-ab0d-4ca3-8900-d6963d276802" containerID="bb675d0fb117a845875aa1cd5e1e21ebf8a27cab27022858e4049f0254b93251" exitCode=0 Sep 19 01:46:26.719060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.719002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" event={"ID":"4382416f-ab0d-4ca3-8900-d6963d276802","Type":"ContainerDied","Data":"bb675d0fb117a845875aa1cd5e1e21ebf8a27cab27022858e4049f0254b93251"} Sep 19 01:46:26.817437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.817408 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:26.856057 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856023 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856078 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856106 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856167 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8jm9\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856189 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856226 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856546 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856263 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap\") pod \"4382416f-ab0d-4ca3-8900-d6963d276802\" (UID: \"4382416f-ab0d-4ca3-8900-d6963d276802\") " Sep 19 01:46:26.856977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.856951 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:46:26.858659 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.858633 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:46:26.859171 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.858847 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts" (OuterVolumeSpecName: "cacerts") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:46:26.859171 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.858856 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9" (OuterVolumeSpecName: "kube-api-access-t8jm9") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "kube-api-access-t8jm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:46:26.859171 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.858863 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:46:26.859171 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.858877 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token" (OuterVolumeSpecName: "istio-token") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:46:26.859310 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.859188 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs" (OuterVolumeSpecName: "local-certs") pod "4382416f-ab0d-4ca3-8900-d6963d276802" (UID: "4382416f-ab0d-4ca3-8900-d6963d276802"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:46:26.957423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957387 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-dns-cert\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957416 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4382416f-ab0d-4ca3-8900-d6963d276802-istio-csr-ca-configmap\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957428 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-istio-kubeconfig\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957437 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4382416f-ab0d-4ca3-8900-d6963d276802-cacerts\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957923 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957445 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4382416f-ab0d-4ca3-8900-d6963d276802-local-certs\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957923 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957454 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8jm9\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-kube-api-access-t8jm9\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:26.957923 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:26.957462 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4382416f-ab0d-4ca3-8900-d6963d276802-istio-token\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:46:27.726880 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.726852 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" Sep 19 01:46:27.726880 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.726869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4" event={"ID":"4382416f-ab0d-4ca3-8900-d6963d276802","Type":"ContainerDied","Data":"96aff803309eef9b541ae3d31bd6a616e7de1b5278708f152161dbdfe48f703d"} Sep 19 01:46:27.727127 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.726937 2568 scope.go:117] "RemoveContainer" containerID="bb675d0fb117a845875aa1cd5e1e21ebf8a27cab27022858e4049f0254b93251" Sep 19 01:46:27.753271 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.753242 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:27.762491 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.762462 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-25rs4"] Sep 19 01:46:27.875825 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:27.875384 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" path="/var/lib/kubelet/pods/4382416f-ab0d-4ca3-8900-d6963d276802/volumes" Sep 19 01:46:29.738976 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.738935 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" event={"ID":"aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f","Type":"ContainerStarted","Data":"552f3bf2debf8dd63a6f8b1d616c444da7e8029c3112057d2b64f0519141f9f4"} Sep 19 01:46:29.739470 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.739050 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:46:29.740608 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.740577 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" event={"ID":"277b1b5f-c31f-495c-af24-96baca837c31","Type":"ContainerStarted","Data":"139cf83028af7f412f0709e3ef56cc4fcd8eeae6cdc06d20221f3ab08214b8a7"} Sep 19 01:46:29.740765 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.740700 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:46:29.769883 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.769826 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" podStartSLOduration=2.087726625 podStartE2EDuration="4.769812014s" totalImagesPullingTime="2.682085389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:29.768695247 +0000 UTC m=+442.427241792" watchObservedRunningTime="2026-09-19 01:46:29.769812014 +0000 UTC m=+442.428358558" Sep 19 01:46:29.806239 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:29.806195 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" podStartSLOduration=2.119810343 podStartE2EDuration="4.806181825s" totalImagesPullingTime="2.686371482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:29.80582307 +0000 UTC m=+442.464369617" watchObservedRunningTime="2026-09-19 01:46:29.806181825 +0000 UTC m=+442.464728400" Sep 19 01:46:30.691186 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:30.691154 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9t4tm" Sep 19 01:46:30.693395 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:46:30.693367 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nzwpb" Sep 19 01:47:00.749038 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:00.749006 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bxk7" Sep 19 01:47:00.752402 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:00.752377 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7bjzr" Sep 19 01:47:22.877477 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.877439 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt"] Sep 19 01:47:22.877957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.877769 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" containerName="discovery" Sep 19 01:47:22.877957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.877780 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" containerName="discovery" Sep 19 01:47:22.877957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.877839 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4382416f-ab0d-4ca3-8900-d6963d276802" containerName="discovery" Sep 19 01:47:22.882053 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.882035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:22.884909 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.884890 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 01:47:22.885010 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.884913 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 01:47:22.885754 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.885724 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lmrcz\"" Sep 19 01:47:22.898284 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.898260 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt"] Sep 19 01:47:22.984193 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.984165 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89"] Sep 19 01:47:22.987552 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:22.987535 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.006015 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.005988 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89"] Sep 19 01:47:23.015010 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.014988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmxj\" (UniqueName: \"kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.015133 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.015025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.015133 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.015046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.104050 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.104015 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24"] Sep 19 01:47:23.107305 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.107287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.115600 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chmxj\" (UniqueName: \"kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.115710 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115610 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.115710 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.115710 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.115841 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.115896 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.115862 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnpq\" (UniqueName: \"kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.116054 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.116038 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.116143 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.116121 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.126138 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.126112 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24"] Sep 19 01:47:23.132310 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.132253 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmxj\" (UniqueName: \"kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.190707 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.190672 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:23.213734 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.213707 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn"] Sep 19 01:47:23.216684 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rdm\" (UniqueName: \"kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.216805 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.216805 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnpq\" (UniqueName: \"kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.216891 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.216891 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216873 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.216962 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.216892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.217138 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.217100 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.217242 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.217148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.217320 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.217306 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.227855 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.227830 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnpq\" (UniqueName: \"kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.232462 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.232426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn"] Sep 19 01:47:23.296125 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.296092 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:23.317343 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rdm\" (UniqueName: \"kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.317492 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.317492 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.317492 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.317492 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.317714 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317504 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdrb\" (UniqueName: \"kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.317886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.317930 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.317900 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.328105 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.328077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rdm\" (UniqueName: \"kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.416163 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.416128 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:23.418476 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.418455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.418627 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.418488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.418627 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.418510 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdrb\" (UniqueName: \"kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.418909 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.418890 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.418955 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.418903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.433139 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.433106 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdrb\" (UniqueName: \"kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.484206 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.484171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt"] Sep 19 01:47:23.485218 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:23.485186 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4353ebdb_76a6_4f9a_80a9_47fb01e41000.slice/crio-855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627 WatchSource:0}: Error finding container 855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627: Status 404 returned error can't find the container with id 855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627 Sep 19 01:47:23.527629 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.527600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:23.590235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.589316 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89"] Sep 19 01:47:23.648548 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:23.648519 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28287d54_4989_4b2f_967e_98c03bc27009.slice/crio-eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b WatchSource:0}: Error finding container eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b: Status 404 returned error can't find the container with id eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b Sep 19 01:47:23.698009 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.697987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24"] Sep 19 01:47:23.699560 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:23.699537 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998af405_9ad7_4966_9953_1ad5e39d7b49.slice/crio-182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81 WatchSource:0}: Error finding container 182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81: Status 404 returned error can't find the container with id 182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81 Sep 19 01:47:23.821686 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.821653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn"] Sep 19 01:47:23.844541 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:23.844511 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d944e8_55c7_4420_9ccd_c34b7a533181.slice/crio-6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231 WatchSource:0}: Error finding container 6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231: Status 404 returned error can't find the container with id 6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231 Sep 19 01:47:23.982900 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.982870 2568 generic.go:356] "Generic (PLEG): container finished" podID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerID="acfc98844a3c99af1444ef0544ea62bf6372eaaf911890ba2c5b0414ddb0371c" exitCode=0 Sep 19 01:47:23.983278 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.982961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" event={"ID":"998af405-9ad7-4966-9953-1ad5e39d7b49","Type":"ContainerDied","Data":"acfc98844a3c99af1444ef0544ea62bf6372eaaf911890ba2c5b0414ddb0371c"} Sep 19 01:47:23.983278 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.983018 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" event={"ID":"998af405-9ad7-4966-9953-1ad5e39d7b49","Type":"ContainerStarted","Data":"182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81"} Sep 19 01:47:23.984612 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.984590 2568 generic.go:356] "Generic (PLEG): container finished" podID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerID="a1b0323192eeb1d09a4bd37d498848e785f57740a5ab0d9d77f63d76810da3d8" exitCode=0 Sep 19 01:47:23.984699 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.984676 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" event={"ID":"b3d944e8-55c7-4420-9ccd-c34b7a533181","Type":"ContainerDied","Data":"a1b0323192eeb1d09a4bd37d498848e785f57740a5ab0d9d77f63d76810da3d8"} Sep 19 01:47:23.984870 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.984719 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" event={"ID":"b3d944e8-55c7-4420-9ccd-c34b7a533181","Type":"ContainerStarted","Data":"6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231"} Sep 19 01:47:23.986391 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.986367 2568 generic.go:356] "Generic (PLEG): container finished" podID="28287d54-4989-4b2f-967e-98c03bc27009" containerID="877d9cf5a2f715cc4cc88a3f768ffb742a09133c78fdd88d4a6d51babd1b4cac" exitCode=0 Sep 19 01:47:23.986513 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.986472 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" event={"ID":"28287d54-4989-4b2f-967e-98c03bc27009","Type":"ContainerDied","Data":"877d9cf5a2f715cc4cc88a3f768ffb742a09133c78fdd88d4a6d51babd1b4cac"} Sep 19 01:47:23.986513 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.986505 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" event={"ID":"28287d54-4989-4b2f-967e-98c03bc27009","Type":"ContainerStarted","Data":"eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b"} Sep 19 01:47:23.988351 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.988327 2568 generic.go:356] "Generic (PLEG): container finished" podID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerID="7e26dc3d7224ca3c1dd2222962192ca40e2161705a888148a7ccfbc382bca61e" exitCode=0 Sep 19 01:47:23.988452 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.988364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" event={"ID":"4353ebdb-76a6-4f9a-80a9-47fb01e41000","Type":"ContainerDied","Data":"7e26dc3d7224ca3c1dd2222962192ca40e2161705a888148a7ccfbc382bca61e"} Sep 19 01:47:23.988452 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:23.988430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" event={"ID":"4353ebdb-76a6-4f9a-80a9-47fb01e41000","Type":"ContainerStarted","Data":"855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627"} Sep 19 01:47:24.995099 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:24.995069 2568 generic.go:356] "Generic (PLEG): container finished" podID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerID="205cc7cf1eafa2ae3f64042ee09eb2905e5abbbc78c6c5312a43067d09b01a0a" exitCode=0 Sep 19 01:47:24.995485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:24.995114 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" event={"ID":"b3d944e8-55c7-4420-9ccd-c34b7a533181","Type":"ContainerDied","Data":"205cc7cf1eafa2ae3f64042ee09eb2905e5abbbc78c6c5312a43067d09b01a0a"} Sep 19 01:47:26.001722 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.001687 2568 generic.go:356] "Generic (PLEG): container finished" podID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerID="67c690ac0bed7bae6f7fa1c500a35d37f7da5bbf3a3c9bb89814cdcdaec6752c" exitCode=0 Sep 19 01:47:26.002189 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.001779 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" event={"ID":"b3d944e8-55c7-4420-9ccd-c34b7a533181","Type":"ContainerDied","Data":"67c690ac0bed7bae6f7fa1c500a35d37f7da5bbf3a3c9bb89814cdcdaec6752c"} Sep 19 01:47:26.003538 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.003515 2568 generic.go:356] "Generic (PLEG): container finished" podID="28287d54-4989-4b2f-967e-98c03bc27009" containerID="a2131f9975d0803e9a13b5e5fb3d1fff9dd1a99af4c7ec547f96cc4618db6c14" exitCode=0 Sep 19 01:47:26.003643 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.003593 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" event={"ID":"28287d54-4989-4b2f-967e-98c03bc27009","Type":"ContainerDied","Data":"a2131f9975d0803e9a13b5e5fb3d1fff9dd1a99af4c7ec547f96cc4618db6c14"} Sep 19 01:47:26.005404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.005386 2568 generic.go:356] "Generic (PLEG): container finished" podID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerID="d3e0edec58cca595e1f5af225d1e58e255d3f81e1bbbd5b4a9759916b8e3c76c" exitCode=0 Sep 19 01:47:26.005496 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.005475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" event={"ID":"4353ebdb-76a6-4f9a-80a9-47fb01e41000","Type":"ContainerDied","Data":"d3e0edec58cca595e1f5af225d1e58e255d3f81e1bbbd5b4a9759916b8e3c76c"} Sep 19 01:47:26.007426 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.007403 2568 generic.go:356] "Generic (PLEG): container finished" podID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerID="86edec2d9a4e0f376e522221ed3812188b991fc23a58f1aa31e49ac4d76f6ff3" exitCode=0 Sep 19 01:47:26.007486 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:26.007429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" event={"ID":"998af405-9ad7-4966-9953-1ad5e39d7b49","Type":"ContainerDied","Data":"86edec2d9a4e0f376e522221ed3812188b991fc23a58f1aa31e49ac4d76f6ff3"} Sep 19 01:47:27.014290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.014248 2568 generic.go:356] "Generic (PLEG): container finished" podID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerID="472d9e6fb6e719705882b665e9f362def600adb803781b22dd2b122b84c1bca7" exitCode=0 Sep 19 01:47:27.014714 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.014330 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" event={"ID":"998af405-9ad7-4966-9953-1ad5e39d7b49","Type":"ContainerDied","Data":"472d9e6fb6e719705882b665e9f362def600adb803781b22dd2b122b84c1bca7"} Sep 19 01:47:27.016231 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.016207 2568 generic.go:356] "Generic (PLEG): container finished" podID="28287d54-4989-4b2f-967e-98c03bc27009" containerID="f605c2c54234e6281fdcaced75dac11e11849dc2d5aec312bb42a7552f11dcbd" exitCode=0 Sep 19 01:47:27.016340 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.016288 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" event={"ID":"28287d54-4989-4b2f-967e-98c03bc27009","Type":"ContainerDied","Data":"f605c2c54234e6281fdcaced75dac11e11849dc2d5aec312bb42a7552f11dcbd"} Sep 19 01:47:27.018290 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.018268 2568 generic.go:356] "Generic (PLEG): container finished" podID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerID="eef8fc0237b618a151bb637f27d23bb6cd70929d0d6d81279a3ea032f5e13019" exitCode=0 Sep 19 01:47:27.018372 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.018358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" event={"ID":"4353ebdb-76a6-4f9a-80a9-47fb01e41000","Type":"ContainerDied","Data":"eef8fc0237b618a151bb637f27d23bb6cd70929d0d6d81279a3ea032f5e13019"} Sep 19 01:47:27.141012 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.140989 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:27.144661 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.144641 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util\") pod \"b3d944e8-55c7-4420-9ccd-c34b7a533181\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " Sep 19 01:47:27.144773 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.144686 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sdrb\" (UniqueName: \"kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb\") pod \"b3d944e8-55c7-4420-9ccd-c34b7a533181\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " Sep 19 01:47:27.144843 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.144786 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle\") pod \"b3d944e8-55c7-4420-9ccd-c34b7a533181\" (UID: \"b3d944e8-55c7-4420-9ccd-c34b7a533181\") " Sep 19 01:47:27.145260 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.145229 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle" (OuterVolumeSpecName: "bundle") pod "b3d944e8-55c7-4420-9ccd-c34b7a533181" (UID: "b3d944e8-55c7-4420-9ccd-c34b7a533181"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:27.146713 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.146694 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb" (OuterVolumeSpecName: "kube-api-access-2sdrb") pod "b3d944e8-55c7-4420-9ccd-c34b7a533181" (UID: "b3d944e8-55c7-4420-9ccd-c34b7a533181"). InnerVolumeSpecName "kube-api-access-2sdrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:47:27.150190 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.150157 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util" (OuterVolumeSpecName: "util") pod "b3d944e8-55c7-4420-9ccd-c34b7a533181" (UID: "b3d944e8-55c7-4420-9ccd-c34b7a533181"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:27.245820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.245782 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:27.245820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.245814 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sdrb\" (UniqueName: \"kubernetes.io/projected/b3d944e8-55c7-4420-9ccd-c34b7a533181-kube-api-access-2sdrb\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:27.245820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:27.245824 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3d944e8-55c7-4420-9ccd-c34b7a533181-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.025419 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.025389 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" Sep 19 01:47:28.025848 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.025420 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wtkdn" event={"ID":"b3d944e8-55c7-4420-9ccd-c34b7a533181","Type":"ContainerDied","Data":"6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231"} Sep 19 01:47:28.025848 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.025462 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bbb751b3d4b0c22bc407a09f5dc0c2aa137c771a2652d72f6a371a76576e231" Sep 19 01:47:28.200622 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.200601 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:28.202629 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.202607 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:28.205393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.205375 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:28.253586 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253553 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util\") pod \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253596 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util\") pod \"28287d54-4989-4b2f-967e-98c03bc27009\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253626 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle\") pod \"998af405-9ad7-4966-9953-1ad5e39d7b49\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253652 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrnpq\" (UniqueName: \"kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq\") pod \"28287d54-4989-4b2f-967e-98c03bc27009\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253680 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle\") pod \"28287d54-4989-4b2f-967e-98c03bc27009\" (UID: \"28287d54-4989-4b2f-967e-98c03bc27009\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253711 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5rdm\" (UniqueName: \"kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm\") pod \"998af405-9ad7-4966-9953-1ad5e39d7b49\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " Sep 19 01:47:28.253768 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253765 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chmxj\" (UniqueName: \"kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj\") pod \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " Sep 19 01:47:28.254091 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253789 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util\") pod \"998af405-9ad7-4966-9953-1ad5e39d7b49\" (UID: \"998af405-9ad7-4966-9953-1ad5e39d7b49\") " Sep 19 01:47:28.254091 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.253824 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle\") pod \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\" (UID: \"4353ebdb-76a6-4f9a-80a9-47fb01e41000\") " Sep 19 01:47:28.255121 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.254568 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle" (OuterVolumeSpecName: "bundle") pod "4353ebdb-76a6-4f9a-80a9-47fb01e41000" (UID: "4353ebdb-76a6-4f9a-80a9-47fb01e41000"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.255121 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.254592 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle" (OuterVolumeSpecName: "bundle") pod "28287d54-4989-4b2f-967e-98c03bc27009" (UID: "28287d54-4989-4b2f-967e-98c03bc27009"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.255121 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.254851 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle" (OuterVolumeSpecName: "bundle") pod "998af405-9ad7-4966-9953-1ad5e39d7b49" (UID: "998af405-9ad7-4966-9953-1ad5e39d7b49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.256935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.256909 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj" (OuterVolumeSpecName: "kube-api-access-chmxj") pod "4353ebdb-76a6-4f9a-80a9-47fb01e41000" (UID: "4353ebdb-76a6-4f9a-80a9-47fb01e41000"). InnerVolumeSpecName "kube-api-access-chmxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:47:28.257037 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.256942 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq" (OuterVolumeSpecName: "kube-api-access-jrnpq") pod "28287d54-4989-4b2f-967e-98c03bc27009" (UID: "28287d54-4989-4b2f-967e-98c03bc27009"). InnerVolumeSpecName "kube-api-access-jrnpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:47:28.257124 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.257092 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm" (OuterVolumeSpecName: "kube-api-access-k5rdm") pod "998af405-9ad7-4966-9953-1ad5e39d7b49" (UID: "998af405-9ad7-4966-9953-1ad5e39d7b49"). InnerVolumeSpecName "kube-api-access-k5rdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:47:28.259943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.259922 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util" (OuterVolumeSpecName: "util") pod "28287d54-4989-4b2f-967e-98c03bc27009" (UID: "28287d54-4989-4b2f-967e-98c03bc27009"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.261232 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.261214 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util" (OuterVolumeSpecName: "util") pod "998af405-9ad7-4966-9953-1ad5e39d7b49" (UID: "998af405-9ad7-4966-9953-1ad5e39d7b49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.261835 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.261813 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util" (OuterVolumeSpecName: "util") pod "4353ebdb-76a6-4f9a-80a9-47fb01e41000" (UID: "4353ebdb-76a6-4f9a-80a9-47fb01e41000"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:47:28.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354836 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354869 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4353ebdb-76a6-4f9a-80a9-47fb01e41000-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354877 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354885 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.354881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354894 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrnpq\" (UniqueName: \"kubernetes.io/projected/28287d54-4989-4b2f-967e-98c03bc27009-kube-api-access-jrnpq\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.355196 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354925 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28287d54-4989-4b2f-967e-98c03bc27009-bundle\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.355196 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354935 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5rdm\" (UniqueName: \"kubernetes.io/projected/998af405-9ad7-4966-9953-1ad5e39d7b49-kube-api-access-k5rdm\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.355196 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354943 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chmxj\" (UniqueName: \"kubernetes.io/projected/4353ebdb-76a6-4f9a-80a9-47fb01e41000-kube-api-access-chmxj\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:28.355196 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:28.354951 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998af405-9ad7-4966-9953-1ad5e39d7b49-util\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:47:29.032062 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.032031 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" Sep 19 01:47:29.032494 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.032034 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csvs24" event={"ID":"998af405-9ad7-4966-9953-1ad5e39d7b49","Type":"ContainerDied","Data":"182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81"} Sep 19 01:47:29.032494 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.032148 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="182b8547094460c11fb0eae6a9e1dd3583bc38027b81ef43352b4b00d7beea81" Sep 19 01:47:29.034081 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.034047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" event={"ID":"28287d54-4989-4b2f-967e-98c03bc27009","Type":"ContainerDied","Data":"eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b"} Sep 19 01:47:29.034204 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.034067 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7dv89" Sep 19 01:47:29.034204 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.034086 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb8eef23a46a00cc930050be60f9721d85a3b06dec962098b2809ecda87f762b" Sep 19 01:47:29.035960 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.035940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" event={"ID":"4353ebdb-76a6-4f9a-80a9-47fb01e41000","Type":"ContainerDied","Data":"855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627"} Sep 19 01:47:29.035960 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.035956 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vgkpt" Sep 19 01:47:29.036109 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:29.035969 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="855962cfe898b673fc2bfccc7d93838fb6ec629938ad2bbbd15af0ca58b6a627" Sep 19 01:47:37.426412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426378 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd"] Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426662 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426672 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426680 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426686 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426694 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426699 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426706 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426711 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426718 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426723 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426730 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426735 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426755 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426760 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426772 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426778 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426784 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426790 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="extract" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426798 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426804 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="pull" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426810 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426815 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426821 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="util" Sep 19 01:47:37.426818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426825 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="util" Sep 19 01:47:37.427499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426872 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="28287d54-4989-4b2f-967e-98c03bc27009" containerName="extract" Sep 19 01:47:37.427499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426880 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d944e8-55c7-4420-9ccd-c34b7a533181" containerName="extract" Sep 19 01:47:37.427499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426887 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4353ebdb-76a6-4f9a-80a9-47fb01e41000" containerName="extract" Sep 19 01:47:37.427499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.426893 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="998af405-9ad7-4966-9953-1ad5e39d7b49" containerName="extract" Sep 19 01:47:37.429736 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.429719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:37.433855 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.433832 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 19 01:47:37.433964 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.433884 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gdhwn\"" Sep 19 01:47:37.435168 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.435153 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 19 01:47:37.455409 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.455381 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd"] Sep 19 01:47:37.522835 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.522802 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qzr\" (UniqueName: \"kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr\") pod \"limitador-operator-controller-manager-74495c69f8-xshxd\" (UID: \"9b8aea08-4a32-4965-88b6-18c3d48495f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:37.623761 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.623705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qzr\" (UniqueName: \"kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr\") pod \"limitador-operator-controller-manager-74495c69f8-xshxd\" (UID: \"9b8aea08-4a32-4965-88b6-18c3d48495f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:37.635491 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.635460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qzr\" (UniqueName: \"kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr\") pod \"limitador-operator-controller-manager-74495c69f8-xshxd\" (UID: \"9b8aea08-4a32-4965-88b6-18c3d48495f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:37.739838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:37.739721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:38.042369 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:38.042324 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8aea08_4a32_4965_88b6_18c3d48495f9.slice/crio-ac66cbf3889cc3ea18109d114ba44aad663e7ab731462bdec406b6cb57f3c0a4 WatchSource:0}: Error finding container ac66cbf3889cc3ea18109d114ba44aad663e7ab731462bdec406b6cb57f3c0a4: Status 404 returned error can't find the container with id ac66cbf3889cc3ea18109d114ba44aad663e7ab731462bdec406b6cb57f3c0a4 Sep 19 01:47:38.042482 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:38.042451 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd"] Sep 19 01:47:38.081267 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:38.081230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" event={"ID":"9b8aea08-4a32-4965-88b6-18c3d48495f9","Type":"ContainerStarted","Data":"ac66cbf3889cc3ea18109d114ba44aad663e7ab731462bdec406b6cb57f3c0a4"} Sep 19 01:47:39.385206 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.385164 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs"] Sep 19 01:47:39.388348 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.388328 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:39.397574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.397552 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bfmnc\"" Sep 19 01:47:39.397821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.397798 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 19 01:47:39.424152 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.424120 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs"] Sep 19 01:47:39.437432 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.437406 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbptn\" (UniqueName: \"kubernetes.io/projected/9fcb7467-22d4-41f6-beaa-6b58612db1f4-kube-api-access-mbptn\") pod \"dns-operator-controller-manager-7b84cd7c9c-wh2gs\" (UID: \"9fcb7467-22d4-41f6-beaa-6b58612db1f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:39.538366 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.538287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbptn\" (UniqueName: \"kubernetes.io/projected/9fcb7467-22d4-41f6-beaa-6b58612db1f4-kube-api-access-mbptn\") pod \"dns-operator-controller-manager-7b84cd7c9c-wh2gs\" (UID: \"9fcb7467-22d4-41f6-beaa-6b58612db1f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:39.557980 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.557947 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbptn\" (UniqueName: \"kubernetes.io/projected/9fcb7467-22d4-41f6-beaa-6b58612db1f4-kube-api-access-mbptn\") pod \"dns-operator-controller-manager-7b84cd7c9c-wh2gs\" (UID: \"9fcb7467-22d4-41f6-beaa-6b58612db1f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:39.700954 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:39.700918 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:40.004412 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:40.004383 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs"] Sep 19 01:47:40.879357 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:40.879327 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcb7467_22d4_41f6_beaa_6b58612db1f4.slice/crio-257733dd0500184b9eb43f309fdd30e33772295348bc7bb9fa378c9f75260fe3 WatchSource:0}: Error finding container 257733dd0500184b9eb43f309fdd30e33772295348bc7bb9fa378c9f75260fe3: Status 404 returned error can't find the container with id 257733dd0500184b9eb43f309fdd30e33772295348bc7bb9fa378c9f75260fe3 Sep 19 01:47:41.099459 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:41.099423 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" event={"ID":"9b8aea08-4a32-4965-88b6-18c3d48495f9","Type":"ContainerStarted","Data":"a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9"} Sep 19 01:47:41.099639 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:41.099489 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:41.100783 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:41.100733 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" event={"ID":"9fcb7467-22d4-41f6-beaa-6b58612db1f4","Type":"ContainerStarted","Data":"257733dd0500184b9eb43f309fdd30e33772295348bc7bb9fa378c9f75260fe3"} Sep 19 01:47:41.143230 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:41.143137 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" podStartSLOduration=1.240058218 podStartE2EDuration="4.143119186s" totalImagesPullingTime="2.903060968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:47:41.141352858 +0000 UTC m=+513.799899406" watchObservedRunningTime="2026-09-19 01:47:41.143119186 +0000 UTC m=+513.801665730" Sep 19 01:47:44.245518 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.245482 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h"] Sep 19 01:47:44.251485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.250406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.254437 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.254413 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sb9jk\"" Sep 19 01:47:44.266795 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.266768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h"] Sep 19 01:47:44.274667 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.274643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.274792 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.274693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjbr2\" (UniqueName: \"kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.375856 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.375819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjbr2\" (UniqueName: \"kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.376035 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.375879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.376227 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.376211 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.391679 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.391647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjbr2\" (UniqueName: \"kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.561550 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.561464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:44.843986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:44.843956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h"] Sep 19 01:47:44.845839 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:44.845811 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode618887f_9e2a_4c53_9b07_3959bdf66076.slice/crio-7419f4dc48e80cb24aa830d86cde15450cad7a1509aa5d7ba5cb99eee7ce32c0 WatchSource:0}: Error finding container 7419f4dc48e80cb24aa830d86cde15450cad7a1509aa5d7ba5cb99eee7ce32c0: Status 404 returned error can't find the container with id 7419f4dc48e80cb24aa830d86cde15450cad7a1509aa5d7ba5cb99eee7ce32c0 Sep 19 01:47:45.123018 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:45.122932 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" event={"ID":"e618887f-9e2a-4c53-9b07-3959bdf66076","Type":"ContainerStarted","Data":"7419f4dc48e80cb24aa830d86cde15450cad7a1509aa5d7ba5cb99eee7ce32c0"} Sep 19 01:47:46.831258 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.831201 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-mjcp4"] Sep 19 01:47:46.835186 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.835159 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:46.838621 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.838591 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nrs58\"" Sep 19 01:47:46.858060 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.858028 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-mjcp4"] Sep 19 01:47:46.897127 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.897070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9zs7\" (UniqueName: \"kubernetes.io/projected/088fd9af-68ee-4c26-9b21-97e55d24626a-kube-api-access-q9zs7\") pod \"authorino-operator-76b478bd78-mjcp4\" (UID: \"088fd9af-68ee-4c26-9b21-97e55d24626a\") " pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:46.998676 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:46.998621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9zs7\" (UniqueName: \"kubernetes.io/projected/088fd9af-68ee-4c26-9b21-97e55d24626a-kube-api-access-q9zs7\") pod \"authorino-operator-76b478bd78-mjcp4\" (UID: \"088fd9af-68ee-4c26-9b21-97e55d24626a\") " pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:47.019210 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:47.019169 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9zs7\" (UniqueName: \"kubernetes.io/projected/088fd9af-68ee-4c26-9b21-97e55d24626a-kube-api-access-q9zs7\") pod \"authorino-operator-76b478bd78-mjcp4\" (UID: \"088fd9af-68ee-4c26-9b21-97e55d24626a\") " pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:47.150594 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:47.150565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:47.489504 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:47.489426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-mjcp4"] Sep 19 01:47:47.493378 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:47:47.493344 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088fd9af_68ee_4c26_9b21_97e55d24626a.slice/crio-84ba79d0f5cb85e4f1252a43e0ef400c7c9e3c832f7b5074160b3669f976e297 WatchSource:0}: Error finding container 84ba79d0f5cb85e4f1252a43e0ef400c7c9e3c832f7b5074160b3669f976e297: Status 404 returned error can't find the container with id 84ba79d0f5cb85e4f1252a43e0ef400c7c9e3c832f7b5074160b3669f976e297 Sep 19 01:47:48.145620 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:48.145572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" event={"ID":"9fcb7467-22d4-41f6-beaa-6b58612db1f4","Type":"ContainerStarted","Data":"bbd822fc725196708b70215e30e20b7edb573608bf899ec8e109e945bd771b5a"} Sep 19 01:47:48.146095 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:48.145686 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:47:48.147132 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:48.147103 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" event={"ID":"088fd9af-68ee-4c26-9b21-97e55d24626a","Type":"ContainerStarted","Data":"84ba79d0f5cb85e4f1252a43e0ef400c7c9e3c832f7b5074160b3669f976e297"} Sep 19 01:47:48.181138 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:48.181058 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" podStartSLOduration=2.811549103 podStartE2EDuration="9.181034776s" totalImagesPullingTime="6.369485673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:47:48.179238406 +0000 UTC m=+520.837784964" watchObservedRunningTime="2026-09-19 01:47:48.181034776 +0000 UTC m=+520.839581322" Sep 19 01:47:49.157587 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:49.157550 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" event={"ID":"e618887f-9e2a-4c53-9b07-3959bdf66076","Type":"ContainerStarted","Data":"b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2"} Sep 19 01:47:49.186436 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:49.186334 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" podStartSLOduration=1.100916056 podStartE2EDuration="5.186314754s" totalImagesPullingTime="4.085398698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:47:49.185214983 +0000 UTC m=+521.843761529" watchObservedRunningTime="2026-09-19 01:47:49.186314754 +0000 UTC m=+521.844861299" Sep 19 01:47:50.164457 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:50.164415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" event={"ID":"088fd9af-68ee-4c26-9b21-97e55d24626a","Type":"ContainerStarted","Data":"905b69312eb5f5cc3c831cc8c2b7aeef6a4b37fd258fc79e73b591ee6f086b13"} Sep 19 01:47:50.164865 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:50.164512 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:47:50.186923 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:50.186867 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" podStartSLOduration=2.035968298 podStartE2EDuration="4.186847925s" totalImagesPullingTime="2.150879627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:47:50.18408131 +0000 UTC m=+522.842627867" watchObservedRunningTime="2026-09-19 01:47:50.186847925 +0000 UTC m=+522.845394469" Sep 19 01:47:51.170227 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:51.170197 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:47:52.108091 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:52.108058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:47:59.160357 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:47:59.160328 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wh2gs" Sep 19 01:48:01.172460 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:01.172387 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:02.178464 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:02.178430 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-mjcp4" Sep 19 01:48:03.416245 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.416206 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h"] Sep 19 01:48:03.416769 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.416421 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" containerName="manager" containerID="cri-o://b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2" gracePeriod=2 Sep 19 01:48:03.418486 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.418462 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h"] Sep 19 01:48:03.420727 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.420679 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.462012 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.461977 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd"] Sep 19 01:48:03.462201 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.462175 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" containerName="manager" containerID="cri-o://a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9" gracePeriod=2 Sep 19 01:48:03.466156 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.466114 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.472723 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.472694 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:03.473098 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.473081 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" containerName="manager" Sep 19 01:48:03.473183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.473101 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" containerName="manager" Sep 19 01:48:03.473235 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.473195 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" containerName="manager" Sep 19 01:48:03.476175 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.476153 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.483087 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.483068 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd"] Sep 19 01:48:03.498836 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.498803 2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b8aea08-4a32-4965-88b6-18c3d48495f9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-xshxd\": pods \"limitador-operator-controller-manager-74495c69f8-xshxd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.505195 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.505167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:03.508982 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.508960 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk"] Sep 19 01:48:03.509277 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.509265 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" containerName="manager" Sep 19 01:48:03.509326 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.509279 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" containerName="manager" Sep 19 01:48:03.509362 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.509358 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" containerName="manager" Sep 19 01:48:03.512183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.512159 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:03.537695 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.537664 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq"] Sep 19 01:48:03.540388 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.540365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv69d\" (UniqueName: \"kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.540518 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.540393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.540849 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.540834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.544791 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.544770 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk"] Sep 19 01:48:03.554225 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.554188 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xshxd\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.556410 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.556382 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.573818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.573791 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq"] Sep 19 01:48:03.592626 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.592582 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xshxd\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.594895 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.594859 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.641309 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.641273 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblkr\" (UniqueName: \"kubernetes.io/projected/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-kube-api-access-hblkr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.641458 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.641358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv69d\" (UniqueName: \"kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.641458 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.641424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.641576 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.641515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.641576 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.641562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfwm\" (UniqueName: \"kubernetes.io/projected/a9b633c3-96e1-4195-988a-4642de3f3fc4-kube-api-access-rkfwm\") pod \"limitador-operator-controller-manager-74495c69f8-qf2gk\" (UID: \"a9b633c3-96e1-4195-988a-4642de3f3fc4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:03.642276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.642252 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.652651 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.652616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv69d\" (UniqueName: \"kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6mkpb\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.698209 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.698188 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.701702 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.701673 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xshxd\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.702881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.702865 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.704650 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.704627 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.707390 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.707368 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8nz5h\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:03.709434 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:03.709413 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xshxd\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:03.742892 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.742846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.743061 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.742901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfwm\" (UniqueName: \"kubernetes.io/projected/a9b633c3-96e1-4195-988a-4642de3f3fc4-kube-api-access-rkfwm\") pod \"limitador-operator-controller-manager-74495c69f8-qf2gk\" (UID: \"a9b633c3-96e1-4195-988a-4642de3f3fc4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:03.743061 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.742933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hblkr\" (UniqueName: \"kubernetes.io/projected/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-kube-api-access-hblkr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.743296 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.743270 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.754698 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.754672 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfwm\" (UniqueName: \"kubernetes.io/projected/a9b633c3-96e1-4195-988a-4642de3f3fc4-kube-api-access-rkfwm\") pod \"limitador-operator-controller-manager-74495c69f8-qf2gk\" (UID: \"a9b633c3-96e1-4195-988a-4642de3f3fc4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:03.754858 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.754841 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblkr\" (UniqueName: \"kubernetes.io/projected/eab5b19d-8c9e-41b1-b65b-84ac8972d4b4-kube-api-access-hblkr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dfczq\" (UID: \"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.837204 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.837172 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:03.843258 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.843232 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5qzr\" (UniqueName: \"kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr\") pod \"9b8aea08-4a32-4965-88b6-18c3d48495f9\" (UID: \"9b8aea08-4a32-4965-88b6-18c3d48495f9\") " Sep 19 01:48:03.843318 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.843284 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume\") pod \"e618887f-9e2a-4c53-9b07-3959bdf66076\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " Sep 19 01:48:03.843433 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.843353 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjbr2\" (UniqueName: \"kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2\") pod \"e618887f-9e2a-4c53-9b07-3959bdf66076\" (UID: \"e618887f-9e2a-4c53-9b07-3959bdf66076\") " Sep 19 01:48:03.843494 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.843428 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:03.843864 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.843835 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e618887f-9e2a-4c53-9b07-3959bdf66076" (UID: "e618887f-9e2a-4c53-9b07-3959bdf66076"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:48:03.845574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.845551 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2" (OuterVolumeSpecName: "kube-api-access-vjbr2") pod "e618887f-9e2a-4c53-9b07-3959bdf66076" (UID: "e618887f-9e2a-4c53-9b07-3959bdf66076"). InnerVolumeSpecName "kube-api-access-vjbr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:03.845574 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.845568 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr" (OuterVolumeSpecName: "kube-api-access-f5qzr") pod "9b8aea08-4a32-4965-88b6-18c3d48495f9" (UID: "9b8aea08-4a32-4965-88b6-18c3d48495f9"). InnerVolumeSpecName "kube-api-access-f5qzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:03.853526 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.853442 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:03.875860 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.875825 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8aea08-4a32-4965-88b6-18c3d48495f9" path="/var/lib/kubelet/pods/9b8aea08-4a32-4965-88b6-18c3d48495f9/volumes" Sep 19 01:48:03.877215 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.876352 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e618887f-9e2a-4c53-9b07-3959bdf66076" path="/var/lib/kubelet/pods/e618887f-9e2a-4c53-9b07-3959bdf66076/volumes" Sep 19 01:48:03.944385 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.944319 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5qzr\" (UniqueName: \"kubernetes.io/projected/9b8aea08-4a32-4965-88b6-18c3d48495f9-kube-api-access-f5qzr\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:03.944385 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.944350 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e618887f-9e2a-4c53-9b07-3959bdf66076-extensions-socket-volume\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:03.944385 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:03.944359 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjbr2\" (UniqueName: \"kubernetes.io/projected/e618887f-9e2a-4c53-9b07-3959bdf66076-kube-api-access-vjbr2\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:04.139134 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.139109 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:04.140592 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:04.140561 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5ebab8_7fb2_427e_b5b1_c12faff989c6.slice/crio-112fc5288b0cb9a64fdc2119c3ddb2f325762c55811281bdeafe9d088052bb11 WatchSource:0}: Error finding container 112fc5288b0cb9a64fdc2119c3ddb2f325762c55811281bdeafe9d088052bb11: Status 404 returned error can't find the container with id 112fc5288b0cb9a64fdc2119c3ddb2f325762c55811281bdeafe9d088052bb11 Sep 19 01:48:04.150277 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:04.150158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b633c3_96e1_4195_988a_4642de3f3fc4.slice/crio-15db31cf8948d7216580c6cbab780ef7842f91e9ec66e7e33958e467e0ab2762 WatchSource:0}: Error finding container 15db31cf8948d7216580c6cbab780ef7842f91e9ec66e7e33958e467e0ab2762: Status 404 returned error can't find the container with id 15db31cf8948d7216580c6cbab780ef7842f91e9ec66e7e33958e467e0ab2762 Sep 19 01:48:04.150277 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.150162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk"] Sep 19 01:48:04.158612 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.158585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq"] Sep 19 01:48:04.160665 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:04.160618 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab5b19d_8c9e_41b1_b65b_84ac8972d4b4.slice/crio-25761e43e5a33557b88e915aa07d830c24e9a0127c2547d6f6cc9409ed47d2a1 WatchSource:0}: Error finding container 25761e43e5a33557b88e915aa07d830c24e9a0127c2547d6f6cc9409ed47d2a1: Status 404 returned error can't find the container with id 25761e43e5a33557b88e915aa07d830c24e9a0127c2547d6f6cc9409ed47d2a1 Sep 19 01:48:04.242254 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.242219 2568 generic.go:356] "Generic (PLEG): container finished" podID="9b8aea08-4a32-4965-88b6-18c3d48495f9" containerID="a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9" exitCode=0 Sep 19 01:48:04.242427 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.242279 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xshxd" Sep 19 01:48:04.242427 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.242317 2568 scope.go:117] "RemoveContainer" containerID="a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9" Sep 19 01:48:04.244957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.244799 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" event={"ID":"a9b633c3-96e1-4195-988a-4642de3f3fc4","Type":"ContainerStarted","Data":"9068f42bcee69f5e3cf77fed41180b3697ec8faaa19191b989f5d59eaa43011b"} Sep 19 01:48:04.244957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.244865 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" event={"ID":"a9b633c3-96e1-4195-988a-4642de3f3fc4","Type":"ContainerStarted","Data":"15db31cf8948d7216580c6cbab780ef7842f91e9ec66e7e33958e467e0ab2762"} Sep 19 01:48:04.244957 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.244919 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:04.248175 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.248105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" event={"ID":"3c5ebab8-7fb2-427e-b5b1-c12faff989c6","Type":"ContainerStarted","Data":"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522"} Sep 19 01:48:04.248175 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.248157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" event={"ID":"3c5ebab8-7fb2-427e-b5b1-c12faff989c6","Type":"ContainerStarted","Data":"112fc5288b0cb9a64fdc2119c3ddb2f325762c55811281bdeafe9d088052bb11"} Sep 19 01:48:04.248465 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.248375 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:04.250452 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.250425 2568 generic.go:356] "Generic (PLEG): container finished" podID="e618887f-9e2a-4c53-9b07-3959bdf66076" containerID="b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2" exitCode=0 Sep 19 01:48:04.250573 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.250561 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8nz5h" Sep 19 01:48:04.254002 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.253980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" event={"ID":"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4","Type":"ContainerStarted","Data":"f2744d65633e660ae510b01bb0efccfc581fae79f4b7a1e13a86319d55f1b2df"} Sep 19 01:48:04.254160 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.254025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" event={"ID":"eab5b19d-8c9e-41b1-b65b-84ac8972d4b4","Type":"ContainerStarted","Data":"25761e43e5a33557b88e915aa07d830c24e9a0127c2547d6f6cc9409ed47d2a1"} Sep 19 01:48:04.254160 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.254073 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:04.254339 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.254257 2568 scope.go:117] "RemoveContainer" containerID="a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9" Sep 19 01:48:04.254562 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:04.254535 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9\": container with ID starting with a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9 not found: ID does not exist" containerID="a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9" Sep 19 01:48:04.254613 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.254575 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9"} err="failed to get container status \"a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9\": rpc error: code = NotFound desc = could not find container \"a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9\": container with ID starting with a9d39cf2d44d8995090b06dad75a4be0b3179a22cc2a64205e3ae643871bb3b9 not found: ID does not exist" Sep 19 01:48:04.254613 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.254597 2568 scope.go:117] "RemoveContainer" containerID="b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2" Sep 19 01:48:04.262731 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.262710 2568 scope.go:117] "RemoveContainer" containerID="b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2" Sep 19 01:48:04.263052 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:04.263034 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2\": container with ID starting with b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2 not found: ID does not exist" containerID="b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2" Sep 19 01:48:04.263104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.263059 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2"} err="failed to get container status \"b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2\": rpc error: code = NotFound desc = could not find container \"b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2\": container with ID starting with b8debae78111e8cef8f70783d2aa7f070c9bc1b99e24bdf16b0e711f795610f2 not found: ID does not exist" Sep 19 01:48:04.273018 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.272975 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" podStartSLOduration=1.272964129 podStartE2EDuration="1.272964129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:04.272820048 +0000 UTC m=+536.931366594" watchObservedRunningTime="2026-09-19 01:48:04.272964129 +0000 UTC m=+536.931510673" Sep 19 01:48:04.299848 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.299800 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" podStartSLOduration=1.299784554 podStartE2EDuration="1.299784554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:04.298540531 +0000 UTC m=+536.957087076" watchObservedRunningTime="2026-09-19 01:48:04.299784554 +0000 UTC m=+536.958331098" Sep 19 01:48:04.327054 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:04.327012 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" podStartSLOduration=1.326997569 podStartE2EDuration="1.326997569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:04.32301296 +0000 UTC m=+536.981559504" watchObservedRunningTime="2026-09-19 01:48:04.326997569 +0000 UTC m=+536.985544115" Sep 19 01:48:15.264977 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.264935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dfczq" Sep 19 01:48:15.265375 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.265031 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:15.265511 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.265488 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qf2gk" Sep 19 01:48:15.377722 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.377689 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:15.377963 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.377936 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" podUID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" containerName="manager" containerID="cri-o://750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522" gracePeriod=10 Sep 19 01:48:15.619017 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.618985 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:15.747311 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.747276 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv69d\" (UniqueName: \"kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d\") pod \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " Sep 19 01:48:15.747496 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.747366 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume\") pod \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\" (UID: \"3c5ebab8-7fb2-427e-b5b1-c12faff989c6\") " Sep 19 01:48:15.747764 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.747721 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c5ebab8-7fb2-427e-b5b1-c12faff989c6" (UID: "3c5ebab8-7fb2-427e-b5b1-c12faff989c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:48:15.749408 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.749383 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d" (OuterVolumeSpecName: "kube-api-access-sv69d") pod "3c5ebab8-7fb2-427e-b5b1-c12faff989c6" (UID: "3c5ebab8-7fb2-427e-b5b1-c12faff989c6"). InnerVolumeSpecName "kube-api-access-sv69d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:15.848987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.848911 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv69d\" (UniqueName: \"kubernetes.io/projected/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-kube-api-access-sv69d\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:15.848987 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:15.848946 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5ebab8-7fb2-427e-b5b1-c12faff989c6-extensions-socket-volume\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:16.323306 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.323273 2568 generic.go:356] "Generic (PLEG): container finished" podID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" containerID="750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522" exitCode=0 Sep 19 01:48:16.323838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.323317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" event={"ID":"3c5ebab8-7fb2-427e-b5b1-c12faff989c6","Type":"ContainerDied","Data":"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522"} Sep 19 01:48:16.323838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.323327 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" Sep 19 01:48:16.323838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.323358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb" event={"ID":"3c5ebab8-7fb2-427e-b5b1-c12faff989c6","Type":"ContainerDied","Data":"112fc5288b0cb9a64fdc2119c3ddb2f325762c55811281bdeafe9d088052bb11"} Sep 19 01:48:16.323838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.323380 2568 scope.go:117] "RemoveContainer" containerID="750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522" Sep 19 01:48:16.334179 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.334100 2568 scope.go:117] "RemoveContainer" containerID="750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522" Sep 19 01:48:16.334863 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:48:16.334831 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522\": container with ID starting with 750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522 not found: ID does not exist" containerID="750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522" Sep 19 01:48:16.334947 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.334870 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522"} err="failed to get container status \"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522\": rpc error: code = NotFound desc = could not find container \"750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522\": container with ID starting with 750c7397a99385254196ef8a242d627b12223c4151092e7f7030b4ae425e5522 not found: ID does not exist" Sep 19 01:48:16.356559 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.356531 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:16.369867 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:16.369843 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6mkpb"] Sep 19 01:48:17.876762 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:17.876721 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" path="/var/lib/kubelet/pods/3c5ebab8-7fb2-427e-b5b1-c12faff989c6/volumes" Sep 19 01:48:34.051394 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.051357 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:34.051902 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.051701 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" containerName="manager" Sep 19 01:48:34.051902 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.051713 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" containerName="manager" Sep 19 01:48:34.051902 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.051789 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5ebab8-7fb2-427e-b5b1-c12faff989c6" containerName="manager" Sep 19 01:48:34.053659 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.053640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.056109 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.056085 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbctd\"" Sep 19 01:48:34.056566 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.056551 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 19 01:48:34.070308 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.070284 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:34.090133 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.090100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwv4f\" (UniqueName: \"kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.090293 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.090173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.140164 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.140131 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:34.191384 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.191349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwv4f\" (UniqueName: \"kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.191548 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.191427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.192019 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.192001 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.200413 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.200392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwv4f\" (UniqueName: \"kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f\") pod \"limitador-limitador-8588749977-7dv4m\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.363109 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.363018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:34.632789 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.632760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:34.634810 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:34.634784 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d5c6ca_5750_4963_acba_654400e58ee3.slice/crio-177d0366de9e9cbd53593b43c9e1f5383e1bdefc08e0d3a04d95e6225b98b9cf WatchSource:0}: Error finding container 177d0366de9e9cbd53593b43c9e1f5383e1bdefc08e0d3a04d95e6225b98b9cf: Status 404 returned error can't find the container with id 177d0366de9e9cbd53593b43c9e1f5383e1bdefc08e0d3a04d95e6225b98b9cf Sep 19 01:48:34.873628 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.873592 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:48:34.876605 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.876581 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:48:34.879247 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.879210 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jf5fs\"" Sep 19 01:48:34.886590 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.886566 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:48:34.897467 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.897443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p588s\" (UniqueName: \"kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s\") pod \"authorino-59c974bd48-hnlm8\" (UID: \"68a711a9-6deb-47bd-a9b8-c8a133cefd48\") " pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:48:34.998074 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:34.998038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p588s\" (UniqueName: \"kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s\") pod \"authorino-59c974bd48-hnlm8\" (UID: \"68a711a9-6deb-47bd-a9b8-c8a133cefd48\") " pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:48:35.006870 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:35.006841 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p588s\" (UniqueName: \"kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s\") pod \"authorino-59c974bd48-hnlm8\" (UID: \"68a711a9-6deb-47bd-a9b8-c8a133cefd48\") " pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:48:35.187657 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:35.187623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:48:35.424397 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:35.424362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" event={"ID":"11d5c6ca-5750-4963-acba-654400e58ee3","Type":"ContainerStarted","Data":"177d0366de9e9cbd53593b43c9e1f5383e1bdefc08e0d3a04d95e6225b98b9cf"} Sep 19 01:48:35.460314 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:35.460169 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:48:35.462710 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:35.462667 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68a711a9_6deb_47bd_a9b8_c8a133cefd48.slice/crio-5d424dfe6930d62ba700af595a391fb9397b6eebcbeb443f38c670fb40f758aa WatchSource:0}: Error finding container 5d424dfe6930d62ba700af595a391fb9397b6eebcbeb443f38c670fb40f758aa: Status 404 returned error can't find the container with id 5d424dfe6930d62ba700af595a391fb9397b6eebcbeb443f38c670fb40f758aa Sep 19 01:48:36.431236 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:36.431193 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" event={"ID":"11d5c6ca-5750-4963-acba-654400e58ee3","Type":"ContainerStarted","Data":"67a433bb2ec5219a98fed1d95ddefc64c8f76f83470ffc0acdf5d1e14ada3ee7"} Sep 19 01:48:36.431675 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:36.431299 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:36.432407 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:36.432386 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hnlm8" event={"ID":"68a711a9-6deb-47bd-a9b8-c8a133cefd48","Type":"ContainerStarted","Data":"5d424dfe6930d62ba700af595a391fb9397b6eebcbeb443f38c670fb40f758aa"} Sep 19 01:48:36.455218 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:36.455177 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" podStartSLOduration=1.211539737 podStartE2EDuration="2.455165236s" totalImagesPullingTime="1.243625499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:36.451919077 +0000 UTC m=+569.110465633" watchObservedRunningTime="2026-09-19 01:48:36.455165236 +0000 UTC m=+569.113711780" Sep 19 01:48:47.439135 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:47.439101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:49.506129 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:49.506091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hnlm8" event={"ID":"68a711a9-6deb-47bd-a9b8-c8a133cefd48","Type":"ContainerStarted","Data":"1df22f39ad77ff2da3a7a116bdcdc1f409d5c7833f7bfeba31544db261a3a308"} Sep 19 01:48:49.522978 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:49.522702 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-hnlm8" podStartSLOduration=1.606409637 podStartE2EDuration="15.5226785s" totalImagesPullingTime="13.916268863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:49.52208907 +0000 UTC m=+582.180635685" watchObservedRunningTime="2026-09-19 01:48:49.5226785 +0000 UTC m=+582.181225251" Sep 19 01:48:49.984910 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:49.984877 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:49.985099 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:49.985054 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" podUID="11d5c6ca-5750-4963-acba-654400e58ee3" containerName="limitador" containerID="cri-o://67a433bb2ec5219a98fed1d95ddefc64c8f76f83470ffc0acdf5d1e14ada3ee7" gracePeriod=30 Sep 19 01:48:50.513345 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.513313 2568 generic.go:356] "Generic (PLEG): container finished" podID="11d5c6ca-5750-4963-acba-654400e58ee3" containerID="67a433bb2ec5219a98fed1d95ddefc64c8f76f83470ffc0acdf5d1e14ada3ee7" exitCode=0 Sep 19 01:48:50.513740 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.513391 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" event={"ID":"11d5c6ca-5750-4963-acba-654400e58ee3","Type":"ContainerDied","Data":"67a433bb2ec5219a98fed1d95ddefc64c8f76f83470ffc0acdf5d1e14ada3ee7"} Sep 19 01:48:50.539946 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.539923 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:50.614027 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.613924 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file\") pod \"11d5c6ca-5750-4963-acba-654400e58ee3\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " Sep 19 01:48:50.614027 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.613984 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwv4f\" (UniqueName: \"kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f\") pod \"11d5c6ca-5750-4963-acba-654400e58ee3\" (UID: \"11d5c6ca-5750-4963-acba-654400e58ee3\") " Sep 19 01:48:50.614365 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.614342 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file" (OuterVolumeSpecName: "config-file") pod "11d5c6ca-5750-4963-acba-654400e58ee3" (UID: "11d5c6ca-5750-4963-acba-654400e58ee3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:48:50.616085 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.616062 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f" (OuterVolumeSpecName: "kube-api-access-nwv4f") pod "11d5c6ca-5750-4963-acba-654400e58ee3" (UID: "11d5c6ca-5750-4963-acba-654400e58ee3"). InnerVolumeSpecName "kube-api-access-nwv4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:50.714925 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.714890 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11d5c6ca-5750-4963-acba-654400e58ee3-config-file\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:50.714925 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:50.714918 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwv4f\" (UniqueName: \"kubernetes.io/projected/11d5c6ca-5750-4963-acba-654400e58ee3-kube-api-access-nwv4f\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:48:51.520449 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.520414 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" event={"ID":"11d5c6ca-5750-4963-acba-654400e58ee3","Type":"ContainerDied","Data":"177d0366de9e9cbd53593b43c9e1f5383e1bdefc08e0d3a04d95e6225b98b9cf"} Sep 19 01:48:51.520886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.520501 2568 scope.go:117] "RemoveContainer" containerID="67a433bb2ec5219a98fed1d95ddefc64c8f76f83470ffc0acdf5d1e14ada3ee7" Sep 19 01:48:51.520886 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.520422 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7dv4m" Sep 19 01:48:51.543678 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.543656 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:51.547821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.547799 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7dv4m"] Sep 19 01:48:51.872763 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:51.872679 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d5c6ca-5750-4963-acba-654400e58ee3" path="/var/lib/kubelet/pods/11d5c6ca-5750-4963-acba-654400e58ee3/volumes" Sep 19 01:48:55.830458 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.830421 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4"] Sep 19 01:48:55.830891 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.830769 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d5c6ca-5750-4963-acba-654400e58ee3" containerName="limitador" Sep 19 01:48:55.830891 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.830783 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d5c6ca-5750-4963-acba-654400e58ee3" containerName="limitador" Sep 19 01:48:55.830891 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.830853 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d5c6ca-5750-4963-acba-654400e58ee3" containerName="limitador" Sep 19 01:48:55.835139 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.835123 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.838695 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.838674 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 19 01:48:55.838868 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.838851 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 19 01:48:55.839467 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.839452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-465fg\"" Sep 19 01:48:55.839514 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.839472 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 19 01:48:55.854300 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.854282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcbr\" (UniqueName: \"kubernetes.io/projected/0f5506d4-917c-4d47-a8da-7e46e1606e5a-kube-api-access-pdcbr\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.854398 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.854326 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0f5506d4-917c-4d47-a8da-7e46e1606e5a-data\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.862349 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.862326 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4"] Sep 19 01:48:55.955267 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.955230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcbr\" (UniqueName: \"kubernetes.io/projected/0f5506d4-917c-4d47-a8da-7e46e1606e5a-kube-api-access-pdcbr\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.955446 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.955286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0f5506d4-917c-4d47-a8da-7e46e1606e5a-data\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.955622 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.955608 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0f5506d4-917c-4d47-a8da-7e46e1606e5a-data\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:55.968473 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:55.968440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcbr\" (UniqueName: \"kubernetes.io/projected/0f5506d4-917c-4d47-a8da-7e46e1606e5a-kube-api-access-pdcbr\") pod \"postgres-69fb4594cf-8w8f4\" (UID: \"0f5506d4-917c-4d47-a8da-7e46e1606e5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:56.144604 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:56.144518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:48:56.417666 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:56.417641 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4"] Sep 19 01:48:56.420083 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:48:56.420053 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5506d4_917c_4d47_a8da_7e46e1606e5a.slice/crio-2d21e0fff41afb6dc8931d96e97a33c4bc7c380ae0173011c0086d08179d3f91 WatchSource:0}: Error finding container 2d21e0fff41afb6dc8931d96e97a33c4bc7c380ae0173011c0086d08179d3f91: Status 404 returned error can't find the container with id 2d21e0fff41afb6dc8931d96e97a33c4bc7c380ae0173011c0086d08179d3f91 Sep 19 01:48:56.548899 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:48:56.548862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" event={"ID":"0f5506d4-917c-4d47-a8da-7e46e1606e5a","Type":"ContainerStarted","Data":"2d21e0fff41afb6dc8931d96e97a33c4bc7c380ae0173011c0086d08179d3f91"} Sep 19 01:49:01.581990 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:01.581913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" event={"ID":"0f5506d4-917c-4d47-a8da-7e46e1606e5a","Type":"ContainerStarted","Data":"21240358bb6d3e55a6c4a89d3a23d5e375deaca151a5e1eec9a13a60ecb4035a"} Sep 19 01:49:01.582343 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:01.582051 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:49:01.601092 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:01.601048 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" podStartSLOduration=1.7032301749999998 podStartE2EDuration="6.601033546s" totalImagesPullingTime="4.897803371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:01.599441058 +0000 UTC m=+594.257987603" watchObservedRunningTime="2026-09-19 01:49:01.601033546 +0000 UTC m=+594.259580091" Sep 19 01:49:07.614804 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:07.614776 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8w8f4" Sep 19 01:49:10.131673 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:10.131634 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:49:10.132146 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:10.131865 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-hnlm8" podUID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" containerName="authorino" containerID="cri-o://1df22f39ad77ff2da3a7a116bdcdc1f409d5c7833f7bfeba31544db261a3a308" gracePeriod=30 Sep 19 01:49:10.628509 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:10.628473 2568 generic.go:356] "Generic (PLEG): container finished" podID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" containerID="1df22f39ad77ff2da3a7a116bdcdc1f409d5c7833f7bfeba31544db261a3a308" exitCode=0 Sep 19 01:49:10.628675 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:10.628548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hnlm8" event={"ID":"68a711a9-6deb-47bd-a9b8-c8a133cefd48","Type":"ContainerDied","Data":"1df22f39ad77ff2da3a7a116bdcdc1f409d5c7833f7bfeba31544db261a3a308"} Sep 19 01:49:10.937439 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:10.937403 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:49:11.075238 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.075200 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p588s\" (UniqueName: \"kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s\") pod \"68a711a9-6deb-47bd-a9b8-c8a133cefd48\" (UID: \"68a711a9-6deb-47bd-a9b8-c8a133cefd48\") " Sep 19 01:49:11.077279 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.077255 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s" (OuterVolumeSpecName: "kube-api-access-p588s") pod "68a711a9-6deb-47bd-a9b8-c8a133cefd48" (UID: "68a711a9-6deb-47bd-a9b8-c8a133cefd48"). InnerVolumeSpecName "kube-api-access-p588s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:49:11.175734 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.175694 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p588s\" (UniqueName: \"kubernetes.io/projected/68a711a9-6deb-47bd-a9b8-c8a133cefd48-kube-api-access-p588s\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:49:11.635221 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.635125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hnlm8" event={"ID":"68a711a9-6deb-47bd-a9b8-c8a133cefd48","Type":"ContainerDied","Data":"5d424dfe6930d62ba700af595a391fb9397b6eebcbeb443f38c670fb40f758aa"} Sep 19 01:49:11.635221 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.635145 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hnlm8" Sep 19 01:49:11.635221 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.635183 2568 scope.go:117] "RemoveContainer" containerID="1df22f39ad77ff2da3a7a116bdcdc1f409d5c7833f7bfeba31544db261a3a308" Sep 19 01:49:11.657881 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.657853 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:49:11.662325 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.662306 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hnlm8"] Sep 19 01:49:11.873197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:11.873165 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" path="/var/lib/kubelet/pods/68a711a9-6deb-47bd-a9b8-c8a133cefd48/volumes" Sep 19 01:49:14.788904 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.788867 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:14.789371 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.789232 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" containerName="authorino" Sep 19 01:49:14.789371 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.789243 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" containerName="authorino" Sep 19 01:49:14.789371 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.789299 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a711a9-6deb-47bd-a9b8-c8a133cefd48" containerName="authorino" Sep 19 01:49:14.792147 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.792124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:14.794650 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.794631 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 19 01:49:14.794961 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.794941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 19 01:49:14.795485 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.795464 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 19 01:49:14.795583 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.795510 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zstw8\"" Sep 19 01:49:14.819813 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.819775 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:14.904967 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.904910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:14.904967 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.904983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmt8\" (UniqueName: \"kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:14.905238 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.905079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:14.967920 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.967882 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59d5465bb6-j7899"] Sep 19 01:49:14.970357 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.970341 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:14.991249 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:14.991223 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59d5465bb6-j7899"] Sep 19 01:49:15.005900 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.005863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmt8\" (UniqueName: \"kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.006078 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.005919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.006078 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.005996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.006196 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:49:15.006079 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 19 01:49:15.006196 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:49:15.006148 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert podName:20d967e0-b2be-4599-920e-57dfc700eed3 nodeName:}" failed. No retries permitted until 2026-09-19 01:49:15.506132496 +0000 UTC m=+608.164679018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert") pod "maas-controller-75dc6cbdf-wmkvf" (UID: "20d967e0-b2be-4599-920e-57dfc700eed3") : secret "maas-controller-webhook-cert" not found Sep 19 01:49:15.008473 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.008453 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.020358 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.020331 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmt8\" (UniqueName: \"kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.107161 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.107062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-metrics-certs\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.107161 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.107134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2m9d\" (UniqueName: \"kubernetes.io/projected/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-kube-api-access-r2m9d\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.107350 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.107193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-webhook-cert\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.208367 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.208331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2m9d\" (UniqueName: \"kubernetes.io/projected/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-kube-api-access-r2m9d\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.208542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.208394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-webhook-cert\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.208542 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.208427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-metrics-certs\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.210785 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.210741 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-metrics-certs\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.210925 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.210901 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-webhook-cert\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.216516 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.216491 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2m9d\" (UniqueName: \"kubernetes.io/projected/3d3ee614-3dbc-4e89-870f-1d0a4ff7942b-kube-api-access-r2m9d\") pod \"maas-controller-59d5465bb6-j7899\" (UID: \"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b\") " pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.280123 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.280088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:15.510276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.510239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.512655 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.512630 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") pod \"maas-controller-75dc6cbdf-wmkvf\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.554958 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.554935 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59d5465bb6-j7899"] Sep 19 01:49:15.556664 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:49:15.556635 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3ee614_3dbc_4e89_870f_1d0a4ff7942b.slice/crio-9a46a2d6662c96a8fc32e2dda70689eb19d030eb0bab506771ee676fc266d1a1 WatchSource:0}: Error finding container 9a46a2d6662c96a8fc32e2dda70689eb19d030eb0bab506771ee676fc266d1a1: Status 404 returned error can't find the container with id 9a46a2d6662c96a8fc32e2dda70689eb19d030eb0bab506771ee676fc266d1a1 Sep 19 01:49:15.657122 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.657080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5465bb6-j7899" event={"ID":"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b","Type":"ContainerStarted","Data":"9a46a2d6662c96a8fc32e2dda70689eb19d030eb0bab506771ee676fc266d1a1"} Sep 19 01:49:15.702250 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.702220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:15.979444 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:15.979421 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:15.981512 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:49:15.981489 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d967e0_b2be_4599_920e_57dfc700eed3.slice/crio-41e8cefa731918e8f1cf5d3124ae5586f1c3badc398f2f0f0e5fde16214029bc WatchSource:0}: Error finding container 41e8cefa731918e8f1cf5d3124ae5586f1c3badc398f2f0f0e5fde16214029bc: Status 404 returned error can't find the container with id 41e8cefa731918e8f1cf5d3124ae5586f1c3badc398f2f0f0e5fde16214029bc Sep 19 01:49:16.668838 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:16.668737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" event={"ID":"20d967e0-b2be-4599-920e-57dfc700eed3","Type":"ContainerStarted","Data":"41e8cefa731918e8f1cf5d3124ae5586f1c3badc398f2f0f0e5fde16214029bc"} Sep 19 01:49:18.682291 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.682259 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" event={"ID":"20d967e0-b2be-4599-920e-57dfc700eed3","Type":"ContainerStarted","Data":"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f"} Sep 19 01:49:18.682696 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.682363 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:18.683820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.683795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5465bb6-j7899" event={"ID":"3d3ee614-3dbc-4e89-870f-1d0a4ff7942b","Type":"ContainerStarted","Data":"9e431e8bcb7de970075511950e3c2a8dec4f5be4f020ee4a4656fd4f10886470"} Sep 19 01:49:18.683938 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.683922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:18.724003 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.719225 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" podStartSLOduration=2.684618422 podStartE2EDuration="4.719201987s" totalImagesPullingTime="2.034583565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:18.716931129 +0000 UTC m=+611.375477675" watchObservedRunningTime="2026-09-19 01:49:18.719201987 +0000 UTC m=+611.377748533" Sep 19 01:49:18.756250 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:18.756198 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59d5465bb6-j7899" podStartSLOduration=2.305926507 podStartE2EDuration="4.756182613s" totalImagesPullingTime="2.450256106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:18.755279704 +0000 UTC m=+611.413826263" watchObservedRunningTime="2026-09-19 01:49:18.756182613 +0000 UTC m=+611.414729182" Sep 19 01:49:29.691065 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:29.691031 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:29.691427 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:29.691115 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59d5465bb6-j7899" Sep 19 01:49:29.800113 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:29.800076 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:29.800339 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:29.800289 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" podUID="20d967e0-b2be-4599-920e-57dfc700eed3" containerName="manager" containerID="cri-o://94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f" gracePeriod=30 Sep 19 01:49:30.046062 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.046033 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:30.131734 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.131663 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs\") pod \"20d967e0-b2be-4599-920e-57dfc700eed3\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " Sep 19 01:49:30.131734 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.131706 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") pod \"20d967e0-b2be-4599-920e-57dfc700eed3\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " Sep 19 01:49:30.131952 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.131738 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfmt8\" (UniqueName: \"kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8\") pod \"20d967e0-b2be-4599-920e-57dfc700eed3\" (UID: \"20d967e0-b2be-4599-920e-57dfc700eed3\") " Sep 19 01:49:30.133940 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.133902 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20d967e0-b2be-4599-920e-57dfc700eed3" (UID: "20d967e0-b2be-4599-920e-57dfc700eed3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:49:30.134061 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.134014 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "20d967e0-b2be-4599-920e-57dfc700eed3" (UID: "20d967e0-b2be-4599-920e-57dfc700eed3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:49:30.134061 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.134025 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8" (OuterVolumeSpecName: "kube-api-access-xfmt8") pod "20d967e0-b2be-4599-920e-57dfc700eed3" (UID: "20d967e0-b2be-4599-920e-57dfc700eed3"). InnerVolumeSpecName "kube-api-access-xfmt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:49:30.233197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.233100 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-metrics-certs\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:49:30.233197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.233140 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20d967e0-b2be-4599-920e-57dfc700eed3-webhook-cert\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:49:30.233197 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.233149 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfmt8\" (UniqueName: \"kubernetes.io/projected/20d967e0-b2be-4599-920e-57dfc700eed3-kube-api-access-xfmt8\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:49:30.746878 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.746813 2568 generic.go:356] "Generic (PLEG): container finished" podID="20d967e0-b2be-4599-920e-57dfc700eed3" containerID="94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f" exitCode=0 Sep 19 01:49:30.746878 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.746848 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" Sep 19 01:49:30.746878 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.746862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" event={"ID":"20d967e0-b2be-4599-920e-57dfc700eed3","Type":"ContainerDied","Data":"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f"} Sep 19 01:49:30.747417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.746928 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-wmkvf" event={"ID":"20d967e0-b2be-4599-920e-57dfc700eed3","Type":"ContainerDied","Data":"41e8cefa731918e8f1cf5d3124ae5586f1c3badc398f2f0f0e5fde16214029bc"} Sep 19 01:49:30.747417 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.746959 2568 scope.go:117] "RemoveContainer" containerID="94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f" Sep 19 01:49:30.756255 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.756235 2568 scope.go:117] "RemoveContainer" containerID="94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f" Sep 19 01:49:30.756545 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:49:30.756524 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f\": container with ID starting with 94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f not found: ID does not exist" containerID="94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f" Sep 19 01:49:30.756607 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.756558 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f"} err="failed to get container status \"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f\": rpc error: code = NotFound desc = could not find container \"94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f\": container with ID starting with 94af1da39699b360952428a390a440179d0c017718d83755f428c3634e07e14f not found: ID does not exist" Sep 19 01:49:30.772549 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.772526 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:30.779113 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:30.779093 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-wmkvf"] Sep 19 01:49:31.872512 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:31.872472 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d967e0-b2be-4599-920e-57dfc700eed3" path="/var/lib/kubelet/pods/20d967e0-b2be-4599-920e-57dfc700eed3/volumes" Sep 19 01:49:53.426374 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.426332 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c"] Sep 19 01:49:53.426998 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.426905 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d967e0-b2be-4599-920e-57dfc700eed3" containerName="manager" Sep 19 01:49:53.426998 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.426926 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d967e0-b2be-4599-920e-57dfc700eed3" containerName="manager" Sep 19 01:49:53.427121 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.427003 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d967e0-b2be-4599-920e-57dfc700eed3" containerName="manager" Sep 19 01:49:53.432914 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.432891 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.438043 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.438023 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 19 01:49:53.438910 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.438892 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jq5j5\"" Sep 19 01:49:53.439259 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.439245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 19 01:49:53.454585 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.454554 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c"] Sep 19 01:49:53.529067 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.529027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-metrics-certs\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.529067 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.529068 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2gm\" (UniqueName: \"kubernetes.io/projected/469e8e94-e262-4ca9-9ab9-970cf2271147-kube-api-access-fx2gm\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.529302 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.529112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/469e8e94-e262-4ca9-9ab9-970cf2271147-openshift-service-ca\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.529302 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.529145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-maas-api-tls\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.629504 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.629472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-maas-api-tls\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.629679 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.629628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-metrics-certs\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.629679 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.629667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2gm\" (UniqueName: \"kubernetes.io/projected/469e8e94-e262-4ca9-9ab9-970cf2271147-kube-api-access-fx2gm\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.629816 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.629711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/469e8e94-e262-4ca9-9ab9-970cf2271147-openshift-service-ca\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.630348 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.630315 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/469e8e94-e262-4ca9-9ab9-970cf2271147-openshift-service-ca\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.632011 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.631994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-maas-api-tls\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.632078 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.632047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469e8e94-e262-4ca9-9ab9-970cf2271147-metrics-certs\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.642420 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.642388 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2gm\" (UniqueName: \"kubernetes.io/projected/469e8e94-e262-4ca9-9ab9-970cf2271147-kube-api-access-fx2gm\") pod \"maas-api-59f6566bbc-48w9c\" (UID: \"469e8e94-e262-4ca9-9ab9-970cf2271147\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:53.742890 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:53.742802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:54.039878 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.039849 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c"] Sep 19 01:49:54.041982 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:49:54.041958 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469e8e94_e262_4ca9_9ab9_970cf2271147.slice/crio-e7b55f28f0b324077296252d39acd2cf517619311d484fb026fe52d82518589d WatchSource:0}: Error finding container e7b55f28f0b324077296252d39acd2cf517619311d484fb026fe52d82518589d: Status 404 returned error can't find the container with id e7b55f28f0b324077296252d39acd2cf517619311d484fb026fe52d82518589d Sep 19 01:49:54.043337 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.043319 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:49:54.330850 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.330773 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:49:54.334841 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.334822 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.335168 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.335137 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdr8h\" (UniqueName: \"kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.335288 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.335198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.338969 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.338950 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wcb9f\"" Sep 19 01:49:54.339072 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.338982 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 01:49:54.353600 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.353577 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:49:54.397842 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.397815 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:49:54.400927 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.400907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.419184 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.419159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:49:54.435967 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.435938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.436252 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.435995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdr8h\" (UniqueName: \"kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.436644 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.436626 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.445420 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.445392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdr8h\" (UniqueName: \"kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h\") pod \"payload-pre-processing-59fbc47bf8-h8x4m\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.536943 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.536914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4j5m\" (UniqueName: \"kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.537152 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.536966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.637983 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.637895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4j5m\" (UniqueName: \"kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.637983 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.637981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.638759 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.638707 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.644658 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.644634 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:54.650055 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.650029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4j5m\" (UniqueName: \"kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m\") pod \"payload-processing-5b54b7fbb7-bcgzv\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.711167 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.711110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:49:54.883488 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.883452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" event={"ID":"469e8e94-e262-4ca9-9ab9-970cf2271147","Type":"ContainerStarted","Data":"e7b55f28f0b324077296252d39acd2cf517619311d484fb026fe52d82518589d"} Sep 19 01:49:54.949038 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:54.948955 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:49:54.952101 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:49:54.952068 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca484dc2_a345_43b8_8c7f_5246e294da2e.slice/crio-f30a66539fb1ee9c599dbdc0805692a3ab1bb60cadb80f545b64f036b28f9247 WatchSource:0}: Error finding container f30a66539fb1ee9c599dbdc0805692a3ab1bb60cadb80f545b64f036b28f9247: Status 404 returned error can't find the container with id f30a66539fb1ee9c599dbdc0805692a3ab1bb60cadb80f545b64f036b28f9247 Sep 19 01:49:55.026821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.026791 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:49:55.028381 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:49:55.028348 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f094178_1c2a_4558_b57d_e053720e7ab9.slice/crio-17815354beb41dfdeabdfff280c74914c76551a7ed3073ca9b41bd8e41ef70c7 WatchSource:0}: Error finding container 17815354beb41dfdeabdfff280c74914c76551a7ed3073ca9b41bd8e41ef70c7: Status 404 returned error can't find the container with id 17815354beb41dfdeabdfff280c74914c76551a7ed3073ca9b41bd8e41ef70c7 Sep 19 01:49:55.890116 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.890016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" event={"ID":"469e8e94-e262-4ca9-9ab9-970cf2271147","Type":"ContainerStarted","Data":"61df4a814882bee4103c0adbaba6d909f3f06d1b825eed8b7a774b4ef550bacc"} Sep 19 01:49:55.890557 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.890122 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:49:55.891426 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.891401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" event={"ID":"ca484dc2-a345-43b8-8c7f-5246e294da2e","Type":"ContainerStarted","Data":"f30a66539fb1ee9c599dbdc0805692a3ab1bb60cadb80f545b64f036b28f9247"} Sep 19 01:49:55.892555 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.892534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" event={"ID":"8f094178-1c2a-4558-b57d-e053720e7ab9","Type":"ContainerStarted","Data":"17815354beb41dfdeabdfff280c74914c76551a7ed3073ca9b41bd8e41ef70c7"} Sep 19 01:49:55.909456 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:55.909404 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" podStartSLOduration=1.391904984 podStartE2EDuration="2.909388899s" totalImagesPullingTime="1.517483915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:55.906845072 +0000 UTC m=+648.565391617" watchObservedRunningTime="2026-09-19 01:49:55.909388899 +0000 UTC m=+648.567935483" Sep 19 01:49:56.899495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:56.899466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" event={"ID":"ca484dc2-a345-43b8-8c7f-5246e294da2e","Type":"ContainerStarted","Data":"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94"} Sep 19 01:49:56.899984 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:56.899570 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:49:56.901269 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:56.901233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" event={"ID":"8f094178-1c2a-4558-b57d-e053720e7ab9","Type":"ContainerStarted","Data":"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486"} Sep 19 01:49:56.916091 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:56.916050 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" podStartSLOduration=1.329009615 podStartE2EDuration="2.916037185s" totalImagesPullingTime="1.58702757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:56.915302871 +0000 UTC m=+649.573849420" watchObservedRunningTime="2026-09-19 01:49:56.916037185 +0000 UTC m=+649.574583730" Sep 19 01:49:56.933225 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:56.933175 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" podStartSLOduration=1.419728363 podStartE2EDuration="2.933160852s" totalImagesPullingTime="1.513432489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:56.932983151 +0000 UTC m=+649.591529697" watchObservedRunningTime="2026-09-19 01:49:56.933160852 +0000 UTC m=+649.591707400" Sep 19 01:49:57.906293 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:49:57.906261 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:50:01.907229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:01.907199 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-48w9c" Sep 19 01:50:07.908701 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:07.908665 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:50:08.912784 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:08.912729 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:50:37.119390 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.119361 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv"] Sep 19 01:50:37.122986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.122967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.126381 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.126358 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xrctz\"" Sep 19 01:50:37.126381 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.126374 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 01:50:37.126622 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.126431 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 01:50:37.126622 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.126433 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 19 01:50:37.137824 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.137804 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv"] Sep 19 01:50:37.256618 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.256866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvvh\" (UniqueName: \"kubernetes.io/projected/21d5c05d-933c-4937-af0c-67b458279ffd-kube-api-access-ckvvh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.256866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d5c05d-933c-4937-af0c-67b458279ffd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.256866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.256866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.256866 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.256858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357521 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357703 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvvh\" (UniqueName: \"kubernetes.io/projected/21d5c05d-933c-4937-af0c-67b458279ffd-kube-api-access-ckvvh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357703 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d5c05d-933c-4937-af0c-67b458279ffd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357703 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357703 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357703 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357991 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357915 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.357991 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.357976 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.358093 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.358076 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.359996 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.359973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21d5c05d-933c-4937-af0c-67b458279ffd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.360157 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.360140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d5c05d-933c-4937-af0c-67b458279ffd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.365643 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.365621 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvvh\" (UniqueName: \"kubernetes.io/projected/21d5c05d-933c-4937-af0c-67b458279ffd-kube-api-access-ckvvh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d4gcv\" (UID: \"21d5c05d-933c-4937-af0c-67b458279ffd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.433212 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.433185 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:37.709386 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:37.709361 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv"] Sep 19 01:50:37.711832 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:50:37.711803 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d5c05d_933c_4937_af0c_67b458279ffd.slice/crio-595884b5a27a194e6ee6991af2d05503937542dac6e14373a638e535ec5613ff WatchSource:0}: Error finding container 595884b5a27a194e6ee6991af2d05503937542dac6e14373a638e535ec5613ff: Status 404 returned error can't find the container with id 595884b5a27a194e6ee6991af2d05503937542dac6e14373a638e535ec5613ff Sep 19 01:50:38.117876 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:38.117767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" event={"ID":"21d5c05d-933c-4937-af0c-67b458279ffd","Type":"ContainerStarted","Data":"595884b5a27a194e6ee6991af2d05503937542dac6e14373a638e535ec5613ff"} Sep 19 01:50:39.124651 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:39.124558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" event={"ID":"21d5c05d-933c-4937-af0c-67b458279ffd","Type":"ContainerStarted","Data":"dfb3f69baf7e1cf7c043d8cd375d41a85eea0f50f1edacd152157f307ca71355"} Sep 19 01:50:39.152428 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:39.152370 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" podStartSLOduration=1.165777287 podStartE2EDuration="2.152354076s" totalImagesPullingTime="986.576789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:50:39.149246271 +0000 UTC m=+691.807792816" watchObservedRunningTime="2026-09-19 01:50:39.152354076 +0000 UTC m=+691.810900676" Sep 19 01:50:47.434122 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:47.434085 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:47.434509 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:47.434147 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:47.446871 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:47.446843 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:50:48.182014 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:50:48.181984 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d4gcv" Sep 19 01:53:28.462489 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.462452 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b66d67b78-r967v"] Sep 19 01:53:28.465818 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.465794 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.468728 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.468708 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 19 01:53:28.469430 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.469410 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jf5fs\"" Sep 19 01:53:28.486450 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.486419 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b66d67b78-r967v"] Sep 19 01:53:28.490614 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.490584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh928\" (UniqueName: \"kubernetes.io/projected/be181b69-a674-4e13-a0b2-5dc2e170b9e5-kube-api-access-fh928\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.490773 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.490678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be181b69-a674-4e13-a0b2-5dc2e170b9e5-tls-cert\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.591455 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.591415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be181b69-a674-4e13-a0b2-5dc2e170b9e5-tls-cert\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.591632 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.591482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh928\" (UniqueName: \"kubernetes.io/projected/be181b69-a674-4e13-a0b2-5dc2e170b9e5-kube-api-access-fh928\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.594018 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.593995 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be181b69-a674-4e13-a0b2-5dc2e170b9e5-tls-cert\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.602933 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.602913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh928\" (UniqueName: \"kubernetes.io/projected/be181b69-a674-4e13-a0b2-5dc2e170b9e5-kube-api-access-fh928\") pod \"authorino-5b66d67b78-r967v\" (UID: \"be181b69-a674-4e13-a0b2-5dc2e170b9e5\") " pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:28.775314 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:28.775212 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b66d67b78-r967v" Sep 19 01:53:29.053128 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:29.053095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b66d67b78-r967v"] Sep 19 01:53:29.054489 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:53:29.054460 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe181b69_a674_4e13_a0b2_5dc2e170b9e5.slice/crio-de25ed2c9e80aa25cc1d89534f89e29e481c0b5c8695a05cd83c5ad25ee6ac02 WatchSource:0}: Error finding container de25ed2c9e80aa25cc1d89534f89e29e481c0b5c8695a05cd83c5ad25ee6ac02: Status 404 returned error can't find the container with id de25ed2c9e80aa25cc1d89534f89e29e481c0b5c8695a05cd83c5ad25ee6ac02 Sep 19 01:53:30.024549 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:30.024508 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b66d67b78-r967v" event={"ID":"be181b69-a674-4e13-a0b2-5dc2e170b9e5","Type":"ContainerStarted","Data":"4fc5b8ddf3d5c97d298b776f740b75446e6a7ecd83fc69a78d7104bf2d6938e5"} Sep 19 01:53:30.024942 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:30.024563 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b66d67b78-r967v" event={"ID":"be181b69-a674-4e13-a0b2-5dc2e170b9e5","Type":"ContainerStarted","Data":"de25ed2c9e80aa25cc1d89534f89e29e481c0b5c8695a05cd83c5ad25ee6ac02"} Sep 19 01:53:30.049632 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:30.049549 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b66d67b78-r967v" podStartSLOduration=1.463666426 podStartE2EDuration="2.049532493s" totalImagesPullingTime="585.866067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:53:30.048928115 +0000 UTC m=+862.707474660" watchObservedRunningTime="2026-09-19 01:53:30.049532493 +0000 UTC m=+862.708079038" Sep 19 01:53:44.727724 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.727687 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-784c4dcb44-h2kl9"] Sep 19 01:53:44.731112 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.731095 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:44.733513 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.733485 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 19 01:53:44.733994 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.733977 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-2mrnp\"" Sep 19 01:53:44.742769 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.742735 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-784c4dcb44-h2kl9"] Sep 19 01:53:44.839074 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.839046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwlpg\" (UniqueName: \"kubernetes.io/projected/d009923d-2e41-4f08-9058-76a01336f43d-kube-api-access-wwlpg\") pod \"ai-gateway-controller-784c4dcb44-h2kl9\" (UID: \"d009923d-2e41-4f08-9058-76a01336f43d\") " pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:44.939966 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.939929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwlpg\" (UniqueName: \"kubernetes.io/projected/d009923d-2e41-4f08-9058-76a01336f43d-kube-api-access-wwlpg\") pod \"ai-gateway-controller-784c4dcb44-h2kl9\" (UID: \"d009923d-2e41-4f08-9058-76a01336f43d\") " pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:44.948840 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:44.948810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwlpg\" (UniqueName: \"kubernetes.io/projected/d009923d-2e41-4f08-9058-76a01336f43d-kube-api-access-wwlpg\") pod \"ai-gateway-controller-784c4dcb44-h2kl9\" (UID: \"d009923d-2e41-4f08-9058-76a01336f43d\") " pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:45.041090 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:45.041006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:45.313906 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:45.313882 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-784c4dcb44-h2kl9"] Sep 19 01:53:45.315544 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:53:45.315515 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd009923d_2e41_4f08_9058_76a01336f43d.slice/crio-2580c01d41663f5c339432cafbe2d5227b205cbfa37d59e9d4f36e5e5ceff00a WatchSource:0}: Error finding container 2580c01d41663f5c339432cafbe2d5227b205cbfa37d59e9d4f36e5e5ceff00a: Status 404 returned error can't find the container with id 2580c01d41663f5c339432cafbe2d5227b205cbfa37d59e9d4f36e5e5ceff00a Sep 19 01:53:46.117157 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:46.117115 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" event={"ID":"d009923d-2e41-4f08-9058-76a01336f43d","Type":"ContainerStarted","Data":"2580c01d41663f5c339432cafbe2d5227b205cbfa37d59e9d4f36e5e5ceff00a"} Sep 19 01:53:47.123705 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:47.123671 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" event={"ID":"d009923d-2e41-4f08-9058-76a01336f43d","Type":"ContainerStarted","Data":"216507ba2b0fabeb1444e560bce6d8cf1a53a831545dc8bb7582f2de03137cfa"} Sep 19 01:53:47.124131 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:47.123804 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:47.146821 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:47.146779 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" podStartSLOduration=2.060159682 podStartE2EDuration="3.146764287s" totalImagesPullingTime="1.086604605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:53:47.144130098 +0000 UTC m=+879.802676642" watchObservedRunningTime="2026-09-19 01:53:47.146764287 +0000 UTC m=+879.805310826" Sep 19 01:53:58.131671 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:58.131640 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-784c4dcb44-h2kl9" Sep 19 01:53:58.708216 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:58.708180 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:53:58.708423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:58.708396 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerName="payload-processing" containerID="cri-o://026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486" gracePeriod=30 Sep 19 01:53:58.736336 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:58.736311 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:53:58.736531 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:58.736510 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" podUID="ca484dc2-a345-43b8-8c7f-5246e294da2e" containerName="payload-pre-processing" containerID="cri-o://0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94" gracePeriod=30 Sep 19 01:53:59.010127 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.010101 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:53:59.012928 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.012909 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:53:59.165560 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165521 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume\") pod \"8f094178-1c2a-4558-b57d-e053720e7ab9\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " Sep 19 01:53:59.165999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165573 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdr8h\" (UniqueName: \"kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h\") pod \"ca484dc2-a345-43b8-8c7f-5246e294da2e\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " Sep 19 01:53:59.165999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165592 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume\") pod \"ca484dc2-a345-43b8-8c7f-5246e294da2e\" (UID: \"ca484dc2-a345-43b8-8c7f-5246e294da2e\") " Sep 19 01:53:59.165999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165661 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4j5m\" (UniqueName: \"kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m\") pod \"8f094178-1c2a-4558-b57d-e053720e7ab9\" (UID: \"8f094178-1c2a-4558-b57d-e053720e7ab9\") " Sep 19 01:53:59.165999 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165973 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f094178-1c2a-4558-b57d-e053720e7ab9" (UID: "8f094178-1c2a-4558-b57d-e053720e7ab9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:53:59.166137 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.165998 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca484dc2-a345-43b8-8c7f-5246e294da2e" (UID: "ca484dc2-a345-43b8-8c7f-5246e294da2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:53:59.167711 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.167687 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m" (OuterVolumeSpecName: "kube-api-access-c4j5m") pod "8f094178-1c2a-4558-b57d-e053720e7ab9" (UID: "8f094178-1c2a-4558-b57d-e053720e7ab9"). InnerVolumeSpecName "kube-api-access-c4j5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:53:59.167808 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.167722 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h" (OuterVolumeSpecName: "kube-api-access-pdr8h") pod "ca484dc2-a345-43b8-8c7f-5246e294da2e" (UID: "ca484dc2-a345-43b8-8c7f-5246e294da2e"). InnerVolumeSpecName "kube-api-access-pdr8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:53:59.188023 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.187987 2568 generic.go:356] "Generic (PLEG): container finished" podID="ca484dc2-a345-43b8-8c7f-5246e294da2e" containerID="0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94" exitCode=0 Sep 19 01:53:59.188183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.188040 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" Sep 19 01:53:59.188183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.188077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" event={"ID":"ca484dc2-a345-43b8-8c7f-5246e294da2e","Type":"ContainerDied","Data":"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94"} Sep 19 01:53:59.188183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.188137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m" event={"ID":"ca484dc2-a345-43b8-8c7f-5246e294da2e","Type":"ContainerDied","Data":"f30a66539fb1ee9c599dbdc0805692a3ab1bb60cadb80f545b64f036b28f9247"} Sep 19 01:53:59.188183 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.188165 2568 scope.go:117] "RemoveContainer" containerID="0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94" Sep 19 01:53:59.191104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.189936 2568 generic.go:356] "Generic (PLEG): container finished" podID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerID="026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486" exitCode=0 Sep 19 01:53:59.191104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.190048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" event={"ID":"8f094178-1c2a-4558-b57d-e053720e7ab9","Type":"ContainerDied","Data":"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486"} Sep 19 01:53:59.191104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.190138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" event={"ID":"8f094178-1c2a-4558-b57d-e053720e7ab9","Type":"ContainerDied","Data":"17815354beb41dfdeabdfff280c74914c76551a7ed3073ca9b41bd8e41ef70c7"} Sep 19 01:53:59.191104 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.190231 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" Sep 19 01:53:59.204499 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.204480 2568 scope.go:117] "RemoveContainer" containerID="0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94" Sep 19 01:53:59.204801 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:53:59.204781 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94\": container with ID starting with 0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94 not found: ID does not exist" containerID="0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94" Sep 19 01:53:59.204861 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.204806 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94"} err="failed to get container status \"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94\": rpc error: code = NotFound desc = could not find container \"0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94\": container with ID starting with 0b3030d6731606d0fe143d4a6b5b9091d3c5c2e8187e9cb4c9aee219ecf67d94 not found: ID does not exist" Sep 19 01:53:59.204861 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.204823 2568 scope.go:117] "RemoveContainer" containerID="026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486" Sep 19 01:53:59.212906 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.212862 2568 scope.go:117] "RemoveContainer" containerID="026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486" Sep 19 01:53:59.213165 ip-10-0-137-224 kubenswrapper[2568]: E0919 01:53:59.213144 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486\": container with ID starting with 026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486 not found: ID does not exist" containerID="026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486" Sep 19 01:53:59.213217 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.213172 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486"} err="failed to get container status \"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486\": rpc error: code = NotFound desc = could not find container \"026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486\": container with ID starting with 026938ed9545744e0d2f07cd353338c0d34cde35e73416ce24604596c6d1c486 not found: ID does not exist" Sep 19 01:53:59.240935 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.240898 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:53:59.247082 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.247017 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-h8x4m"] Sep 19 01:53:59.266431 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.266402 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4j5m\" (UniqueName: \"kubernetes.io/projected/8f094178-1c2a-4558-b57d-e053720e7ab9-kube-api-access-c4j5m\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:53:59.266431 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.266426 2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f094178-1c2a-4558-b57d-e053720e7ab9-plugins-config-volume\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:53:59.266431 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.266437 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdr8h\" (UniqueName: \"kubernetes.io/projected/ca484dc2-a345-43b8-8c7f-5246e294da2e-kube-api-access-pdr8h\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:53:59.266709 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.266446 2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca484dc2-a345-43b8-8c7f-5246e294da2e-plugins-config-volume\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Sep 19 01:53:59.275191 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.275165 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:53:59.285154 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.285127 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bcgzv"] Sep 19 01:53:59.798986 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.798955 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp"] Sep 19 01:53:59.799311 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799299 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerName="payload-processing" Sep 19 01:53:59.799359 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799312 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerName="payload-processing" Sep 19 01:53:59.799359 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799323 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca484dc2-a345-43b8-8c7f-5246e294da2e" containerName="payload-pre-processing" Sep 19 01:53:59.799359 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799329 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca484dc2-a345-43b8-8c7f-5246e294da2e" containerName="payload-pre-processing" Sep 19 01:53:59.799452 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799417 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca484dc2-a345-43b8-8c7f-5246e294da2e" containerName="payload-pre-processing" Sep 19 01:53:59.799452 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.799425 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerName="payload-processing" Sep 19 01:53:59.803833 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.803812 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:53:59.814731 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.814711 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 01:53:59.837666 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.837640 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp"] Sep 19 01:53:59.873146 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.873115 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" path="/var/lib/kubelet/pods/8f094178-1c2a-4558-b57d-e053720e7ab9/volumes" Sep 19 01:53:59.873482 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.873466 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca484dc2-a345-43b8-8c7f-5246e294da2e" path="/var/lib/kubelet/pods/ca484dc2-a345-43b8-8c7f-5246e294da2e/volumes" Sep 19 01:53:59.912211 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.912172 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-5b54b7fbb7-bcgzv" podUID="8f094178-1c2a-4558-b57d-e053720e7ab9" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.47:9004: i/o timeout" Sep 19 01:53:59.931092 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.931061 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xfnwb"] Sep 19 01:53:59.934763 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.934734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:53:59.938018 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.937997 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vkvtx\"" Sep 19 01:53:59.949849 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.949827 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xfnwb"] Sep 19 01:53:59.971790 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.971738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981a607a-a470-48d8-9e98-ec3427fc4ed7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:53:59.971976 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.971892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bn26\" (UniqueName: \"kubernetes.io/projected/981a607a-a470-48d8-9e98-ec3427fc4ed7-kube-api-access-6bn26\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:53:59.981146 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:53:59.981122 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b66d67b78-r967v_be181b69-a674-4e13-a0b2-5dc2e170b9e5/authorino/0.log" Sep 19 01:54:00.073132 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.073037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981a607a-a470-48d8-9e98-ec3427fc4ed7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:00.073132 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.073085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5885ce-cb63-4097-82c6-c4a3116b0548-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.073132 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.073114 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92v2\" (UniqueName: \"kubernetes.io/projected/4b5885ce-cb63-4097-82c6-c4a3116b0548-kube-api-access-k92v2\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.073383 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.073233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bn26\" (UniqueName: \"kubernetes.io/projected/981a607a-a470-48d8-9e98-ec3427fc4ed7-kube-api-access-6bn26\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:00.073731 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.073712 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981a607a-a470-48d8-9e98-ec3427fc4ed7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:00.082200 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.082170 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bn26\" (UniqueName: \"kubernetes.io/projected/981a607a-a470-48d8-9e98-ec3427fc4ed7-kube-api-access-6bn26\") pod \"payload-pre-processing-59fbc47bf8-nkxlp\" (UID: \"981a607a-a470-48d8-9e98-ec3427fc4ed7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:00.114085 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.114009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:00.174393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.174311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5885ce-cb63-4097-82c6-c4a3116b0548-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.174393 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.174347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92v2\" (UniqueName: \"kubernetes.io/projected/4b5885ce-cb63-4097-82c6-c4a3116b0548-kube-api-access-k92v2\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.175358 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.175330 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5885ce-cb63-4097-82c6-c4a3116b0548-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.183256 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.183228 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92v2\" (UniqueName: \"kubernetes.io/projected/4b5885ce-cb63-4097-82c6-c4a3116b0548-kube-api-access-k92v2\") pod \"payload-processing-5b54b7fbb7-xfnwb\" (UID: \"4b5885ce-cb63-4097-82c6-c4a3116b0548\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.244820 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.244781 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:00.391129 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.391099 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp"] Sep 19 01:54:00.392965 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:54:00.392934 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981a607a_a470_48d8_9e98_ec3427fc4ed7.slice/crio-f58c5c981d0668d7ad8f42579180495af787ee70b8d0c32391d5fa74b0f3eb7f WatchSource:0}: Error finding container f58c5c981d0668d7ad8f42579180495af787ee70b8d0c32391d5fa74b0f3eb7f: Status 404 returned error can't find the container with id f58c5c981d0668d7ad8f42579180495af787ee70b8d0c32391d5fa74b0f3eb7f Sep 19 01:54:00.519096 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:00.519068 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xfnwb"] Sep 19 01:54:00.520696 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:54:00.520660 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5885ce_cb63_4097_82c6_c4a3116b0548.slice/crio-d679750df566a781d7c7c591c44c43256ece5966e41132c69f38fbccb55dc3ce WatchSource:0}: Error finding container d679750df566a781d7c7c591c44c43256ece5966e41132c69f38fbccb55dc3ce: Status 404 returned error can't find the container with id d679750df566a781d7c7c591c44c43256ece5966e41132c69f38fbccb55dc3ce Sep 19 01:54:01.205916 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.205876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" event={"ID":"4b5885ce-cb63-4097-82c6-c4a3116b0548","Type":"ContainerStarted","Data":"1f51fdd1b10c2fbe13571fbce1da98fbd5ad00af0b50f4929f48866f17043fab"} Sep 19 01:54:01.206386 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.205939 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" event={"ID":"4b5885ce-cb63-4097-82c6-c4a3116b0548","Type":"ContainerStarted","Data":"d679750df566a781d7c7c591c44c43256ece5966e41132c69f38fbccb55dc3ce"} Sep 19 01:54:01.206386 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.205968 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:01.207533 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.207512 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" event={"ID":"981a607a-a470-48d8-9e98-ec3427fc4ed7","Type":"ContainerStarted","Data":"adf31ae63c4071d179b1891b23a7a0ecb515194a15090eceea721c88ceacc099"} Sep 19 01:54:01.207615 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.207552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" event={"ID":"981a607a-a470-48d8-9e98-ec3427fc4ed7","Type":"ContainerStarted","Data":"f58c5c981d0668d7ad8f42579180495af787ee70b8d0c32391d5fa74b0f3eb7f"} Sep 19 01:54:01.207615 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.207578 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:01.224354 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.224308 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" podStartSLOduration=2.224291125 podStartE2EDuration="2.224291125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:01.222180351 +0000 UTC m=+893.880726895" watchObservedRunningTime="2026-09-19 01:54:01.224291125 +0000 UTC m=+893.882837674" Sep 19 01:54:01.239695 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:01.239645 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" podStartSLOduration=2.239631094 podStartE2EDuration="2.239631094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:01.23773673 +0000 UTC m=+893.896283277" watchObservedRunningTime="2026-09-19 01:54:01.239631094 +0000 UTC m=+893.898177639" Sep 19 01:54:05.827495 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:05.827456 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-784c4dcb44-h2kl9_d009923d-2e41-4f08-9058-76a01336f43d/manager/0.log" Sep 19 01:54:05.944758 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:05.944719 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7bjzr_277b1b5f-c31f-495c-af24-96baca837c31/manager/0.log" Sep 19 01:54:06.076013 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.075984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6bxk7_aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f/manager/0.log" Sep 19 01:54:06.204998 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.204966 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59d5465bb6-j7899_3d3ee614-3dbc-4e89-870f-1d0a4ff7942b/manager/0.log" Sep 19 01:54:06.311326 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.311300 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nzwpb_6e555694-01ac-403f-a8b8-b593df6642ef/server/0.log" Sep 19 01:54:06.434238 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.434205 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9t4tm_2c781f6a-19a5-4ff4-af7e-99a2b2bc112d/manager/0.log" Sep 19 01:54:06.546404 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.546320 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-pqg5z_774cc4d4-f8e0-4062-bfe0-74d186385fc9/copy-manifests/0.log" Sep 19 01:54:06.552533 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:06.552512 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-pqg5z_774cc4d4-f8e0-4062-bfe0-74d186385fc9/manager/0.log" Sep 19 01:54:07.170337 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:07.170305 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59f6566bbc-48w9c_469e8e94-e262-4ca9-9ab9-970cf2271147/maas-api/0.log" Sep 19 01:54:07.272407 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:07.272375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8w8f4_0f5506d4-917c-4d47-a8da-7e46e1606e5a/postgres/0.log" Sep 19 01:54:08.082819 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:08.082787 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b66d67b78-r967v_be181b69-a674-4e13-a0b2-5dc2e170b9e5/authorino/0.log" Sep 19 01:54:08.193632 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:08.193605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-mjcp4_088fd9af-68ee-4c26-9b21-97e55d24626a/manager/0.log" Sep 19 01:54:08.298030 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:08.298000 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wh2gs_9fcb7467-22d4-41f6-beaa-6b58612db1f4/manager/0.log" Sep 19 01:54:08.529051 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:08.528973 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dfczq_eab5b19d-8c9e-41b1-b65b-84ac8972d4b4/manager/0.log" Sep 19 01:54:08.749448 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:08.749414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qf2gk_a9b633c3-96e1-4195-988a-4642de3f3fc4/manager/0.log" Sep 19 01:54:09.420137 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:09.420101 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-4s44k_80890caa-57e9-4fd5-93cd-56027d47130c/kube-auth-proxy/0.log" Sep 19 01:54:09.648115 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:09.648085 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nkxlp_981a607a-a470-48d8-9e98-ec3427fc4ed7/payload-pre-processing/0.log" Sep 19 01:54:09.762421 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:09.762328 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xfnwb_4b5885ce-cb63-4097-82c6-c4a3116b0548/payload-processing/0.log" Sep 19 01:54:10.347234 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:10.347198 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d4gcv_21d5c05d-933c-4937-af0c-67b458279ffd/main/0.log" Sep 19 01:54:12.216211 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:12.216178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xfnwb" Sep 19 01:54:12.216593 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:12.216370 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nkxlp" Sep 19 01:54:14.923150 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:14.923118 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9pvs7_8754f9ed-a37f-47ae-8fee-3b4724488700/global-pull-secret-syncer/0.log" Sep 19 01:54:15.068430 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:15.068400 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n6vgf_fe9dfbaf-0aff-4883-b719-470e07409f83/konnectivity-agent/0.log" Sep 19 01:54:15.165415 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:15.165386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-224.ec2.internal_88ce1435fe9a8f35b60fb0b4eb4027b3/haproxy/0.log" Sep 19 01:54:20.083410 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:20.083380 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b66d67b78-r967v_be181b69-a674-4e13-a0b2-5dc2e170b9e5/authorino/0.log" Sep 19 01:54:20.167753 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:20.167716 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-mjcp4_088fd9af-68ee-4c26-9b21-97e55d24626a/manager/0.log" Sep 19 01:54:20.197384 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:20.197356 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wh2gs_9fcb7467-22d4-41f6-beaa-6b58612db1f4/manager/0.log" Sep 19 01:54:20.278182 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:20.278146 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dfczq_eab5b19d-8c9e-41b1-b65b-84ac8972d4b4/manager/0.log" Sep 19 01:54:20.342638 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:20.342556 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qf2gk_a9b633c3-96e1-4195-988a-4642de3f3fc4/manager/0.log" Sep 19 01:54:22.449481 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:22.449425 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-fqp7q_826f1b10-d8ff-454c-83b7-80f905128397/monitoring-plugin/0.log" Sep 19 01:54:22.691621 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:22.691594 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxkjs_1bb73331-1294-41c9-9f72-3b6f1b17d5c8/node-exporter/0.log" Sep 19 01:54:22.717544 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:22.717480 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxkjs_1bb73331-1294-41c9-9f72-3b6f1b17d5c8/kube-rbac-proxy/0.log" Sep 19 01:54:22.743107 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:22.743085 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxkjs_1bb73331-1294-41c9-9f72-3b6f1b17d5c8/init-textfile/0.log" Sep 19 01:54:24.681112 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.681073 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b"] Sep 19 01:54:24.686276 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.686255 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.688973 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.688950 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"openshift-service-ca.crt\"" Sep 19 01:54:24.689728 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.689711 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26pck\"/\"default-dockercfg-59ng7\"" Sep 19 01:54:24.689948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.689935 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"kube-root-ca.crt\"" Sep 19 01:54:24.694088 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.694068 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b"] Sep 19 01:54:24.769789 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.769723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-sys\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.769789 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.769797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwcr6\" (UniqueName: \"kubernetes.io/projected/15273650-3178-4fa0-a931-7a0fe7439a91-kube-api-access-kwcr6\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.770047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.769879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-podres\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.770047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.769902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-proc\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.770047 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.769937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-lib-modules\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871035 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-podres\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871035 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-proc\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-lib-modules\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-sys\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwcr6\" (UniqueName: \"kubernetes.io/projected/15273650-3178-4fa0-a931-7a0fe7439a91-kube-api-access-kwcr6\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871136 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-proc\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-podres\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871229 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871208 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-sys\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.871423 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.871235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15273650-3178-4fa0-a931-7a0fe7439a91-lib-modules\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.879948 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.879927 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwcr6\" (UniqueName: \"kubernetes.io/projected/15273650-3178-4fa0-a931-7a0fe7439a91-kube-api-access-kwcr6\") pod \"perf-node-gather-daemonset-b6n8b\" (UID: \"15273650-3178-4fa0-a931-7a0fe7439a91\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:24.996653 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:24.996576 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:25.276797 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:25.276772 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b"] Sep 19 01:54:25.279173 ip-10-0-137-224 kubenswrapper[2568]: W0919 01:54:25.279141 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15273650_3178_4fa0_a931_7a0fe7439a91.slice/crio-29c6c20926b76644738a658ee6ee6911cefd8df402b1278616cdb4f5f7f84960 WatchSource:0}: Error finding container 29c6c20926b76644738a658ee6ee6911cefd8df402b1278616cdb4f5f7f84960: Status 404 returned error can't find the container with id 29c6c20926b76644738a658ee6ee6911cefd8df402b1278616cdb4f5f7f84960 Sep 19 01:54:25.340409 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:25.340381 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" event={"ID":"15273650-3178-4fa0-a931-7a0fe7439a91","Type":"ContainerStarted","Data":"29c6c20926b76644738a658ee6ee6911cefd8df402b1278616cdb4f5f7f84960"} Sep 19 01:54:26.347776 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:26.347722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" event={"ID":"15273650-3178-4fa0-a931-7a0fe7439a91","Type":"ContainerStarted","Data":"40a55cd4b3049492cfbecbb8a092a0b43c2f66517780bf2bd7720bf1ea50ea07"} Sep 19 01:54:26.348234 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:26.347819 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:26.365757 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:26.365655 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" podStartSLOduration=2.365642838 podStartE2EDuration="2.365642838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:26.364203284 +0000 UTC m=+919.022749830" watchObservedRunningTime="2026-09-19 01:54:26.365642838 +0000 UTC m=+919.024189382" Sep 19 01:54:27.506413 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:27.506382 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rsdtw_3d5ae99a-4069-43d9-94fe-9cc85200ee3b/dns/0.log" Sep 19 01:54:27.560693 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:27.560667 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rsdtw_3d5ae99a-4069-43d9-94fe-9cc85200ee3b/kube-rbac-proxy/0.log" Sep 19 01:54:27.812928 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:27.812852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbb2w_ff4a4af0-5c0d-4a72-85ef-2e34118c0b0f/dns-node-resolver/0.log" Sep 19 01:54:28.402024 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:28.401998 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6stw_68129407-7656-423e-8380-71c6ba7d6484/node-ca/0.log" Sep 19 01:54:29.535439 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:29.535405 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-4s44k_80890caa-57e9-4fd5-93cd-56027d47130c/kube-auth-proxy/0.log" Sep 19 01:54:29.589386 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:29.589342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nkxlp_981a607a-a470-48d8-9e98-ec3427fc4ed7/payload-pre-processing/0.log" Sep 19 01:54:29.615664 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:29.615637 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xfnwb_4b5885ce-cb63-4097-82c6-c4a3116b0548/payload-processing/0.log" Sep 19 01:54:30.301129 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:30.301070 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqn4n_88ece72f-fa62-4e0c-af9f-314535fed31c/serve-healthcheck-canary/0.log" Sep 19 01:54:30.870468 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:30.870431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-8p9m8_a5eb925e-f985-46e6-9d54-c26fa265e35c/insights-operator/0.log" Sep 19 01:54:30.871026 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:30.871001 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-8p9m8_a5eb925e-f985-46e6-9d54-c26fa265e35c/insights-operator/1.log" Sep 19 01:54:30.989966 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:30.989930 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdbl_66d8c6ae-3f2c-46f4-b077-8f37a851ee26/kube-rbac-proxy/0.log" Sep 19 01:54:31.015294 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:31.015270 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdbl_66d8c6ae-3f2c-46f4-b077-8f37a851ee26/exporter/0.log" Sep 19 01:54:31.048660 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:31.048636 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdbl_66d8c6ae-3f2c-46f4-b077-8f37a851ee26/extractor/0.log" Sep 19 01:54:32.362472 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:32.362445 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-b6n8b" Sep 19 01:54:33.383928 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.383898 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-784c4dcb44-h2kl9_d009923d-2e41-4f08-9058-76a01336f43d/manager/0.log" Sep 19 01:54:33.416259 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.416222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7bjzr_277b1b5f-c31f-495c-af24-96baca837c31/manager/0.log" Sep 19 01:54:33.461783 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.461721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6bxk7_aa93fbb3-1f50-4c71-8bf3-5efad8fbc39f/manager/0.log" Sep 19 01:54:33.504212 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.504182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59d5465bb6-j7899_3d3ee614-3dbc-4e89-870f-1d0a4ff7942b/manager/0.log" Sep 19 01:54:33.527317 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.527289 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nzwpb_6e555694-01ac-403f-a8b8-b593df6642ef/server/0.log" Sep 19 01:54:33.600451 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.600370 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9t4tm_2c781f6a-19a5-4ff4-af7e-99a2b2bc112d/manager/0.log" Sep 19 01:54:33.628933 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.628910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-pqg5z_774cc4d4-f8e0-4062-bfe0-74d186385fc9/manager/0.log" Sep 19 01:54:33.652993 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:33.652970 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-pqg5z_774cc4d4-f8e0-4062-bfe0-74d186385fc9/copy-manifests/0.log" Sep 19 01:54:35.233093 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:35.233049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9trrj_e660a85e-cdc1-47af-937f-87f6690a9400/openshift-lws-operator/0.log" Sep 19 01:54:35.771297 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:35.771268 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-4s44k_80890caa-57e9-4fd5-93cd-56027d47130c/kube-auth-proxy/0.log" Sep 19 01:54:35.809862 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:35.809823 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nkxlp_981a607a-a470-48d8-9e98-ec3427fc4ed7/payload-pre-processing/0.log" Sep 19 01:54:35.827340 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:35.827309 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xfnwb_4b5885ce-cb63-4097-82c6-c4a3116b0548/payload-processing/0.log" Sep 19 01:54:37.035568 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:37.035536 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-4s44k_80890caa-57e9-4fd5-93cd-56027d47130c/kube-auth-proxy/0.log" Sep 19 01:54:37.068857 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:37.068824 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nkxlp_981a607a-a470-48d8-9e98-ec3427fc4ed7/payload-pre-processing/0.log" Sep 19 01:54:37.088162 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:37.088133 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xfnwb_4b5885ce-cb63-4097-82c6-c4a3116b0548/payload-processing/0.log" Sep 19 01:54:41.832117 ip-10-0-137-224 kubenswrapper[2568]: I0919 01:54:41.832083 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5wsq6_d93945fa-9288-42d1-8faa-659efc846315/kube-multus/0.log"