Sep 18 14:50:52.638166 ip-10-0-133-129 systemd[1]: Starting Kubernetes Kubelet... Sep 18 14:50:55.975864 ip-10-0-133-129 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:55.975864 ip-10-0-133-129 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 14:50:55.975864 ip-10-0-133-129 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:55.975864 ip-10-0-133-129 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 14:50:55.975864 ip-10-0-133-129 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 14:50:55.976790 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.975946 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 14:50:55.979512 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979490 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.979512 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979507 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:55.979512 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979512 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.979512 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979516 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:55.979512 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979520 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979526 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979530 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979534 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979537 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979543 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979548 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979552 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979556 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979559 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979571 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979575 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979579 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979583 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979587 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979591 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979595 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979598 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979603 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979607 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:55.979806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979611 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979615 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979619 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979623 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979626 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979633 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979638 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979643 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979647 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979652 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979657 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979661 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979665 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979669 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979675 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979679 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979683 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979688 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979692 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:55.980640 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979699 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979705 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979709 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979713 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979719 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979724 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979728 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979733 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979738 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979742 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979747 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979751 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979756 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979760 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979764 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979769 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979773 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979778 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979782 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979786 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:55.981522 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979790 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979794 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979798 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979802 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979806 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979810 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979816 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979821 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979826 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979829 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979834 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979838 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979859 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979863 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979868 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979872 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979876 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979881 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979885 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:55.982398 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979889 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979895 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979899 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979903 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979908 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979912 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979916 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979922 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979926 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979930 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979934 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979938 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979943 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979947 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979952 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979957 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.979961 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981095 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981106 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981110 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:55.983226 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981115 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981120 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981125 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981129 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981133 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981138 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981142 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981147 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981151 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981155 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981159 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981165 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981173 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981179 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981184 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981189 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981194 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981200 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981204 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:55.984118 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981209 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981216 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981221 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981226 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981230 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981237 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981242 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981246 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981251 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981255 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981260 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981265 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981269 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981273 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981277 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981281 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981285 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981289 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981293 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:55.984901 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981298 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981304 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981309 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981313 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981317 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981321 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981326 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981332 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981336 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981341 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981345 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981350 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981354 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981358 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981363 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981367 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981371 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981375 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981380 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981385 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.985435 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981389 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981393 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981397 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981401 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981408 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981413 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981418 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981422 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981426 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981430 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981434 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981438 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981442 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981447 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981451 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981456 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981460 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981464 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981468 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981473 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:55.985999 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981477 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981481 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981486 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981491 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981496 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981500 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981504 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981508 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981513 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981517 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981521 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981525 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981529 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981532 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981537 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981541 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981546 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.981551 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982145 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982153 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:55.986658 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982159 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982163 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982167 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982172 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982176 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982181 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982186 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982190 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982195 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982199 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982204 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982209 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982214 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982218 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982222 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982227 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982231 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982235 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982239 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:55.987173 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982244 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982249 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982253 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982257 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982262 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982266 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982270 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982274 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982278 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982285 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982289 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982294 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982298 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982302 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982306 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982310 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982314 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982318 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982323 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:55.987728 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982328 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982332 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982336 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982340 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982344 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982348 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982353 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982357 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982361 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982366 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982370 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982374 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982378 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982382 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982386 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982391 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982395 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982399 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982403 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982406 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:55.988214 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982410 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982414 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982421 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982427 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982432 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982437 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982442 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982448 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982452 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982456 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982460 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982467 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982471 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982475 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982479 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982483 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982487 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982492 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982497 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:55.988687 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982503 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982507 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982511 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982515 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982519 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982523 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982528 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982532 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982536 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982540 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982544 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982551 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982557 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982561 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982566 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982571 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982575 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982579 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982584 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.982587 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:55.989168 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982695 2548 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982749 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982758 2548 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982764 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982773 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982778 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982784 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982790 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982795 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982800 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982806 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982811 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982817 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982823 2548 flags.go:64] FLAG: --cgroup-root="" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982827 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982832 2548 flags.go:64] FLAG: --client-ca-file="" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982837 2548 flags.go:64] FLAG: --cloud-provider="external" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982859 2548 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982867 2548 flags.go:64] FLAG: --cluster-domain="" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982872 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982877 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982882 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982887 2548 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982894 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 14:50:55.989656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982898 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982903 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982909 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982915 2548 flags.go:64] FLAG: --contention-profiling="false" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982919 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982924 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982929 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982934 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982940 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982945 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982950 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982955 2548 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982961 2548 flags.go:64] FLAG: --enable-server="true" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982966 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982972 2548 flags.go:64] FLAG: --event-burst="100" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982977 2548 flags.go:64] FLAG: --event-qps="50" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982982 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982986 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982992 2548 flags.go:64] FLAG: --eviction-hard="" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.982998 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983003 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983008 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983013 2548 flags.go:64] FLAG: --eviction-soft="" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983018 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983023 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 14:50:55.990348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983029 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983033 2548 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983038 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983043 2548 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983047 2548 flags.go:64] FLAG: --feature-gates="" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983053 2548 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983058 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983063 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983068 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983072 2548 flags.go:64] FLAG: --healthz-port="10248" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983078 2548 flags.go:64] FLAG: --help="false" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983083 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-133-129.ec2.internal" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983088 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983092 2548 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983097 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983103 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983108 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983113 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983118 2548 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983124 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983128 2548 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983133 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983138 2548 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983143 2548 flags.go:64] FLAG: --kube-reserved="" Sep 18 14:50:55.991434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983147 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983152 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983157 2548 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983161 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983166 2548 flags.go:64] FLAG: --lock-file="" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983171 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983176 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983181 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983190 2548 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983195 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983200 2548 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983204 2548 flags.go:64] FLAG: --logging-format="text" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983209 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983214 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983219 2548 flags.go:64] FLAG: --manifest-url="" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983223 2548 flags.go:64] FLAG: --manifest-url-header="" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983229 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983234 2548 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983241 2548 flags.go:64] FLAG: --max-pods="110" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983246 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983250 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983255 2548 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983260 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983264 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983279 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 14:50:55.992162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983284 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983295 2548 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983302 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983307 2548 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983312 2548 flags.go:64] FLAG: --pod-cidr="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983316 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983325 2548 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983331 2548 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983336 2548 flags.go:64] FLAG: --pods-per-core="0" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983340 2548 flags.go:64] FLAG: --port="10250" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983345 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983350 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01021f34a3f272af9" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983355 2548 flags.go:64] FLAG: --qos-reserved="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983360 2548 flags.go:64] FLAG: --read-only-port="10255" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983790 2548 flags.go:64] FLAG: --register-node="true" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983796 2548 flags.go:64] FLAG: --register-with-taints="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983803 2548 flags.go:64] FLAG: --registry-burst="10" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983808 2548 flags.go:64] FLAG: --registry-qps="5" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983812 2548 flags.go:64] FLAG: --reserved-cpus="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983817 2548 flags.go:64] FLAG: --reserved-memory="" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983823 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983828 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983833 2548 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983838 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983857 2548 flags.go:64] FLAG: --runonce="false" Sep 18 14:50:55.992826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983863 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983870 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983875 2548 flags.go:64] FLAG: --seccomp-default="false" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983880 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983884 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983889 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983894 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983899 2548 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983904 2548 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983911 2548 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983916 2548 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983920 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983925 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983930 2548 flags.go:64] FLAG: --system-cgroups="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983934 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983943 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983948 2548 flags.go:64] FLAG: --tls-cert-file="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983952 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983960 2548 flags.go:64] FLAG: --tls-min-version="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983964 2548 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983969 2548 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983974 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983979 2548 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983984 2548 flags.go:64] FLAG: --v="2" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983990 2548 flags.go:64] FLAG: --version="false" Sep 18 14:50:55.993470 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.983997 2548 flags.go:64] FLAG: --vmodule="" Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.984006 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.984011 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984181 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984188 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984193 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984198 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984203 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984209 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984214 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984218 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984222 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984227 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984232 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984236 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984241 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984247 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984252 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984256 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984260 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984264 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:55.994093 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984269 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984273 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984278 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984282 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984286 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984290 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984294 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984298 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984302 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984311 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984315 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984320 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984324 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984328 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984332 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984336 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984341 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984345 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984349 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984355 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:55.994612 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984359 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984363 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984367 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984371 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984376 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984380 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984384 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984392 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984398 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984403 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984407 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984411 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984418 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984422 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984426 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984430 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984434 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984439 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984443 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:55.995137 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984447 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984453 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984458 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984464 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984469 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984472 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984477 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984481 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984485 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984489 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984493 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984497 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984503 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984507 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984511 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984516 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984520 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984524 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984528 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:55.995645 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984533 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984538 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984543 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984547 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984551 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984555 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984559 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984563 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984567 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984572 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984576 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984580 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984584 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984588 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984592 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984597 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984602 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984606 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984610 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:55.996131 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984614 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984618 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984623 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.984627 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.984635 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.992724 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.992738 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.992758 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.992764 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992819 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992823 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992827 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992830 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992833 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992836 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:55.996603 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992839 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992856 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992860 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992863 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992867 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992870 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992872 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992877 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992881 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992884 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992887 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992889 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992892 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992895 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992899 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992902 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992904 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992907 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992910 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992913 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.997003 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992915 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992918 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992920 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992924 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992927 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992930 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992932 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992935 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992938 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992941 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992945 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992948 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992951 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992954 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992957 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992960 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992962 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992965 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992967 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992970 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:55.997496 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992974 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992976 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992979 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992982 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992985 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992987 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992990 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992994 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992996 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.992999 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993002 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993005 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993007 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993010 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993013 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993016 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993018 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993021 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993024 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:55.997998 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993027 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993029 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993032 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993034 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993037 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993039 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993042 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993045 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993047 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993050 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993054 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993058 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993061 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993063 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993067 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993069 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993072 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993075 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993077 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:55.998489 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993080 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993083 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993085 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993088 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993090 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993093 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993096 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993098 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993101 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993104 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993107 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993109 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993112 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993115 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993117 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:55.999000 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.993122 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993230 2548 feature_gate.go:328] unrecognized feature gate: Example Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993234 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993238 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993241 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993244 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993247 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993250 2548 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993253 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993255 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993258 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993261 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993264 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993272 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993275 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993278 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993280 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993283 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993287 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993291 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 14:50:55.999400 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993294 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993297 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993300 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993303 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993305 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993308 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993311 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993314 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993316 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993319 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993321 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993324 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993327 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993329 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993332 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993335 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993338 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993340 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993343 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 14:50:56.000020 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993345 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993348 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993350 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993353 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993356 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993358 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993361 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993364 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993367 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993369 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993372 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993375 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993378 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993380 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993383 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993385 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993388 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993390 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993393 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993396 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 14:50:56.000991 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993398 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993401 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993404 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993406 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993409 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993412 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993415 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993417 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993420 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993423 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993425 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993429 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993432 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993435 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993438 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993441 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993444 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993447 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993450 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 14:50:56.001602 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993453 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993457 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993460 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993463 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993465 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993468 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993471 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993474 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993476 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993479 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993482 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993484 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993487 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993490 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993493 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993496 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993498 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993501 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993503 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993506 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 14:50:56.002200 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993509 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:55.993511 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.993516 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.993611 2548 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.995398 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.996071 2548 server.go:1019] "Starting client certificate rotation" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.996168 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.996721 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:55.998509 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:50:56.002776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.001208 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 14:50:56.006398 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.006382 2548 log.go:25] "Validated CRI v1 runtime API" Sep 18 14:50:56.007746 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.007730 2548 log.go:25] "Validated CRI v1 image API" Sep 18 14:50:56.008611 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.008596 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 14:50:56.011049 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.011025 2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d9572212-8f03-4072-8069-b8550ed15b4e:/dev/nvme0n1p4 fa981307-8985-4a37-a9c5-3743ab681783:/dev/nvme0n1p3] Sep 18 14:50:56.011124 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.011049 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 14:50:56.015874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.015636 2548 manager.go:216] Machine: {Timestamp:2026-09-18 14:50:56.014826804 +0000 UTC m=+1.864246637 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109561 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e9378d4f4d4cfe6e7e50590a1dcf2 SystemUUID:ec2e9378-d4f4-d4cf-e6e7-e50590a1dcf2 BootID:36cc906d-a74e-4f14-aabf-17b5153a28c5 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:2d:e9:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:2d:e9:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:f5:35:59:3d:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 14:50:56.015874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.015868 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 14:50:56.016030 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.015970 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 14:50:56.017610 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.017414 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 14:50:56.017758 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.017615 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 14:50:56.018590 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.018579 2548 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 14:50:56.018635 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.018593 2548 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 14:50:56.018635 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.018600 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:50:56.018635 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.018611 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 14:50:56.019697 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.019684 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 14:50:56.022510 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022497 2548 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:50:56.022630 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022621 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 14:50:56.022661 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022655 2548 kubelet.go:486] "Attempting to sync node with API server" Sep 18 14:50:56.022692 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022667 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 14:50:56.022692 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022683 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 14:50:56.022751 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022693 2548 kubelet.go:398] "Adding apiserver pod source" Sep 18 14:50:56.022751 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.022702 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 14:50:56.023071 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.023060 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:50:56.023116 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.023078 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 14:50:56.024147 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.024126 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:50:56.025037 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.025023 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 14:50:56.026882 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.026867 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 14:50:56.026957 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.026898 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 14:50:56.027871 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027860 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 14:50:56.027909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027877 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 14:50:56.027909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027883 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 14:50:56.027909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027889 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 14:50:56.027909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027898 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 14:50:56.027909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027903 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027917 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027922 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027930 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027935 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027943 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027949 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027975 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 14:50:56.028062 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.027980 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 14:50:56.031215 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.031194 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 14:50:56.031308 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.031220 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 14:50:56.031308 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.031218 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 14:50:56.031710 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.031693 2548 server.go:1268] "Started kubelet" Sep 18 14:50:56.031793 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.031765 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 14:50:56.031858 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.031799 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 14:50:56.031907 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.031869 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 14:50:56.032762 ip-10-0-133-129 systemd[1]: Started Kubernetes Kubelet. Sep 18 14:50:56.033369 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.032824 2548 server.go:310] "Adding debug handlers to kubelet server" Sep 18 14:50:56.033369 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.032867 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 14:50:56.035792 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.035766 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 14:50:56.038416 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.038403 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 14:50:56.038488 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.038423 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 14:50:56.038559 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.038542 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.039018 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039001 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 14:50:56.039099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039053 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 14:50:56.039099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039072 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 14:50:56.039207 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039156 2548 reconstruct.go:97] "Volume reconstruction finished" Sep 18 14:50:56.039207 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039164 2548 reconciler.go:29] "Reconciler: start to sync state" Sep 18 14:50:56.039266 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039236 2548 factory.go:55] Registering systemd factory Sep 18 14:50:56.039266 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039250 2548 factory.go:223] Registration of the systemd container factory successfully Sep 18 14:50:56.039492 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039468 2548 factory.go:153] Registering CRI-O factory Sep 18 14:50:56.039492 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039487 2548 factory.go:223] Registration of the crio container factory successfully Sep 18 14:50:56.039603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039537 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 14:50:56.039603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039560 2548 factory.go:103] Registering Raw factory Sep 18 14:50:56.039603 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.039574 2548 manager.go:1196] Started watching for new ooms in manager Sep 18 14:50:56.040061 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.040049 2548 manager.go:349] Starting recovery of all containers Sep 18 14:50:56.041108 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.041086 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 14:50:56.041182 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.041163 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 14:50:56.059514 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.059475 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gsl9l" Sep 18 14:50:56.059514 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.059508 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gsl9l" Sep 18 14:50:56.067618 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.067513 2548 manager.go:354] Recovery completed Sep 18 14:50:56.071530 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.071518 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.073192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073173 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.073271 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073207 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.073271 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073223 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.073751 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073739 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 14:50:56.073791 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073752 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 14:50:56.073791 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073756 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.073791 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.073767 2548 state_mem.go:36] "Initialized new in-memory state store" Sep 18 14:50:56.074373 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074357 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.074427 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074387 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.074427 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074399 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.074717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074701 2548 policy_none.go:49] "None policy: Start" Sep 18 14:50:56.074717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074719 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 14:50:56.074821 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.074729 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 14:50:56.075550 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.075538 2548 policy_none.go:47] "Start" Sep 18 14:50:56.108424 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108412 2548 manager.go:337] "Starting Device Plugin manager" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.108442 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108451 2548 server.go:87] "Starting device plugin registration server" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108688 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108712 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108790 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108887 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.108897 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.109248 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.109295 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.119551 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.118495 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 14:50:56.120274 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.120257 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 14:50:56.120320 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.120310 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 14:50:56.120359 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.120336 2548 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 14:50:56.120398 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.120379 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 14:50:56.122238 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.122216 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:56.209055 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.209025 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.210706 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.210690 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.210788 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.210723 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.210788 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.210738 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.210788 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.210765 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.220428 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.220409 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.220516 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.220430 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-129.ec2.internal\": node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.220516 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.220507 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal"] Sep 18 14:50:56.220607 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.220562 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.221392 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.221377 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.221452 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.221402 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.221452 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.221411 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.222426 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.222415 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.222546 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.222532 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.222602 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.222566 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.223083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223063 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.223083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223085 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.223201 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223085 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.223201 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223113 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.223201 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223122 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.223201 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.223098 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.224148 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.224122 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.224148 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.224149 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 14:50:56.224757 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.224743 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Sep 18 14:50:56.224834 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.224766 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 14:50:56.224834 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.224775 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Sep 18 14:50:56.240225 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.240208 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.240315 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.240236 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.240315 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.240277 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f42899217f0ec711059b689f33b26745-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"f42899217f0ec711059b689f33b26745\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.240410 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.240355 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.250354 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.250336 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.254529 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.254516 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340506 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.340485 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.340580 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340516 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f42899217f0ec711059b689f33b26745-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"f42899217f0ec711059b689f33b26745\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340580 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340536 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340580 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340550 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340580 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340573 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340704 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340599 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f42899217f0ec711059b689f33b26745-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"f42899217f0ec711059b689f33b26745\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.340704 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.340613 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/110a776e9fbd4dfb8234a171ee2ca5b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"110a776e9fbd4dfb8234a171ee2ca5b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.441257 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.441227 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.541938 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.541890 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.554041 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.554023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.558230 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.558000 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:56.642553 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.642532 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.742950 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.742931 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.843346 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.843297 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.943802 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:56.943777 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:56.971366 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.971344 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:56.995967 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.995945 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 14:50:56.996459 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.996080 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 14:50:56.996459 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:56.996104 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 14:50:57.043084 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.043062 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:57.044082 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.044062 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.064586 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.064554 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 14:45:56 +0000 UTC" deadline="2028-05-15 04:51:25.453973517 +0000 UTC" Sep 18 14:50:57.064586 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.064578 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14510h0m28.389398221s" Sep 18 14:50:57.085286 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:57.085264 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110a776e9fbd4dfb8234a171ee2ca5b2.slice/crio-dba7590c23710214ea199fef082c4942bad1f1507611674deff5d6aed50206a3 WatchSource:0}: Error finding container dba7590c23710214ea199fef082c4942bad1f1507611674deff5d6aed50206a3: Status 404 returned error can't find the container with id dba7590c23710214ea199fef082c4942bad1f1507611674deff5d6aed50206a3 Sep 18 14:50:57.085790 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:57.085774 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42899217f0ec711059b689f33b26745.slice/crio-a0222cd779f5918151b439f4c892654697613c5fa0faada906acf107c7ced487 WatchSource:0}: Error finding container a0222cd779f5918151b439f4c892654697613c5fa0faada906acf107c7ced487: Status 404 returned error can't find the container with id a0222cd779f5918151b439f4c892654697613c5fa0faada906acf107c7ced487 Sep 18 14:50:57.090899 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.090884 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:50:57.125793 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.125714 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"f42899217f0ec711059b689f33b26745","Type":"ContainerStarted","Data":"a0222cd779f5918151b439f4c892654697613c5fa0faada906acf107c7ced487"} Sep 18 14:50:57.126832 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.126811 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"110a776e9fbd4dfb8234a171ee2ca5b2","Type":"ContainerStarted","Data":"dba7590c23710214ea199fef082c4942bad1f1507611674deff5d6aed50206a3"} Sep 18 14:50:57.144131 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.144109 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.244470 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.244442 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.344811 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.344789 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.445224 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.445176 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.546039 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:57.545925 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Sep 18 14:50:57.574253 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.574086 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:57.639580 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.639554 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Sep 18 14:50:57.650299 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.650278 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:50:57.651167 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.651149 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Sep 18 14:50:57.662337 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.662318 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 14:50:57.864182 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:57.864107 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:58.024153 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.024125 2548 apiserver.go:52] "Watching apiserver" Sep 18 14:50:58.031682 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.031657 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 14:50:58.032055 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.032034 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj","openshift-multus/multus-additional-cni-plugins-r2hh2","openshift-multus/multus-h97zl","openshift-multus/network-metrics-daemon-qnvbc","openshift-network-diagnostics/network-check-target-nvd62","openshift-network-operator/iptables-alerter-pj8dv","openshift-ovn-kubernetes/ovnkube-node-jvrdr","kube-system/global-pull-secret-syncer-s9wc9","kube-system/konnectivity-agent-scckj","openshift-cluster-node-tuning-operator/tuned-nvsnt","openshift-dns/node-resolver-smzwk","openshift-image-registry/node-ca-xf86k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal"] Sep 18 14:50:58.034295 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.034270 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.036247 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.036223 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.037080 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.037059 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 14:50:58.037184 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.037104 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v6jtv\"" Sep 18 14:50:58.037327 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.037301 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.037449 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.037307 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.038250 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.038232 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.038564 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.038546 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 14:50:58.039168 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039124 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 14:50:58.039168 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039155 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 14:50:58.039362 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039260 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.039700 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039616 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c966v\"" Sep 18 14:50:58.039700 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039623 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 14:50:58.039872 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.039699 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.040518 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.040499 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.040613 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.040523 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 14:50:58.040613 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.040588 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:50:58.040745 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.040724 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8z4n7\"" Sep 18 14:50:58.042445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.042416 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:50:58.042540 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.042485 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:50:58.044399 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.044382 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.046676 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.046662 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.047538 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.047507 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-srx2f\"" Sep 18 14:50:58.047666 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.047649 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.048124 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048062 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.048275 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048260 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 14:50:58.048862 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048827 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-system-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.048946 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-netns\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.048946 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048914 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.048946 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048939 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-cni-binary-copy\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048963 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-daemon-config\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.048986 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-etc-kubernetes\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049008 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-cnibin\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049027 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-k8s-cni-cncf-io\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049060 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6jp9\" (UniqueName: \"kubernetes.io/projected/84daa28e-6647-4732-a07b-bbb87c80e34c-kube-api-access-t6jp9\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049073 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-socket-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049086 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049100 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049177 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-cnibin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049207 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-bin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049251 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-conf-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049276 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049295 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-socket-dir-parent\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049322 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-hostroot\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.049338 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049348 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-registration-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049398 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049416 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-multus\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049438 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049444 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049464 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049488 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-device-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049512 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mg4w\" (UniqueName: \"kubernetes.io/projected/49f41607-1eef-4e4c-b486-859090092b6b-kube-api-access-9mg4w\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049535 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-kubelet\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049562 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-sys-fs\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049585 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-system-cni-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049611 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049640 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-multus-certs\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049662 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049692 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wtt\" (UniqueName: \"kubernetes.io/projected/bc5e545b-5a92-49c1-b638-50214247ce43-kube-api-access-g2wtt\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049718 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw8q7\" (UniqueName: \"kubernetes.io/projected/fc965755-516b-4f4c-af7c-eac391af7854-kube-api-access-hw8q7\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.049959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049615 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.050608 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.049991 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mj5zp\"" Sep 18 14:50:58.050608 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.050117 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 14:50:58.050608 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.050303 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 14:50:58.051246 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.051115 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 14:50:58.052866 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.051455 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.053706 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.053555 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 14:50:58.054907 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.054509 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bnk8j\"" Sep 18 14:50:58.054907 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.054519 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.054907 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.054574 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 14:50:58.054907 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.054522 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 14:50:58.056734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.056715 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.056906 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.056887 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.057323 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.057306 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l62v8\"" Sep 18 14:50:58.057428 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.057407 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.059133 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.059117 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.059425 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.059281 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wr2sd\"" Sep 18 14:50:58.059611 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.059590 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.059688 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.059660 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.061985 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.061966 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 14:50:58.062083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.062010 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zjrj\"" Sep 18 14:50:58.062083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.062014 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 14:50:58.062083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.062056 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 14:50:58.080050 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.080028 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t7crl" Sep 18 14:50:58.089692 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.089678 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t7crl" Sep 18 14:50:58.140312 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.140265 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 14:50:58.149936 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.149905 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.150028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.149937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wtt\" (UniqueName: \"kubernetes.io/projected/bc5e545b-5a92-49c1-b638-50214247ce43-kube-api-access-g2wtt\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.150028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.149965 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-etc-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.150028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.149997 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428a1e96-15d7-414c-87a9-1f14c5dd253b-hosts-file\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.150028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29802ef6-1a51-4063-b6c6-b6493c950c9c-host\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.150224 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150138 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-node-log\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.150224 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150171 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29802ef6-1a51-4063-b6c6-b6493c950c9c-serviceca\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.150224 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150202 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150240 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-daemon-config\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150277 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150295 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150321 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-k8s-cni-cncf-io\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150342 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6jp9\" (UniqueName: \"kubernetes.io/projected/84daa28e-6647-4732-a07b-bbb87c80e34c-kube-api-access-t6jp9\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.150365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150362 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-host-slash\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150378 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-env-overrides\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150395 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-k8s-cni-cncf-io\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150391 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150458 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-sys\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150510 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qflqq\" (UniqueName: \"kubernetes.io/projected/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-kube-api-access-qflqq\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150529 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150539 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-dbus\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.150640 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150570 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-socket-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150670 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150698 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150721 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-bin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150730 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150754 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-config\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150778 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhfq\" (UniqueName: \"kubernetes.io/projected/02709818-a206-4a14-80de-a59db838b9de-kube-api-access-qjhfq\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150791 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150791 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-bin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151019 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150806 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a1e96-15d7-414c-87a9-1f14c5dd253b-tmp-dir\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151145 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-daemon-config\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150870 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-socket-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.150877 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sshz\" (UniqueName: \"kubernetes.io/projected/428a1e96-15d7-414c-87a9-1f14c5dd253b-kube-api-access-6sshz\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151369 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-socket-dir-parent\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151415 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-hostroot\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151460 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151448 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-systemd-units\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151476 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-var-lib-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151511 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-socket-dir-parent\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151581 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-hostroot\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151638 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc965755-516b-4f4c-af7c-eac391af7854-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151663 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-bin\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.151720 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151715 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-konnectivity-ca\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.152012 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151762 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-kubernetes\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.152012 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151801 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.152012 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.151918 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.152149 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152036 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.152149 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152088 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gd9\" (UniqueName: \"kubernetes.io/projected/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-kube-api-access-92gd9\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.152149 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.152095 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:58.152149 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152135 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-systemd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.152312 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152184 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-kubelet-config\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.152312 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152232 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152405 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.152337 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:58.652289068 +0000 UTC m=+4.501708906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:58.152405 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152346 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152405 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152364 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-device-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152548 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152402 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mg4w\" (UniqueName: \"kubernetes.io/projected/49f41607-1eef-4e4c-b486-859090092b6b-kube-api-access-9mg4w\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152548 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152419 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-device-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152548 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-kubelet\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.152548 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152461 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.152713 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152558 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-conf\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.152713 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152609 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-sys-fs\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152713 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152641 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-system-cni-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.152713 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152677 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-multus-certs\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.152713 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152705 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-script-lib\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152734 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-modprobe-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152783 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-var-lib-kubelet\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152827 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-sys-fs\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152831 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-host\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152881 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw8q7\" (UniqueName: \"kubernetes.io/projected/fc965755-516b-4f4c-af7c-eac391af7854-kube-api-access-hw8q7\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152885 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-system-cni-dir\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152912 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-system-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152920 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-multus-certs\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152940 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-netns\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.152993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.152992 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-kubelet\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.153537 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-ovn\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.153588 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153556 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysconfig\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.153641 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153616 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-cni-binary-copy\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.153716 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153703 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-etc-kubernetes\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.153764 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153737 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-run\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.153806 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153787 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.153879 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153818 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-cnibin\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.153879 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153874 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-netd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.153972 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.153902 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-systemd\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.154044 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154014 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-lib-modules\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.154119 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154106 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq8t\" (UniqueName: \"kubernetes.io/projected/29802ef6-1a51-4063-b6c6-b6493c950c9c-kube-api-access-ptq8t\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.154170 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154138 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-cnibin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154218 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154175 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-run-netns\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154267 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154198 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-system-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154343 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154326 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc965755-516b-4f4c-af7c-eac391af7854-cnibin\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.154399 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154328 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-etc-kubernetes\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154399 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154331 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-conf-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154486 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154456 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-cnibin\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154543 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154495 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-iptables-alerter-script\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.154590 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154571 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-log-socket\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.154628 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154527 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-conf-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.154628 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154602 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-tuned\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.154712 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-tmp\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.154712 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:50:58.154802 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154719 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.155010 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154874 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-slash\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.155107 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155025 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02709818-a206-4a14-80de-a59db838b9de-ovn-node-metrics-cert\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.155107 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.154941 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-multus-cni-dir\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.155107 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155075 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-registration-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.155232 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155180 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-multus\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.155678 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155512 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84daa28e-6647-4732-a07b-bbb87c80e34c-host-var-lib-cni-multus\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.155678 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155602 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-netns\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.155678 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155630 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-kubelet\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.155678 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155560 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41607-1eef-4e4c-b486-859090092b6b-registration-dir\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.155678 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-agent-certs\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.155989 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.155677 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84daa28e-6647-4732-a07b-bbb87c80e34c-cni-binary-copy\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.156613 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.156594 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 14:50:58.159911 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.159894 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6jp9\" (UniqueName: \"kubernetes.io/projected/84daa28e-6647-4732-a07b-bbb87c80e34c-kube-api-access-t6jp9\") pod \"multus-h97zl\" (UID: \"84daa28e-6647-4732-a07b-bbb87c80e34c\") " pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.160007 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.159986 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wtt\" (UniqueName: \"kubernetes.io/projected/bc5e545b-5a92-49c1-b638-50214247ce43-kube-api-access-g2wtt\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.164409 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.164391 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw8q7\" (UniqueName: \"kubernetes.io/projected/fc965755-516b-4f4c-af7c-eac391af7854-kube-api-access-hw8q7\") pod \"multus-additional-cni-plugins-r2hh2\" (UID: \"fc965755-516b-4f4c-af7c-eac391af7854\") " pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.164639 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.164617 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mg4w\" (UniqueName: \"kubernetes.io/projected/49f41607-1eef-4e4c-b486-859090092b6b-kube-api-access-9mg4w\") pod \"aws-ebs-csi-driver-node-7grmj\" (UID: \"49f41607-1eef-4e4c-b486-859090092b6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.256367 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256343 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-etc-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256487 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428a1e96-15d7-414c-87a9-1f14c5dd253b-hosts-file\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.256487 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256394 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29802ef6-1a51-4063-b6c6-b6493c950c9c-host\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.256487 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256416 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-node-log\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256487 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256439 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29802ef6-1a51-4063-b6c6-b6493c950c9c-serviceca\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.256487 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256447 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-etc-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256483 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428a1e96-15d7-414c-87a9-1f14c5dd253b-hosts-file\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256495 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29802ef6-1a51-4063-b6c6-b6493c950c9c-host\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256511 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-node-log\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256557 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256589 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-host-slash\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256637 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-env-overrides\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256655 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256674 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256686 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256697 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-sys\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256719 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qflqq\" (UniqueName: \"kubernetes.io/projected/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-kube-api-access-qflqq\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.256734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256740 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-dbus\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256776 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-config\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256805 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhfq\" (UniqueName: \"kubernetes.io/projected/02709818-a206-4a14-80de-a59db838b9de-kube-api-access-qjhfq\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256807 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29802ef6-1a51-4063-b6c6-b6493c950c9c-serviceca\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256819 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256825 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a1e96-15d7-414c-87a9-1f14c5dd253b-tmp-dir\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256872 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sshz\" (UniqueName: \"kubernetes.io/projected/428a1e96-15d7-414c-87a9-1f14c5dd253b-kube-api-access-6sshz\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256894 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-sys\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256900 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-systemd-units\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256932 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-systemd-units\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256933 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-var-lib-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-bin\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256967 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-var-lib-openvswitch\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256695 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-host-slash\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.256981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-konnectivity-ca\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-kubernetes\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257051 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gd9\" (UniqueName: \"kubernetes.io/projected/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-kube-api-access-92gd9\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257092 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-systemd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.257354 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257097 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-kubernetes\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257118 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-kubelet-config\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257149 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257174 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-conf\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257202 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-script-lib\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257226 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-modprobe-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257261 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-var-lib-kubelet\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257283 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-host\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257310 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-ovn\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257332 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysconfig\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257355 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-run\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257377 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257382 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-dbus\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257393 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-konnectivity-ca\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257445 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-bin\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257666 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a1e96-15d7-414c-87a9-1f14c5dd253b-tmp-dir\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257725 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-modprobe-d\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.258192 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257757 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257785 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-var-lib-kubelet\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257803 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-systemd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257823 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-config\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257834 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-host\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257863 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa25a9d-2606-4009-8289-f3d65d9d9274-kubelet-config\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257173 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-env-overrides\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257900 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-run\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257901 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-run-ovn\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257912 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-netd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257945 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-systemd\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257950 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-cni-netd\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257950 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02709818-a206-4a14-80de-a59db838b9de-ovnkube-script-lib\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257964 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysctl-conf\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.257968 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.257993 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-systemd\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258002 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-sysconfig\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259001 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258037 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-lib-modules\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.258048 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:58.758027745 +0000 UTC m=+4.607447578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258100 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq8t\" (UniqueName: \"kubernetes.io/projected/29802ef6-1a51-4063-b6c6-b6493c950c9c-kube-api-access-ptq8t\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-iptables-alerter-script\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258131 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-lib-modules\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258264 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-log-socket\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258297 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-tuned\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258317 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-tmp\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258328 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-log-socket\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258334 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258361 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-slash\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258379 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02709818-a206-4a14-80de-a59db838b9de-ovn-node-metrics-cert\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258398 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-netns\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258451 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-kubelet\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258484 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-agent-certs\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258508 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-slash\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258557 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-run-netns\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.259798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258617 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02709818-a206-4a14-80de-a59db838b9de-host-kubelet\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.260621 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.258745 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-iptables-alerter-script\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.260958 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.260936 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-tmp\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.260958 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.260954 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-etc-tuned\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.261093 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.261029 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02709818-a206-4a14-80de-a59db838b9de-ovn-node-metrics-cert\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.261093 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.261044 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bb635d6-8336-43d2-b3ff-fe6ad04b453c-agent-certs\") pod \"konnectivity-agent-scckj\" (UID: \"9bb635d6-8336-43d2-b3ff-fe6ad04b453c\") " pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.283506 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.283478 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:58.283506 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.283503 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:58.283664 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.283532 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:58.283664 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.283587 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:58.783570766 +0000 UTC m=+4.632990592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:58.285886 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.285856 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq8t\" (UniqueName: \"kubernetes.io/projected/29802ef6-1a51-4063-b6c6-b6493c950c9c-kube-api-access-ptq8t\") pod \"node-ca-xf86k\" (UID: \"29802ef6-1a51-4063-b6c6-b6493c950c9c\") " pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.286011 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.285978 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sshz\" (UniqueName: \"kubernetes.io/projected/428a1e96-15d7-414c-87a9-1f14c5dd253b-kube-api-access-6sshz\") pod \"node-resolver-smzwk\" (UID: \"428a1e96-15d7-414c-87a9-1f14c5dd253b\") " pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.286100 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.286033 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gd9\" (UniqueName: \"kubernetes.io/projected/5f678feb-8eb4-4bb2-9170-c4cc59822b7e-kube-api-access-92gd9\") pod \"iptables-alerter-pj8dv\" (UID: \"5f678feb-8eb4-4bb2-9170-c4cc59822b7e\") " pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.286367 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.286348 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qflqq\" (UniqueName: \"kubernetes.io/projected/0b5adfda-73dd-42f6-9d1e-05163ba78cf3-kube-api-access-qflqq\") pod \"tuned-nvsnt\" (UID: \"0b5adfda-73dd-42f6-9d1e-05163ba78cf3\") " pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.286399 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.286352 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhfq\" (UniqueName: \"kubernetes.io/projected/02709818-a206-4a14-80de-a59db838b9de-kube-api-access-qjhfq\") pod \"ovnkube-node-jvrdr\" (UID: \"02709818-a206-4a14-80de-a59db838b9de\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.345501 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.345466 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" Sep 18 14:50:58.354741 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.354725 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" Sep 18 14:50:58.363475 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.363457 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h97zl" Sep 18 14:50:58.368923 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.368907 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj8dv" Sep 18 14:50:58.375484 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.375467 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:50:58.382955 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.382936 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:50:58.388705 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.388687 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" Sep 18 14:50:58.394322 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.394301 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smzwk" Sep 18 14:50:58.398857 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.398830 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf86k" Sep 18 14:50:58.661263 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.661184 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:58.661408 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.661301 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:58.661408 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.661360 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:59.661346237 +0000 UTC m=+5.510766057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:58.762261 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.762228 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:58.762417 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.762372 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:58.762464 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.762432 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:50:59.762418718 +0000 UTC m=+5.611838538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:58.863541 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:58.863515 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:50:58.863639 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.863627 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:58.863688 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.863644 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:58.863688 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.863653 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:58.863749 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:58.863700 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:50:59.86368852 +0000 UTC m=+5.713108340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:58.871394 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.871362 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29802ef6_1a51_4063_b6c6_b6493c950c9c.slice/crio-6b9c891bee9efefcfdbf9e20043f836bb3e9f64befcc07242e7eeb7b186183ae WatchSource:0}: Error finding container 6b9c891bee9efefcfdbf9e20043f836bb3e9f64befcc07242e7eeb7b186183ae: Status 404 returned error can't find the container with id 6b9c891bee9efefcfdbf9e20043f836bb3e9f64befcc07242e7eeb7b186183ae Sep 18 14:50:58.873830 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.873714 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02709818_a206_4a14_80de_a59db838b9de.slice/crio-7e81d9530ac40a8ffd5abbc108fad48bc701ee0b9ca020ed8d55497f0b3cb400 WatchSource:0}: Error finding container 7e81d9530ac40a8ffd5abbc108fad48bc701ee0b9ca020ed8d55497f0b3cb400: Status 404 returned error can't find the container with id 7e81d9530ac40a8ffd5abbc108fad48bc701ee0b9ca020ed8d55497f0b3cb400 Sep 18 14:50:58.876142 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.876121 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f41607_1eef_4e4c_b486_859090092b6b.slice/crio-b7a5da276f9ddfff8ffa64bb51e975943e1ab8e55290dbef96fb8cb7f1599011 WatchSource:0}: Error finding container b7a5da276f9ddfff8ffa64bb51e975943e1ab8e55290dbef96fb8cb7f1599011: Status 404 returned error can't find the container with id b7a5da276f9ddfff8ffa64bb51e975943e1ab8e55290dbef96fb8cb7f1599011 Sep 18 14:50:58.896329 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.896311 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb635d6_8336_43d2_b3ff_fe6ad04b453c.slice/crio-2588f02d7e3ecfd84f60ef638e6f4681e97dfc250d0ed9dcd3325ca528cf4505 WatchSource:0}: Error finding container 2588f02d7e3ecfd84f60ef638e6f4681e97dfc250d0ed9dcd3325ca528cf4505: Status 404 returned error can't find the container with id 2588f02d7e3ecfd84f60ef638e6f4681e97dfc250d0ed9dcd3325ca528cf4505 Sep 18 14:50:58.897055 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.897031 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428a1e96_15d7_414c_87a9_1f14c5dd253b.slice/crio-02e6b32d30727e508bfddc58155e453de67a98e4af701aa9c385b1b370b24da2 WatchSource:0}: Error finding container 02e6b32d30727e508bfddc58155e453de67a98e4af701aa9c385b1b370b24da2: Status 404 returned error can't find the container with id 02e6b32d30727e508bfddc58155e453de67a98e4af701aa9c385b1b370b24da2 Sep 18 14:50:58.897608 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.897580 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f678feb_8eb4_4bb2_9170_c4cc59822b7e.slice/crio-a98134cf3e3f7a4d9c83850ddf3688ff070a98f62d78c797617621f369382a26 WatchSource:0}: Error finding container a98134cf3e3f7a4d9c83850ddf3688ff070a98f62d78c797617621f369382a26: Status 404 returned error can't find the container with id a98134cf3e3f7a4d9c83850ddf3688ff070a98f62d78c797617621f369382a26 Sep 18 14:50:58.898806 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.898481 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5adfda_73dd_42f6_9d1e_05163ba78cf3.slice/crio-c99185e8065c14a407d328dbc3d76833c3e9432f78352d703530fc1efc43dfbc WatchSource:0}: Error finding container c99185e8065c14a407d328dbc3d76833c3e9432f78352d703530fc1efc43dfbc: Status 404 returned error can't find the container with id c99185e8065c14a407d328dbc3d76833c3e9432f78352d703530fc1efc43dfbc Sep 18 14:50:58.901033 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:50:58.901013 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84daa28e_6647_4732_a07b_bbb87c80e34c.slice/crio-4ecde7aed025fdb8f892388e2ba20a2e5a9599f2a10d49dcfeaf3e20fb61a801 WatchSource:0}: Error finding container 4ecde7aed025fdb8f892388e2ba20a2e5a9599f2a10d49dcfeaf3e20fb61a801: Status 404 returned error can't find the container with id 4ecde7aed025fdb8f892388e2ba20a2e5a9599f2a10d49dcfeaf3e20fb61a801 Sep 18 14:50:59.093575 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.093411 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:45:58 +0000 UTC" deadline="2028-03-21 04:38:38.141809913 +0000 UTC" Sep 18 14:50:59.093575 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.093573 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13189h47m39.048239735s" Sep 18 14:50:59.121461 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.121439 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:59.121621 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.121528 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:50:59.131710 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.131686 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"110a776e9fbd4dfb8234a171ee2ca5b2","Type":"ContainerStarted","Data":"63c5acb04094574237e17dda9119cea4b0aaafae00486faaa776e6cf0ac023fc"} Sep 18 14:50:59.132826 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.132798 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" event={"ID":"0b5adfda-73dd-42f6-9d1e-05163ba78cf3","Type":"ContainerStarted","Data":"c99185e8065c14a407d328dbc3d76833c3e9432f78352d703530fc1efc43dfbc"} Sep 18 14:50:59.133902 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.133876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj8dv" event={"ID":"5f678feb-8eb4-4bb2-9170-c4cc59822b7e","Type":"ContainerStarted","Data":"a98134cf3e3f7a4d9c83850ddf3688ff070a98f62d78c797617621f369382a26"} Sep 18 14:50:59.134760 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.134735 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scckj" event={"ID":"9bb635d6-8336-43d2-b3ff-fe6ad04b453c","Type":"ContainerStarted","Data":"2588f02d7e3ecfd84f60ef638e6f4681e97dfc250d0ed9dcd3325ca528cf4505"} Sep 18 14:50:59.135840 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.135818 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" event={"ID":"49f41607-1eef-4e4c-b486-859090092b6b","Type":"ContainerStarted","Data":"b7a5da276f9ddfff8ffa64bb51e975943e1ab8e55290dbef96fb8cb7f1599011"} Sep 18 14:50:59.137040 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.137011 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"f42899217f0ec711059b689f33b26745","Type":"ContainerStarted","Data":"0eed9788ef8be4b2f319c2f3dcf57b564e7efb4c0ed1fb38b1a9cf2926fb2c9f"} Sep 18 14:50:59.138118 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.138102 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h97zl" event={"ID":"84daa28e-6647-4732-a07b-bbb87c80e34c","Type":"ContainerStarted","Data":"4ecde7aed025fdb8f892388e2ba20a2e5a9599f2a10d49dcfeaf3e20fb61a801"} Sep 18 14:50:59.139318 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.139123 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerStarted","Data":"ab6d5faf00197c6da3674a0f36ca89e7b95cebf2887aba18ae9aebd187ecbdc2"} Sep 18 14:50:59.140207 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.140185 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smzwk" event={"ID":"428a1e96-15d7-414c-87a9-1f14c5dd253b","Type":"ContainerStarted","Data":"02e6b32d30727e508bfddc58155e453de67a98e4af701aa9c385b1b370b24da2"} Sep 18 14:50:59.141270 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.141246 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"7e81d9530ac40a8ffd5abbc108fad48bc701ee0b9ca020ed8d55497f0b3cb400"} Sep 18 14:50:59.142148 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.142132 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf86k" event={"ID":"29802ef6-1a51-4063-b6c6-b6493c950c9c","Type":"ContainerStarted","Data":"6b9c891bee9efefcfdbf9e20043f836bb3e9f64befcc07242e7eeb7b186183ae"} Sep 18 14:50:59.159046 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.159007 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" podStartSLOduration=2.158996426 podStartE2EDuration="2.158996426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:50:59.158917784 +0000 UTC m=+5.008337627" watchObservedRunningTime="2026-09-18 14:50:59.158996426 +0000 UTC m=+5.008416268" Sep 18 14:50:59.671554 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.671014 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:50:59.671554 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.671171 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:59.671554 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.671236 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:01.671214974 +0000 UTC m=+7.520634800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:50:59.672431 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.672141 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 14:50:59.771520 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.771444 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:50:59.771707 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.771620 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:59.771707 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.771699 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:01.771680725 +0000 UTC m=+7.621100559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:50:59.872734 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:50:59.872696 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:50:59.872908 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.872877 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:50:59.872908 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.872899 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:50:59.873025 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.872912 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:50:59.873025 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:50:59.872972 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:01.872955074 +0000 UTC m=+7.722374899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:00.094149 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.094061 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 14:45:58 +0000 UTC" deadline="2028-05-10 06:08:52.935755045 +0000 UTC" Sep 18 14:51:00.094149 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.094102 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14391h17m52.84165792s" Sep 18 14:51:00.120972 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.120946 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:00.121108 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:00.121065 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:00.121570 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.121441 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:00.121570 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:00.121533 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:00.173596 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.173559 2548 generic.go:356] "Generic (PLEG): container finished" podID="110a776e9fbd4dfb8234a171ee2ca5b2" containerID="63c5acb04094574237e17dda9119cea4b0aaafae00486faaa776e6cf0ac023fc" exitCode=0 Sep 18 14:51:00.174560 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:00.174394 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"110a776e9fbd4dfb8234a171ee2ca5b2","Type":"ContainerDied","Data":"63c5acb04094574237e17dda9119cea4b0aaafae00486faaa776e6cf0ac023fc"} Sep 18 14:51:01.121018 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.120987 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:01.121478 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.121132 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:01.184486 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.184451 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"110a776e9fbd4dfb8234a171ee2ca5b2","Type":"ContainerStarted","Data":"fab08b5a5e571b860f74f3dbd5d2be210007a1cb2709f1cfcb73e26bacd93c62"} Sep 18 14:51:01.202494 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.202444 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" podStartSLOduration=4.202423449 podStartE2EDuration="4.202423449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:01.202046787 +0000 UTC m=+7.051466630" watchObservedRunningTime="2026-09-18 14:51:01.202423449 +0000 UTC m=+7.051843293" Sep 18 14:51:01.692866 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.692804 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:01.693101 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.692981 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:01.693101 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.693046 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:05.693027238 +0000 UTC m=+11.542447078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:01.794201 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.794162 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:01.794365 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.794326 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:01.794422 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.794394 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:05.794375266 +0000 UTC m=+11.643795105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:01.895467 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:01.895392 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:01.895699 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.895587 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:01.895699 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.895613 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:01.895699 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.895628 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:01.895699 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:01.895693 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:05.895672774 +0000 UTC m=+11.745092599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:02.121311 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:02.121213 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:02.121808 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:02.121332 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:02.121808 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:02.121220 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:02.121808 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:02.121733 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:03.120750 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:03.120718 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:03.120952 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:03.120870 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:04.121284 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:04.121251 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:04.121718 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:04.121381 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:04.121893 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:04.121873 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:04.122004 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:04.121978 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:05.121708 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:05.121152 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:05.121708 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.121347 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:05.729150 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:05.728864 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:05.729150 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.729056 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:05.729150 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.729112 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:13.729093853 +0000 UTC m=+19.578513682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:05.830011 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:05.829467 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:05.830011 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.829604 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:05.830011 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.829674 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:13.829654785 +0000 UTC m=+19.679074621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:05.930205 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:05.930072 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:05.930383 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.930213 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:05.930383 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.930238 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:05.930383 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.930253 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:05.930383 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:05.930316 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:13.930297971 +0000 UTC m=+19.779717793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:06.128874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:06.121905 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:06.128874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:06.124906 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:06.128874 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:06.125079 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:06.128874 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:06.127399 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:07.120711 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:07.120640 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:07.120884 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:07.120785 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:08.121610 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:08.121572 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:08.122109 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:08.121572 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:08.122109 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:08.121704 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:08.122109 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:08.121794 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:09.121619 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:09.121539 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:09.122007 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:09.121674 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:10.120934 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:10.120901 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:10.121222 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:10.121028 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:10.121380 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:10.121348 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:10.121457 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:10.121446 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:11.121066 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:11.121031 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:11.121525 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:11.121167 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:12.121352 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:12.121321 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:12.121795 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:12.121324 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:12.121795 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:12.121438 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:12.121795 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:12.121539 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:13.120929 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:13.120899 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:13.121207 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.121027 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:13.784536 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:13.784507 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:13.785023 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.784683 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:13.785023 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.784765 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:29.78474255 +0000 UTC m=+35.634162382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:13.885901 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:13.885865 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:13.886060 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.885989 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:13.886060 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.886051 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:51:29.886036916 +0000 UTC m=+35.735456736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:13.986976 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:13.986945 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:13.987160 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.987103 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:13.987160 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.987122 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:13.987160 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.987133 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:13.987318 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:13.987191 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:51:29.987172739 +0000 UTC m=+35.836592561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:14.121007 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:14.120927 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:14.121172 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:14.121055 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:14.121172 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:14.121115 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:14.121276 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:14.121245 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:15.121401 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:15.121373 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:15.121806 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:15.121495 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:16.121811 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:16.121745 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:16.122169 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:16.121826 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:16.122169 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:16.121902 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:16.122169 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:16.121983 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:17.121940 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.121569 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:17.122640 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:17.122041 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:17.217556 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.217487 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" event={"ID":"49f41607-1eef-4e4c-b486-859090092b6b","Type":"ContainerStarted","Data":"00071768391a77026afbe9575f828efa54aa40c237da97543ee8c5618a29d3f3"} Sep 18 14:51:17.218905 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.218876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h97zl" event={"ID":"84daa28e-6647-4732-a07b-bbb87c80e34c","Type":"ContainerStarted","Data":"af40071e98439df58977ab62cb6660e0e849dbcfbb38c63b8d835f6af71a2e45"} Sep 18 14:51:17.220345 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.220323 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="8910aa2061d69e84f96bfd464c9938e20db35a5ce5a6be53a02534961d071aff" exitCode=0 Sep 18 14:51:17.220447 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.220390 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"8910aa2061d69e84f96bfd464c9938e20db35a5ce5a6be53a02534961d071aff"} Sep 18 14:51:17.221885 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.221866 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smzwk" event={"ID":"428a1e96-15d7-414c-87a9-1f14c5dd253b","Type":"ContainerStarted","Data":"3964a702c0e05366b305a45dca33b5c4ad10368bf73e68f290b1e938c892afc2"} Sep 18 14:51:17.224742 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.224724 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:51:17.225074 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225057 2548 generic.go:356] "Generic (PLEG): container finished" podID="02709818-a206-4a14-80de-a59db838b9de" containerID="93c6dc5a126106ec18f63592000f2b60f4773328a56af62413df80b6a03119c5" exitCode=1 Sep 18 14:51:17.225160 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225124 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"b1ec6c30c65a6fddbbc6a52bbe36bf929df46901015632e4110de33f78d06483"} Sep 18 14:51:17.225205 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225190 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"6ab299f0cb5434bcce7d454b938b0512108813dd6b5423be45a9b3a646ef45ab"} Sep 18 14:51:17.225254 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225239 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"45f335e4b5bd68506758b35cb54c5db6f98d851e8306245906a5bbe185710224"} Sep 18 14:51:17.225305 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225291 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"264cd8b897d40fe2f28585624bc4ed043b5d17a3d7e85873b192574ab055f3ac"} Sep 18 14:51:17.225351 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225341 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerDied","Data":"93c6dc5a126106ec18f63592000f2b60f4773328a56af62413df80b6a03119c5"} Sep 18 14:51:17.225418 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.225391 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"1ca99f0241a70a710bda89923a763c053427d1c8f969a796afe7251011359032"} Sep 18 14:51:17.226557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.226535 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf86k" event={"ID":"29802ef6-1a51-4063-b6c6-b6493c950c9c","Type":"ContainerStarted","Data":"47d163b4ae16a73aab9a0ac1cdc6e9e0c9547c4cc04b0543f7ffb7e16258d585"} Sep 18 14:51:17.227870 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.227830 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" event={"ID":"0b5adfda-73dd-42f6-9d1e-05163ba78cf3","Type":"ContainerStarted","Data":"9dd4a6b3f0c24921e8f0395fec306d46b8fde7600db1d76d98717cf8c37e0804"} Sep 18 14:51:17.229128 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.229109 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scckj" event={"ID":"9bb635d6-8336-43d2-b3ff-fe6ad04b453c","Type":"ContainerStarted","Data":"0208357bd4d5e80b45de430b8b0e8ab46e6bc0c235a67ce1d6373bdd6b3d8b71"} Sep 18 14:51:17.261735 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.261698 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-scckj" podStartSLOduration=8.171362143 podStartE2EDuration="21.261686215s" totalImagesPullingTime="13.090324072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:17.261558663 +0000 UTC m=+23.110978504" watchObservedRunningTime="2026-09-18 14:51:17.261686215 +0000 UTC m=+23.111106056" Sep 18 14:51:17.262039 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.262018 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h97zl" podStartSLOduration=3.883701533 podStartE2EDuration="21.262012419s" totalImagesPullingTime="17.378310886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:17.242920398 +0000 UTC m=+23.092340237" watchObservedRunningTime="2026-09-18 14:51:17.262012419 +0000 UTC m=+23.111432261" Sep 18 14:51:17.300304 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.300269 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-smzwk" podStartSLOduration=3.9658910179999998 podStartE2EDuration="21.300259094s" totalImagesPullingTime="17.334368076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:17.282204106 +0000 UTC m=+23.131623947" watchObservedRunningTime="2026-09-18 14:51:17.300259094 +0000 UTC m=+23.149678937" Sep 18 14:51:17.300374 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.300326 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xf86k" podStartSLOduration=3.9644829660000003 podStartE2EDuration="21.300321551s" totalImagesPullingTime="17.335838585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:17.299957036 +0000 UTC m=+23.149376890" watchObservedRunningTime="2026-09-18 14:51:17.300321551 +0000 UTC m=+23.149741393" Sep 18 14:51:17.620965 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:17.620941 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 14:51:18.106353 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.106321 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:51:18.106998 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.106974 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:51:18.120916 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.120893 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:18.121041 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:18.120999 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:18.121162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.120902 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:18.121266 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:18.121240 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:18.122981 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.122891 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T14:51:17.620961483Z","UUID":"f7de481c-36c8-4434-8a72-2215f90ea8c1","Handler":null,"Name":"","Endpoint":""} Sep 18 14:51:18.124755 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.124735 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 14:51:18.124879 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.124770 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 14:51:18.147801 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.147761 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nvsnt" podStartSLOduration=4.818340709 podStartE2EDuration="22.147746154s" totalImagesPullingTime="17.329405445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:17.342611327 +0000 UTC m=+23.192031162" watchObservedRunningTime="2026-09-18 14:51:18.147746154 +0000 UTC m=+23.997165997" Sep 18 14:51:18.234083 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.234039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj8dv" event={"ID":"5f678feb-8eb4-4bb2-9170-c4cc59822b7e","Type":"ContainerStarted","Data":"b9801ccd5d89c54528749687b4b5df88e76186319f66ec5608a481ee197fc457"} Sep 18 14:51:18.237579 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.237298 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" event={"ID":"49f41607-1eef-4e4c-b486-859090092b6b","Type":"ContainerStarted","Data":"2adc04a9e53e22a8da232d1038ae6cd943061c3296918125ee25df32102f721d"} Sep 18 14:51:18.238115 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.237859 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:51:18.238115 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.238086 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-scckj" Sep 18 14:51:18.331031 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:18.330987 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pj8dv" podStartSLOduration=5.025692379 podStartE2EDuration="22.330973245s" totalImagesPullingTime="17.305280866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:18.284461781 +0000 UTC m=+24.133881624" watchObservedRunningTime="2026-09-18 14:51:18.330973245 +0000 UTC m=+24.180393087" Sep 18 14:51:19.121586 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:19.121381 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:19.121717 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:19.121695 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:19.245543 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:19.245478 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:51:19.245933 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:19.245893 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"da02fccea9046f8ba88c74fb2920d7402ade7ec28859f6f086e4ed504c5cd350"} Sep 18 14:51:19.248320 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:19.248295 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" event={"ID":"49f41607-1eef-4e4c-b486-859090092b6b","Type":"ContainerStarted","Data":"6ac55ff16ac1fc53fd9d34200868137d3662c0ded01639f036ca5fddf9f4e980"} Sep 18 14:51:19.276347 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:19.276294 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7grmj" podStartSLOduration=3.951943145 podStartE2EDuration="23.27627518s" totalImagesPullingTime="19.324332035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:19.275372756 +0000 UTC m=+25.124792581" watchObservedRunningTime="2026-09-18 14:51:19.27627518 +0000 UTC m=+25.125695023" Sep 18 14:51:20.121264 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:20.121230 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:20.121454 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:20.121349 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:20.121454 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:20.121410 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:20.121567 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:20.121528 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:21.120778 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.120755 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:21.121140 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:21.120866 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:21.258041 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.257775 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:51:21.258495 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.258261 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"7fbdd40f51ecd167dab3ec70c0c51dff95c83e9fd866b28197235f1d2fbb5286"} Sep 18 14:51:21.258738 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.258516 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:21.258738 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.258689 2548 scope.go:117] "RemoveContainer" containerID="93c6dc5a126106ec18f63592000f2b60f4773328a56af62413df80b6a03119c5" Sep 18 14:51:21.273427 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:21.273410 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:22.121381 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.121203 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:22.122028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.121281 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:22.122028 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:22.121462 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:22.122028 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:22.121551 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:22.262133 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.262105 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="398e19ac683de27d4000f52eabeaa125f0696a0a0106baff9e4a67b5fa285328" exitCode=0 Sep 18 14:51:22.262260 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.262184 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"398e19ac683de27d4000f52eabeaa125f0696a0a0106baff9e4a67b5fa285328"} Sep 18 14:51:22.266164 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.266150 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:51:22.266540 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.266520 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" event={"ID":"02709818-a206-4a14-80de-a59db838b9de","Type":"ContainerStarted","Data":"84bd7dc2c865466011640166f829482a883abc8fa36b4ccfed8ec209f76b22fc"} Sep 18 14:51:22.266717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.266700 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:22.266774 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.266763 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:22.281899 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.281878 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:22.310694 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:22.310655 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" podStartSLOduration=8.930620764 podStartE2EDuration="26.310642804s" totalImagesPullingTime="17.38002204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:22.308997568 +0000 UTC m=+28.158417410" watchObservedRunningTime="2026-09-18 14:51:22.310642804 +0000 UTC m=+28.160062686" Sep 18 14:51:23.092208 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.092180 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvd62"] Sep 18 14:51:23.092346 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.092268 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:23.092392 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:23.092367 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:23.096341 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.096301 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9wc9"] Sep 18 14:51:23.096449 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.096409 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:23.096529 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:23.096512 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:23.096968 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.096947 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnvbc"] Sep 18 14:51:23.097069 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:23.097056 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:23.097171 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:23.097154 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:24.273090 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:24.272827 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="9d5e364f6553335d92b8d86ad9da47e28676cafba441ac259b07a57fbf14bc13" exitCode=0 Sep 18 14:51:24.273539 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:24.272918 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"9d5e364f6553335d92b8d86ad9da47e28676cafba441ac259b07a57fbf14bc13"} Sep 18 14:51:25.121421 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:25.121394 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:25.121421 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:25.121425 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:25.121654 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:25.121394 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:25.121654 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:25.121486 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:25.121654 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:25.121601 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:25.121790 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:25.121702 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:26.279170 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:26.279142 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="e52f5778ab113bfa7c03621907302a875d597243ec6f776205e1a76151d5b9e0" exitCode=0 Sep 18 14:51:26.279646 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:26.279178 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"e52f5778ab113bfa7c03621907302a875d597243ec6f776205e1a76151d5b9e0"} Sep 18 14:51:27.121396 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:27.121337 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:27.121396 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:27.121384 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:27.121682 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:27.121443 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:27.121682 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:27.121464 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:27.121682 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:27.121538 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:27.121682 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:27.121602 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:29.120670 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.120630 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:29.121284 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.120753 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:29.121284 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.120764 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9wc9" podUID="0fa25a9d-2606-4009-8289-f3d65d9d9274" Sep 18 14:51:29.121284 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.120792 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:29.121284 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.120897 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvd62" podUID="bbcd561b-9ab5-46ad-a0dc-27770a687b9d" Sep 18 14:51:29.121284 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.121002 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnvbc" podUID="bc5e545b-5a92-49c1-b638-50214247ce43" Sep 18 14:51:29.145547 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.145485 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeReady" Sep 18 14:51:29.145676 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.145623 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 14:51:29.205753 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.205729 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:51:29.236402 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.236365 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zpsdd"] Sep 18 14:51:29.236717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.236684 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.239758 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.239738 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rnh8n\"" Sep 18 14:51:29.239900 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.239773 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 14:51:29.240134 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.240112 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 14:51:29.241031 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.241012 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 14:51:29.249162 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.249142 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 14:51:29.252546 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.252530 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w74qv"] Sep 18 14:51:29.252676 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.252654 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.255612 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.255587 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 14:51:29.255711 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.255650 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rx7lv\"" Sep 18 14:51:29.255711 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.255685 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 14:51:29.274435 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.274416 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:51:29.274539 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.274464 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.274539 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.274479 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zpsdd"] Sep 18 14:51:29.274539 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.274509 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w74qv"] Sep 18 14:51:29.277219 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.277191 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-44nxd\"" Sep 18 14:51:29.277219 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.277204 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 14:51:29.277404 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.277348 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 14:51:29.277959 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.277943 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 14:51:29.399555 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399494 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.399555 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399523 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.399742 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399559 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.399742 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399584 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-859fb\" (UniqueName: \"kubernetes.io/projected/b13b134d-c0b9-4f32-be84-37210ba95417-kube-api-access-859fb\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.399742 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399652 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.399742 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399732 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8bw\" (UniqueName: \"kubernetes.io/projected/cd48db29-6dfe-4443-a916-daa8d44a82af-kube-api-access-xc8bw\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.399941 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399768 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.399941 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd48db29-6dfe-4443-a916-daa8d44a82af-config-volume\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.399941 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399805 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd48db29-6dfe-4443-a916-daa8d44a82af-tmp-dir\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.399941 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.399941 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399905 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj96b\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.400177 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.399985 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.400177 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.400037 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13b134d-c0b9-4f32-be84-37210ba95417-cert\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.400177 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.400066 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501020 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.500992 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501181 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501039 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13b134d-c0b9-4f32-be84-37210ba95417-cert\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.501181 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501066 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501294 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501190 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501294 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501232 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.501294 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501278 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501306 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-859fb\" (UniqueName: \"kubernetes.io/projected/b13b134d-c0b9-4f32-be84-37210ba95417-kube-api-access-859fb\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.501445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501357 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501445 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.501424 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501454 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.501499 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:51:30.001479132 +0000 UTC m=+35.850898954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8bw\" (UniqueName: \"kubernetes.io/projected/cd48db29-6dfe-4443-a916-daa8d44a82af-kube-api-access-xc8bw\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501557 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501580 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd48db29-6dfe-4443-a916-daa8d44a82af-config-volume\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.501605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501602 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd48db29-6dfe-4443-a916-daa8d44a82af-tmp-dir\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.501944 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501626 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501944 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501669 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj96b\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.501944 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.501812 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.502089 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.502052 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:29.502089 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.502065 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:29.502188 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.502106 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:51:30.002092187 +0000 UTC m=+35.851512030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:29.502188 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.502120 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd48db29-6dfe-4443-a916-daa8d44a82af-tmp-dir\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.502482 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.502460 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.502570 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.502536 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd48db29-6dfe-4443-a916-daa8d44a82af-config-volume\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.505630 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.505606 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.505630 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.505620 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b13b134d-c0b9-4f32-be84-37210ba95417-cert\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.506068 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.506052 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.514554 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.514513 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.514933 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.514906 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-859fb\" (UniqueName: \"kubernetes.io/projected/b13b134d-c0b9-4f32-be84-37210ba95417-kube-api-access-859fb\") pod \"ingress-canary-w74qv\" (UID: \"b13b134d-c0b9-4f32-be84-37210ba95417\") " pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.515112 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.515076 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj96b\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:29.515112 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.515091 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8bw\" (UniqueName: \"kubernetes.io/projected/cd48db29-6dfe-4443-a916-daa8d44a82af-kube-api-access-xc8bw\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:29.583739 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.583703 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w74qv" Sep 18 14:51:29.803705 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.803673 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:29.803937 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.803800 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:29.803937 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.803881 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs podName:bc5e545b-5a92-49c1-b638-50214247ce43 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:01.80385895 +0000 UTC m=+67.653278782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs") pod "network-metrics-daemon-qnvbc" (UID: "bc5e545b-5a92-49c1-b638-50214247ce43") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 14:51:29.904882 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:29.904836 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:29.905030 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.904982 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:29.905089 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:29.905044 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret podName:0fa25a9d-2606-4009-8289-f3d65d9d9274 nodeName:}" failed. No retries permitted until 2026-09-18 14:52:01.905028465 +0000 UTC m=+67.754448289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret") pod "global-pull-secret-syncer-s9wc9" (UID: "0fa25a9d-2606-4009-8289-f3d65d9d9274") : object "kube-system"/"original-pull-secret" not registered Sep 18 14:51:30.006186 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:30.006155 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:30.006365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:30.006242 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:30.006365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:30.006285 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:30.006365 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006319 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:30.006365 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006344 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006393 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006406 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006428 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006439 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nf2kz for pod openshift-network-diagnostics/network-check-target-nvd62: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006409 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:51:31.006389429 +0000 UTC m=+36.855809269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006513 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:51:31.006498694 +0000 UTC m=+36.855918523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:30.006565 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:30.006530 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz podName:bbcd561b-9ab5-46ad-a0dc-27770a687b9d nodeName:}" failed. No retries permitted until 2026-09-18 14:52:02.006520331 +0000 UTC m=+67.855940159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nf2kz" (UniqueName: "kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz") pod "network-check-target-nvd62" (UID: "bbcd561b-9ab5-46ad-a0dc-27770a687b9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 14:51:30.657828 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:30.657611 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w74qv"] Sep 18 14:51:30.662245 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:51:30.662219 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13b134d_c0b9_4f32_be84_37210ba95417.slice/crio-2fc4e857cba52eec8cc4cdd85648ce5c80bff3915856c9e8954bae9bb4d3fec2 WatchSource:0}: Error finding container 2fc4e857cba52eec8cc4cdd85648ce5c80bff3915856c9e8954bae9bb4d3fec2: Status 404 returned error can't find the container with id 2fc4e857cba52eec8cc4cdd85648ce5c80bff3915856c9e8954bae9bb4d3fec2 Sep 18 14:51:31.013172 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.013142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:31.013310 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.013201 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:31.013310 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:31.013283 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:31.013310 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:31.013288 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:31.013310 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:31.013304 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:31.013456 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:31.013333 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:51:33.013319755 +0000 UTC m=+38.862739576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:31.013456 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:31.013346 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:51:33.013340332 +0000 UTC m=+38.862760152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:31.120832 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.120807 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:51:31.121002 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.120934 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:51:31.121002 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.120969 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:51:31.123724 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.123702 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:51:31.124837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.124656 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:51:31.124837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.124663 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cjrmt\"" Sep 18 14:51:31.124837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.124713 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdtc\"" Sep 18 14:51:31.124837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.124659 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:51:31.124837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.124720 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:51:31.295258 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.295179 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="816a58d7f1d4f76d294ac692ecdd1c5697310bcad5ddd396492a7dbce360da0d" exitCode=0 Sep 18 14:51:31.295422 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.295256 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"816a58d7f1d4f76d294ac692ecdd1c5697310bcad5ddd396492a7dbce360da0d"} Sep 18 14:51:31.296624 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:31.296599 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w74qv" event={"ID":"b13b134d-c0b9-4f32-be84-37210ba95417","Type":"ContainerStarted","Data":"2fc4e857cba52eec8cc4cdd85648ce5c80bff3915856c9e8954bae9bb4d3fec2"} Sep 18 14:51:32.302731 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:32.302699 2548 generic.go:356] "Generic (PLEG): container finished" podID="fc965755-516b-4f4c-af7c-eac391af7854" containerID="72a16851e0e7c0b996d53e1c0a58002e97c4e1a45c7f96990e0f5a14ea80cc14" exitCode=0 Sep 18 14:51:32.303128 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:32.302757 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerDied","Data":"72a16851e0e7c0b996d53e1c0a58002e97c4e1a45c7f96990e0f5a14ea80cc14"} Sep 18 14:51:33.029960 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.029772 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.029995 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:33.029930 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:33.030032 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:33.030080 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:33.030084 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:51:37.030068389 +0000 UTC m=+42.879488213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:33.030135 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:33.030125 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:51:37.03011381 +0000 UTC m=+42.879533631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:33.308439 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.308375 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" event={"ID":"fc965755-516b-4f4c-af7c-eac391af7854","Type":"ContainerStarted","Data":"b4e52db0035974d97336961412b81e31f5770a14c1b2149cb3c7988ca5c368b4"} Sep 18 14:51:33.309894 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.309872 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w74qv" event={"ID":"b13b134d-c0b9-4f32-be84-37210ba95417","Type":"ContainerStarted","Data":"afba5654fdff1d8e7e6dc22a7739fe90df08da7c6f46cb58668d2fb963a4be8a"} Sep 18 14:51:33.336767 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.336724 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r2hh2" podStartSLOduration=9.454627262 podStartE2EDuration="37.336707747s" totalImagesPullingTime="27.882080485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:33.335461758 +0000 UTC m=+39.184881596" watchObservedRunningTime="2026-09-18 14:51:33.336707747 +0000 UTC m=+39.186127603" Sep 18 14:51:33.353998 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:33.353961 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w74qv" podStartSLOduration=2.395981212 podStartE2EDuration="4.353948317s" totalImagesPullingTime="1.957967105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:33.353358728 +0000 UTC m=+39.202778571" watchObservedRunningTime="2026-09-18 14:51:33.353948317 +0000 UTC m=+39.203368162" Sep 18 14:51:37.055711 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:37.055671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:37.055733 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:37.055823 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:37.055858 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:37.055909 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:51:45.055893686 +0000 UTC m=+50.905313505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:37.055828 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:37.056157 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:37.055970 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:51:45.055955438 +0000 UTC m=+50.905375260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:39.116323 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.116293 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fsrss"] Sep 18 14:51:39.119317 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.119303 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.122359 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.122330 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 14:51:39.122489 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.122339 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 14:51:39.123500 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.123482 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zs65q\"" Sep 18 14:51:39.123500 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.123494 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 14:51:39.123652 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.123496 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 14:51:39.129557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.129539 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fsrss"] Sep 18 14:51:39.270355 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.270327 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/036734da-67ad-44f8-bf6f-e81a8afd441b-data-volume\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.270502 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.270369 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/036734da-67ad-44f8-bf6f-e81a8afd441b-crio-socket\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.270502 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.270397 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.270502 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.270424 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.270502 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.270444 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xzz\" (UniqueName: \"kubernetes.io/projected/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-api-access-27xzz\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.317396 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.317371 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h"] Sep 18 14:51:39.322211 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.322192 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" Sep 18 14:51:39.324837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.324815 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 14:51:39.324947 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.324815 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2pt2g\"" Sep 18 14:51:39.324947 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.324823 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 14:51:39.329792 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.329773 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h"] Sep 18 14:51:39.371555 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371504 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/036734da-67ad-44f8-bf6f-e81a8afd441b-data-volume\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371555 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371544 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/036734da-67ad-44f8-bf6f-e81a8afd441b-crio-socket\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371673 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371569 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371673 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371594 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371673 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371611 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xzz\" (UniqueName: \"kubernetes.io/projected/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-api-access-27xzz\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371673 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.371645 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:39.371818 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.371712 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:39.871693507 +0000 UTC m=+45.721113346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : configmap "kube-rbac-proxy" not found Sep 18 14:51:39.371818 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371732 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/036734da-67ad-44f8-bf6f-e81a8afd441b-crio-socket\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.371818 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.371738 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:39.371818 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.371794 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:39.871782689 +0000 UTC m=+45.721202545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:39.371978 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.371871 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/036734da-67ad-44f8-bf6f-e81a8afd441b-data-volume\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.381741 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.381714 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xzz\" (UniqueName: \"kubernetes.io/projected/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-api-access-27xzz\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.472004 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.471973 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcbd\" (UniqueName: \"kubernetes.io/projected/62f807c6-8ad7-4703-b556-7db93fee1543-kube-api-access-jxcbd\") pod \"migrator-76794cbd6c-g8w9h\" (UID: \"62f807c6-8ad7-4703-b556-7db93fee1543\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" Sep 18 14:51:39.572396 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.572365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcbd\" (UniqueName: \"kubernetes.io/projected/62f807c6-8ad7-4703-b556-7db93fee1543-kube-api-access-jxcbd\") pod \"migrator-76794cbd6c-g8w9h\" (UID: \"62f807c6-8ad7-4703-b556-7db93fee1543\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" Sep 18 14:51:39.580245 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.580218 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcbd\" (UniqueName: \"kubernetes.io/projected/62f807c6-8ad7-4703-b556-7db93fee1543-kube-api-access-jxcbd\") pod \"migrator-76794cbd6c-g8w9h\" (UID: \"62f807c6-8ad7-4703-b556-7db93fee1543\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" Sep 18 14:51:39.631129 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.631082 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" Sep 18 14:51:39.874348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.874315 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.874474 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.874353 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:39.874474 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.874438 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:39.874550 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.874523 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:40.874504849 +0000 UTC m=+46.723924689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : configmap "kube-rbac-proxy" not found Sep 18 14:51:39.874550 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.874528 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:39.874665 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:39.874581 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:40.874565917 +0000 UTC m=+46.723985742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:39.902765 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:39.902704 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h"] Sep 18 14:51:39.905894 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:51:39.905867 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f807c6_8ad7_4703_b556_7db93fee1543.slice/crio-8f70a55600a1194ff9eaeaac0b8e77e9cf9a9e5bcf06c7d369ffcc2efafb619f WatchSource:0}: Error finding container 8f70a55600a1194ff9eaeaac0b8e77e9cf9a9e5bcf06c7d369ffcc2efafb619f: Status 404 returned error can't find the container with id 8f70a55600a1194ff9eaeaac0b8e77e9cf9a9e5bcf06c7d369ffcc2efafb619f Sep 18 14:51:40.326537 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:40.326506 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" event={"ID":"62f807c6-8ad7-4703-b556-7db93fee1543","Type":"ContainerStarted","Data":"8f70a55600a1194ff9eaeaac0b8e77e9cf9a9e5bcf06c7d369ffcc2efafb619f"} Sep 18 14:51:40.674338 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:40.674314 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smzwk_428a1e96-15d7-414c-87a9-1f14c5dd253b/dns-node-resolver/0.log" Sep 18 14:51:40.882649 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:40.882615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:40.882649 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:40.882651 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:40.882881 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:40.882742 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:40.882881 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:40.882756 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:40.882881 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:40.882820 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:42.882800779 +0000 UTC m=+48.732220601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : configmap "kube-rbac-proxy" not found Sep 18 14:51:40.882881 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:40.882840 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:42.882831576 +0000 UTC m=+48.732251396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:41.658464 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.658438 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krzqt"] Sep 18 14:51:41.676639 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.676622 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf86k_29802ef6-1a51-4063-b6c6-b6493c950c9c/node-ca/0.log" Sep 18 14:51:41.682049 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.682030 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krzqt"] Sep 18 14:51:41.682137 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.682116 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.685088 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.685067 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 14:51:41.685170 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.685137 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wlrjp\"" Sep 18 14:51:41.686010 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.685988 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 14:51:41.686010 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.686001 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 14:51:41.686227 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.686211 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 14:51:41.687152 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.687135 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-cabundle\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.687232 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.687199 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84k6\" (UniqueName: \"kubernetes.io/projected/abc63ded-3854-412b-9b4c-8f4263d241c3-kube-api-access-l84k6\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.687282 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.687244 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-key\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.787835 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.787774 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84k6\" (UniqueName: \"kubernetes.io/projected/abc63ded-3854-412b-9b4c-8f4263d241c3-kube-api-access-l84k6\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.787964 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.787835 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-key\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.787964 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.787920 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-cabundle\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.788484 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.788466 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-cabundle\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.790148 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.790131 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abc63ded-3854-412b-9b4c-8f4263d241c3-signing-key\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.795613 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.795595 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84k6\" (UniqueName: \"kubernetes.io/projected/abc63ded-3854-412b-9b4c-8f4263d241c3-kube-api-access-l84k6\") pod \"service-ca-55f6fc7b86-krzqt\" (UID: \"abc63ded-3854-412b-9b4c-8f4263d241c3\") " pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:41.990566 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:41.990536 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" Sep 18 14:51:42.273150 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.273125 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-krzqt"] Sep 18 14:51:42.275800 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:51:42.275772 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc63ded_3854_412b_9b4c_8f4263d241c3.slice/crio-9a49bc7f04cee7d11d94e57b1610abc3a1ec7e67de3fbd6b0246735466e777fa WatchSource:0}: Error finding container 9a49bc7f04cee7d11d94e57b1610abc3a1ec7e67de3fbd6b0246735466e777fa: Status 404 returned error can't find the container with id 9a49bc7f04cee7d11d94e57b1610abc3a1ec7e67de3fbd6b0246735466e777fa Sep 18 14:51:42.332822 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.332755 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" event={"ID":"62f807c6-8ad7-4703-b556-7db93fee1543","Type":"ContainerStarted","Data":"a29ece7dc05e1cd178b9bc26852ac3321758152647a85876ea32be7ac2d1cb42"} Sep 18 14:51:42.332914 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.332825 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" event={"ID":"62f807c6-8ad7-4703-b556-7db93fee1543","Type":"ContainerStarted","Data":"347d548fd620805a911a0dcc00926c4aad0a1ba520f6462fb2d9af02f69839cd"} Sep 18 14:51:42.333931 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.333914 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" event={"ID":"abc63ded-3854-412b-9b4c-8f4263d241c3","Type":"ContainerStarted","Data":"9a49bc7f04cee7d11d94e57b1610abc3a1ec7e67de3fbd6b0246735466e777fa"} Sep 18 14:51:42.350328 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.350287 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-g8w9h" podStartSLOduration=1.8943086 podStartE2EDuration="3.350274864s" totalImagesPullingTime="1.455966264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:42.349638949 +0000 UTC m=+48.199058790" watchObservedRunningTime="2026-09-18 14:51:42.350274864 +0000 UTC m=+48.199694753" Sep 18 14:51:42.478358 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.478237 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w74qv_b13b134d-c0b9-4f32-be84-37210ba95417/serve-healthcheck-canary/0.log" Sep 18 14:51:42.895971 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.895926 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:42.896373 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:42.895981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:42.896373 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:42.896075 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 14:51:42.896373 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:42.896125 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:42.896373 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:42.896158 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:46.896136588 +0000 UTC m=+52.745556424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : configmap "kube-rbac-proxy" not found Sep 18 14:51:42.896373 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:42.896176 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:46.896164569 +0000 UTC m=+52.745584417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:45.113895 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:45.113862 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:45.113958 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:45.114020 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:45.114044 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:45.114056 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf48d778c-dsz9s: secret "image-registry-tls" not found Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:45.114089 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls podName:cd48db29-6dfe-4443-a916-daa8d44a82af nodeName:}" failed. No retries permitted until 2026-09-18 14:52:01.114070161 +0000 UTC m=+66.963489988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls") pod "dns-default-zpsdd" (UID: "cd48db29-6dfe-4443-a916-daa8d44a82af") : secret "dns-default-metrics-tls" not found Sep 18 14:51:45.114262 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:45.114105 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls podName:741de162-8b82-4ea7-9abf-51135f28ddaa nodeName:}" failed. No retries permitted until 2026-09-18 14:52:01.114098411 +0000 UTC m=+66.963518234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls") pod "image-registry-5bf48d778c-dsz9s" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa") : secret "image-registry-tls" not found Sep 18 14:51:45.343426 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:45.343384 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" event={"ID":"abc63ded-3854-412b-9b4c-8f4263d241c3","Type":"ContainerStarted","Data":"8d5de16c305a813562c3b581e1a7dfc33c44b2ba49ad96344b370605f2b9ce4b"} Sep 18 14:51:45.366360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:45.366267 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-krzqt" podStartSLOduration=2.271740379 podStartE2EDuration="4.366251309s" totalImagesPullingTime="2.09451093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:51:45.365476379 +0000 UTC m=+51.214896219" watchObservedRunningTime="2026-09-18 14:51:45.366251309 +0000 UTC m=+51.215671188" Sep 18 14:51:46.927186 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:46.927154 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:46.927186 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:46.927189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:46.927636 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:46.927322 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:46.927636 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:46.927386 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:51:54.927369562 +0000 UTC m=+60.776789397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:51:46.927770 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:46.927748 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/036734da-67ad-44f8-bf6f-e81a8afd441b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:54.283089 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:54.283065 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvrdr" Sep 18 14:51:54.985711 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:51:54.985679 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:51:54.985925 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:54.985858 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 14:51:54.986003 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:51:54.985953 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls podName:036734da-67ad-44f8-bf6f-e81a8afd441b nodeName:}" failed. No retries permitted until 2026-09-18 14:52:10.985931171 +0000 UTC m=+76.835351005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fsrss" (UID: "036734da-67ad-44f8-bf6f-e81a8afd441b") : secret "insights-runtime-extractor-tls" not found Sep 18 14:52:01.130125 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.130091 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:01.130616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.130161 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:52:01.132507 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.132481 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd48db29-6dfe-4443-a916-daa8d44a82af-metrics-tls\") pod \"dns-default-zpsdd\" (UID: \"cd48db29-6dfe-4443-a916-daa8d44a82af\") " pod="openshift-dns/dns-default-zpsdd" Sep 18 14:52:01.132625 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.132533 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"image-registry-5bf48d778c-dsz9s\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:01.351794 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.351768 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rnh8n\"" Sep 18 14:52:01.359349 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.359332 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:01.366265 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.366250 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rx7lv\"" Sep 18 14:52:01.373605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.373584 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zpsdd" Sep 18 14:52:01.631634 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.631588 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:52:01.633955 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:01.633929 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741de162_8b82_4ea7_9abf_51135f28ddaa.slice/crio-03dacd1241165c6e5bd94e5fddea14526a0c986109f56b49adaf68ce57b43464 WatchSource:0}: Error finding container 03dacd1241165c6e5bd94e5fddea14526a0c986109f56b49adaf68ce57b43464: Status 404 returned error can't find the container with id 03dacd1241165c6e5bd94e5fddea14526a0c986109f56b49adaf68ce57b43464 Sep 18 14:52:01.647598 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.647534 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zpsdd"] Sep 18 14:52:01.650588 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:01.650563 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd48db29_6dfe_4443_a916_daa8d44a82af.slice/crio-4cb3fe958bdd43857e301cead4eb28659a7f992721a3dc7934a5a05244c71734 WatchSource:0}: Error finding container 4cb3fe958bdd43857e301cead4eb28659a7f992721a3dc7934a5a05244c71734: Status 404 returned error can't find the container with id 4cb3fe958bdd43857e301cead4eb28659a7f992721a3dc7934a5a05244c71734 Sep 18 14:52:01.835909 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.835872 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:52:01.838432 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.838414 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 14:52:01.848538 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.848512 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc5e545b-5a92-49c1-b638-50214247ce43-metrics-certs\") pod \"network-metrics-daemon-qnvbc\" (UID: \"bc5e545b-5a92-49c1-b638-50214247ce43\") " pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:52:01.938954 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.936635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:52:01.939567 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.939545 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 14:52:01.949945 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:01.949917 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa25a9d-2606-4009-8289-f3d65d9d9274-original-pull-secret\") pod \"global-pull-secret-syncer-s9wc9\" (UID: \"0fa25a9d-2606-4009-8289-f3d65d9d9274\") " pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:52:02.032494 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.032462 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9wc9" Sep 18 14:52:02.037529 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.037512 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:52:02.040274 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.040252 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 14:52:02.047043 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.047023 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdtc\"" Sep 18 14:52:02.050464 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.050444 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 14:52:02.054626 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.054606 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnvbc" Sep 18 14:52:02.060705 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.060677 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf2kz\" (UniqueName: \"kubernetes.io/projected/bbcd561b-9ab5-46ad-a0dc-27770a687b9d-kube-api-access-nf2kz\") pod \"network-check-target-nvd62\" (UID: \"bbcd561b-9ab5-46ad-a0dc-27770a687b9d\") " pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:52:02.302835 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.302766 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9wc9"] Sep 18 14:52:02.306203 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:02.306168 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa25a9d_2606_4009_8289_f3d65d9d9274.slice/crio-5d7944260431660027fd4e07f33e67f7ceddc38f75cc2fea3b908b4a9c5173ba WatchSource:0}: Error finding container 5d7944260431660027fd4e07f33e67f7ceddc38f75cc2fea3b908b4a9c5173ba: Status 404 returned error can't find the container with id 5d7944260431660027fd4e07f33e67f7ceddc38f75cc2fea3b908b4a9c5173ba Sep 18 14:52:02.323871 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.323836 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnvbc"] Sep 18 14:52:02.327151 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:02.327118 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5e545b_5a92_49c1_b638_50214247ce43.slice/crio-d9baceb0b8c817014552ebcabcfb69100fa840c13423e681d9bacb90c922b630 WatchSource:0}: Error finding container d9baceb0b8c817014552ebcabcfb69100fa840c13423e681d9bacb90c922b630: Status 404 returned error can't find the container with id d9baceb0b8c817014552ebcabcfb69100fa840c13423e681d9bacb90c922b630 Sep 18 14:52:02.341932 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.341909 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cjrmt\"" Sep 18 14:52:02.350124 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.350091 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:52:02.388574 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.388499 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnvbc" event={"ID":"bc5e545b-5a92-49c1-b638-50214247ce43","Type":"ContainerStarted","Data":"d9baceb0b8c817014552ebcabcfb69100fa840c13423e681d9bacb90c922b630"} Sep 18 14:52:02.390404 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.390370 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" event={"ID":"741de162-8b82-4ea7-9abf-51135f28ddaa","Type":"ContainerStarted","Data":"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477"} Sep 18 14:52:02.390521 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.390422 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" event={"ID":"741de162-8b82-4ea7-9abf-51135f28ddaa","Type":"ContainerStarted","Data":"03dacd1241165c6e5bd94e5fddea14526a0c986109f56b49adaf68ce57b43464"} Sep 18 14:52:02.390975 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.390927 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:02.392379 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.392348 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpsdd" event={"ID":"cd48db29-6dfe-4443-a916-daa8d44a82af","Type":"ContainerStarted","Data":"4cb3fe958bdd43857e301cead4eb28659a7f992721a3dc7934a5a05244c71734"} Sep 18 14:52:02.393779 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.393753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9wc9" event={"ID":"0fa25a9d-2606-4009-8289-f3d65d9d9274","Type":"ContainerStarted","Data":"5d7944260431660027fd4e07f33e67f7ceddc38f75cc2fea3b908b4a9c5173ba"} Sep 18 14:52:02.414068 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.413972 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" podStartSLOduration=49.413949654 podStartE2EDuration="49.413949654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:02.41316908 +0000 UTC m=+68.262588922" watchObservedRunningTime="2026-09-18 14:52:02.413949654 +0000 UTC m=+68.263369496" Sep 18 14:52:02.625974 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.625566 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvd62"] Sep 18 14:52:02.627943 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:02.627908 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcd561b_9ab5_46ad_a0dc_27770a687b9d.slice/crio-08e4e779c349f7e0b62b6cc8684c0d7c94293806810deb48d43b09d62d9dbcab WatchSource:0}: Error finding container 08e4e779c349f7e0b62b6cc8684c0d7c94293806810deb48d43b09d62d9dbcab: Status 404 returned error can't find the container with id 08e4e779c349f7e0b62b6cc8684c0d7c94293806810deb48d43b09d62d9dbcab Sep 18 14:52:02.894468 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.893413 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg"] Sep 18 14:52:02.895864 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.895581 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:02.899186 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.899131 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 14:52:02.900348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.900322 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 14:52:02.900463 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.900343 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 14:52:02.900639 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.900624 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cq8dx\"" Sep 18 14:52:02.900722 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.900692 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 14:52:02.903287 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.902958 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx"] Sep 18 14:52:02.905799 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.905272 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.908474 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.908224 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 14:52:02.909068 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.909049 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 14:52:02.911230 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.910640 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg"] Sep 18 14:52:02.911230 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.910735 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 14:52:02.911230 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.911080 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 14:52:02.933330 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.933308 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx"] Sep 18 14:52:02.938994 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.938973 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:52:02.944867 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.944827 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.944969 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.944881 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.944969 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.944916 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.945088 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.945043 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2h6\" (UniqueName: \"kubernetes.io/projected/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-kube-api-access-sf2h6\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.945141 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.945100 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:02.945197 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.945139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.945197 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.945168 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:02.945299 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.945223 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfzq6\" (UniqueName: \"kubernetes.io/projected/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-kube-api-access-qfzq6\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:02.994332 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.994288 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-656d786556-4gkz5"] Sep 18 14:52:02.996333 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:02.996313 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.018607 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.018564 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656d786556-4gkz5"] Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046383 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-image-registry-private-configuration\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046442 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2h6\" (UniqueName: \"kubernetes.io/projected/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-kube-api-access-sf2h6\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046533 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046582 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-bound-sa-token\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046612 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046655 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfzq6\" (UniqueName: \"kubernetes.io/projected/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-kube-api-access-qfzq6\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046734 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-trusted-ca\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsl59\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-kube-api-access-bsl59\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046800 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046891 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046941 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/066debd8-ab31-439b-ac2b-7aada7ed5586-ca-trust-extracted\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.046974 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-installation-pull-secrets\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047056 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.047007 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-certificates\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047984 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.047037 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-tls\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.047984 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.047354 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.049892 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.049871 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:03.050092 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.050056 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.050435 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.050393 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.051141 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.051112 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.051227 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.051143 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-ca\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.056260 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.056221 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2h6\" (UniqueName: \"kubernetes.io/projected/c08b3d1d-1c35-4e5f-be46-dd47dc6535bf-kube-api-access-sf2h6\") pod \"cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx\" (UID: \"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.062922 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.062898 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfzq6\" (UniqueName: \"kubernetes.io/projected/cf74d529-10f3-4fd5-9d6e-8e934b2b6bea-kube-api-access-qfzq6\") pod \"managed-serviceaccount-addon-agent-6dc9d877b4-7bffg\" (UID: \"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:03.147899 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.147809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/066debd8-ab31-439b-ac2b-7aada7ed5586-ca-trust-extracted\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.147899 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.147875 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-installation-pull-secrets\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.147904 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-certificates\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.147937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-tls\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.147966 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-image-registry-private-configuration\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.148034 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-bound-sa-token\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.148065 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-trusted-ca\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.148088 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsl59\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-kube-api-access-bsl59\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.148428 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.148237 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/066debd8-ab31-439b-ac2b-7aada7ed5586-ca-trust-extracted\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.149159 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.149133 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-certificates\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.149268 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.149230 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/066debd8-ab31-439b-ac2b-7aada7ed5586-trusted-ca\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.151237 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.151196 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-registry-tls\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.151237 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.151226 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-image-registry-private-configuration\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.152221 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.152180 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/066debd8-ab31-439b-ac2b-7aada7ed5586-installation-pull-secrets\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.160866 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.160829 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-bound-sa-token\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.161360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.161341 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsl59\" (UniqueName: \"kubernetes.io/projected/066debd8-ab31-439b-ac2b-7aada7ed5586-kube-api-access-bsl59\") pod \"image-registry-656d786556-4gkz5\" (UID: \"066debd8-ab31-439b-ac2b-7aada7ed5586\") " pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.218000 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.217965 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" Sep 18 14:52:03.226799 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.226601 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" Sep 18 14:52:03.315096 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.315018 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:03.399636 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.399483 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvd62" event={"ID":"bbcd561b-9ab5-46ad-a0dc-27770a687b9d","Type":"ContainerStarted","Data":"08e4e779c349f7e0b62b6cc8684c0d7c94293806810deb48d43b09d62d9dbcab"} Sep 18 14:52:03.925295 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.925273 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656d786556-4gkz5"] Sep 18 14:52:03.929157 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:03.927941 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066debd8_ab31_439b_ac2b_7aada7ed5586.slice/crio-24f959e84f32929a651dfb9fa3e7f703fdb5035813df892ece9b431c0592d638 WatchSource:0}: Error finding container 24f959e84f32929a651dfb9fa3e7f703fdb5035813df892ece9b431c0592d638: Status 404 returned error can't find the container with id 24f959e84f32929a651dfb9fa3e7f703fdb5035813df892ece9b431c0592d638 Sep 18 14:52:03.957997 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.957941 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg"] Sep 18 14:52:03.962444 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:03.962391 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx"] Sep 18 14:52:03.973701 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:03.972108 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc08b3d1d_1c35_4e5f_be46_dd47dc6535bf.slice/crio-235a5e17eb1375c5931a6be373fdc4088f85c0c7ae7a49751261cafabafe1607 WatchSource:0}: Error finding container 235a5e17eb1375c5931a6be373fdc4088f85c0c7ae7a49751261cafabafe1607: Status 404 returned error can't find the container with id 235a5e17eb1375c5931a6be373fdc4088f85c0c7ae7a49751261cafabafe1607 Sep 18 14:52:04.407311 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.407263 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnvbc" event={"ID":"bc5e545b-5a92-49c1-b638-50214247ce43","Type":"ContainerStarted","Data":"fa920a6de993ca89f2c0f422c078f53826b9939b147d6a946e4ceb42775c28da"} Sep 18 14:52:04.407756 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.407345 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnvbc" event={"ID":"bc5e545b-5a92-49c1-b638-50214247ce43","Type":"ContainerStarted","Data":"0619982739c987be5b08cf3a3401e07a5bd023bea52a835cb3f96fd3725f0e18"} Sep 18 14:52:04.409922 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.409895 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpsdd" event={"ID":"cd48db29-6dfe-4443-a916-daa8d44a82af","Type":"ContainerStarted","Data":"9bb4653e00acfb6d8dcc2ab4b1c226292b029c06ebf904b0108eba8fc4769264"} Sep 18 14:52:04.410063 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.409946 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpsdd" event={"ID":"cd48db29-6dfe-4443-a916-daa8d44a82af","Type":"ContainerStarted","Data":"307c8ef00704ee56e9f1e29c355ee051a5ac47fd960ec03e6811a6a43c2d6bd6"} Sep 18 14:52:04.410463 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.410443 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zpsdd" Sep 18 14:52:04.412221 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.412036 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" event={"ID":"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf","Type":"ContainerStarted","Data":"235a5e17eb1375c5931a6be373fdc4088f85c0c7ae7a49751261cafabafe1607"} Sep 18 14:52:04.414106 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.414080 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656d786556-4gkz5" event={"ID":"066debd8-ab31-439b-ac2b-7aada7ed5586","Type":"ContainerStarted","Data":"0fed26c75d57d1f6aab9b31a5b6cc52ec913a58a8cf1622151387810b8c2fd6d"} Sep 18 14:52:04.414221 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.414129 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656d786556-4gkz5" event={"ID":"066debd8-ab31-439b-ac2b-7aada7ed5586","Type":"ContainerStarted","Data":"24f959e84f32929a651dfb9fa3e7f703fdb5035813df892ece9b431c0592d638"} Sep 18 14:52:04.414415 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.414327 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:04.415820 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.415786 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" event={"ID":"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea","Type":"ContainerStarted","Data":"ba232eb76b087666dc4fcd9ce42e4823e83339ec63024ffd9bea7d4f16aec9c3"} Sep 18 14:52:04.428632 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.428236 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qnvbc" podStartSLOduration=67.115457143 podStartE2EDuration="1m8.428218774s" totalImagesPullingTime="1.312761631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:04.427081093 +0000 UTC m=+70.276500936" watchObservedRunningTime="2026-09-18 14:52:04.428218774 +0000 UTC m=+70.277638616" Sep 18 14:52:04.495161 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.495105 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-656d786556-4gkz5" podStartSLOduration=2.49509112 podStartE2EDuration="2.49509112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:04.493914276 +0000 UTC m=+70.343334118" watchObservedRunningTime="2026-09-18 14:52:04.49509112 +0000 UTC m=+70.344510989" Sep 18 14:52:04.495425 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:04.495394 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zpsdd" podStartSLOduration=33.505800541 podStartE2EDuration="35.495382758s" totalImagesPullingTime="1.989582217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:04.473885181 +0000 UTC m=+70.323305027" watchObservedRunningTime="2026-09-18 14:52:04.495382758 +0000 UTC m=+70.344802600" Sep 18 14:52:10.443985 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.443934 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" event={"ID":"cf74d529-10f3-4fd5-9d6e-8e934b2b6bea","Type":"ContainerStarted","Data":"7673367a3f8ecfa4cec1d04025ef8f15f16e01340d640f328f855debe979b2e8"} Sep 18 14:52:10.446908 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.446881 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvd62" event={"ID":"bbcd561b-9ab5-46ad-a0dc-27770a687b9d","Type":"ContainerStarted","Data":"7cd2ae7d1149353e09579f92becdcbfebdc645b74ae8736b4ee8d8138f8400b7"} Sep 18 14:52:10.448725 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.448686 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" event={"ID":"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf","Type":"ContainerStarted","Data":"87421bae1ee048611bff051ea7509345cb3dfca7c91d0b2cc917508b7f222d5d"} Sep 18 14:52:10.448890 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.448768 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:52:10.469124 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.469074 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dc9d877b4-7bffg" podStartSLOduration=2.07728582 podStartE2EDuration="8.469051978s" totalImagesPullingTime="6.391766158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:10.467141905 +0000 UTC m=+76.316561747" watchObservedRunningTime="2026-09-18 14:52:10.469051978 +0000 UTC m=+76.318471823" Sep 18 14:52:10.489874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:10.489569 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nvd62" podStartSLOduration=66.770737136 podStartE2EDuration="1m14.489554473s" totalImagesPullingTime="7.718817337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:10.488516574 +0000 UTC m=+76.337936428" watchObservedRunningTime="2026-09-18 14:52:10.489554473 +0000 UTC m=+76.338974357" Sep 18 14:52:11.017122 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.017087 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:52:11.019396 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.019376 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/036734da-67ad-44f8-bf6f-e81a8afd441b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fsrss\" (UID: \"036734da-67ad-44f8-bf6f-e81a8afd441b\") " pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:52:11.230163 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.230137 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zs65q\"" Sep 18 14:52:11.238617 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.238602 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fsrss" Sep 18 14:52:11.458274 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.458242 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" event={"ID":"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf","Type":"ContainerStarted","Data":"69069ff9e24252e59f468848514146ed6688a8637ca705ed8cdcbae6de2762f9"} Sep 18 14:52:11.458668 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.458290 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" event={"ID":"c08b3d1d-1c35-4e5f-be46-dd47dc6535bf","Type":"ContainerStarted","Data":"3ac36f6f9383e12e733d33f9e718dacd3bc3a2d7fd126c14100a4526a187ef85"} Sep 18 14:52:11.459767 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.459739 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9wc9" event={"ID":"0fa25a9d-2606-4009-8289-f3d65d9d9274","Type":"ContainerStarted","Data":"73f960e3d19dc1ddc2f3077e21e0b5d9dbfef4b620bd703db86b38e049badfcc"} Sep 18 14:52:11.479929 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.479882 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74fc4dc4bb-fhnwx" podStartSLOduration=3.087877915 podStartE2EDuration="9.479862599s" totalImagesPullingTime="6.391984684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:11.479506465 +0000 UTC m=+77.328926306" watchObservedRunningTime="2026-09-18 14:52:11.479862599 +0000 UTC m=+77.329282442" Sep 18 14:52:11.495647 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.495608 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s9wc9" podStartSLOduration=67.456387533 podStartE2EDuration="1m15.495595953s" totalImagesPullingTime="8.03920842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:11.494876183 +0000 UTC m=+77.344296026" watchObservedRunningTime="2026-09-18 14:52:11.495595953 +0000 UTC m=+77.345015797" Sep 18 14:52:11.512669 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:11.512652 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fsrss"] Sep 18 14:52:11.514815 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:11.514791 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036734da_67ad_44f8_bf6f_e81a8afd441b.slice/crio-b70b67283c6414022b2ad7c0d88ed1e8a57ac888feb56926b49f0eb23d8ba173 WatchSource:0}: Error finding container b70b67283c6414022b2ad7c0d88ed1e8a57ac888feb56926b49f0eb23d8ba173: Status 404 returned error can't find the container with id b70b67283c6414022b2ad7c0d88ed1e8a57ac888feb56926b49f0eb23d8ba173 Sep 18 14:52:12.465304 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:12.465232 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fsrss" event={"ID":"036734da-67ad-44f8-bf6f-e81a8afd441b","Type":"ContainerStarted","Data":"968f41ac7cb56dc9a2b201fa9b9e76f2600a67610341ab72690c605bef942baf"} Sep 18 14:52:12.465698 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:12.465309 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fsrss" event={"ID":"036734da-67ad-44f8-bf6f-e81a8afd441b","Type":"ContainerStarted","Data":"fc2999cf4d31efe9da11fc4fc47c58fd0100c907efd2ce056f80958d12e7bdd3"} Sep 18 14:52:12.465698 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:12.465328 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fsrss" event={"ID":"036734da-67ad-44f8-bf6f-e81a8afd441b","Type":"ContainerStarted","Data":"b70b67283c6414022b2ad7c0d88ed1e8a57ac888feb56926b49f0eb23d8ba173"} Sep 18 14:52:14.474827 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:14.474793 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fsrss" event={"ID":"036734da-67ad-44f8-bf6f-e81a8afd441b","Type":"ContainerStarted","Data":"79e180fb4de548969315dfd0f96cf717c52f80be4662b26a3a5d66e345a7dd99"} Sep 18 14:52:14.497801 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:14.497758 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fsrss" podStartSLOduration=33.607099338 podStartE2EDuration="35.497738783s" totalImagesPullingTime="1.890639445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:51:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:14.496496439 +0000 UTC m=+80.345916284" watchObservedRunningTime="2026-09-18 14:52:14.497738783 +0000 UTC m=+80.347158627" Sep 18 14:52:15.429384 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:15.429354 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zpsdd" Sep 18 14:52:17.419798 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.419763 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r8jpr"] Sep 18 14:52:17.425407 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.425389 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.427939 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.427917 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7mpl9\"" Sep 18 14:52:17.428047 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.427994 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 14:52:17.428047 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.428015 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 14:52:17.428239 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.428213 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 14:52:17.428894 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.428869 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 14:52:17.429014 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.428936 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 14:52:17.429096 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.428869 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 14:52:17.563287 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563265 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563412 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-metrics-client-ca\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563412 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563321 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-textfile\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563412 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563342 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-wtmp\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563414 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-root\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563473 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-sys\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563492 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563514 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkkbn\" (UniqueName: \"kubernetes.io/projected/057c53d5-ba4b-4414-8728-8b7d564793b8-kube-api-access-pkkbn\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.563557 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.563536 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-tls\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.664718 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664696 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.664837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664730 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-metrics-client-ca\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.664837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664748 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-textfile\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.664837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664771 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-wtmp\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.664837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664805 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-root\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664841 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-sys\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664885 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664967 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-root\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664981 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-wtmp\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.664971 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057c53d5-ba4b-4414-8728-8b7d564793b8-sys\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.665001 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkkbn\" (UniqueName: \"kubernetes.io/projected/057c53d5-ba4b-4414-8728-8b7d564793b8-kube-api-access-pkkbn\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665065 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.665056 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-tls\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665322 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.665177 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-textfile\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665365 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.665342 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.665423 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.665406 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057c53d5-ba4b-4414-8728-8b7d564793b8-metrics-client-ca\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.667169 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.667144 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.667325 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.667301 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057c53d5-ba4b-4414-8728-8b7d564793b8-node-exporter-tls\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.674467 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.674449 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkkbn\" (UniqueName: \"kubernetes.io/projected/057c53d5-ba4b-4414-8728-8b7d564793b8-kube-api-access-pkkbn\") pod \"node-exporter-r8jpr\" (UID: \"057c53d5-ba4b-4414-8728-8b7d564793b8\") " pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.735719 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:17.735698 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r8jpr" Sep 18 14:52:17.747313 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:52:17.747293 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057c53d5_ba4b_4414_8728_8b7d564793b8.slice/crio-87c5d7290a0415f2c0bb30365460714ca079fc4fca6b83d808b8cb94e0e36db9 WatchSource:0}: Error finding container 87c5d7290a0415f2c0bb30365460714ca079fc4fca6b83d808b8cb94e0e36db9: Status 404 returned error can't find the container with id 87c5d7290a0415f2c0bb30365460714ca079fc4fca6b83d808b8cb94e0e36db9 Sep 18 14:52:18.491307 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:18.491269 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8jpr" event={"ID":"057c53d5-ba4b-4414-8728-8b7d564793b8","Type":"ContainerStarted","Data":"87c5d7290a0415f2c0bb30365460714ca079fc4fca6b83d808b8cb94e0e36db9"} Sep 18 14:52:19.496631 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:19.496599 2548 generic.go:356] "Generic (PLEG): container finished" podID="057c53d5-ba4b-4414-8728-8b7d564793b8" containerID="153b5645a234882e59b772f646e4c39a5f297c9b7f3fbbd26a532bd72890a243" exitCode=0 Sep 18 14:52:19.497048 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:19.496692 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8jpr" event={"ID":"057c53d5-ba4b-4414-8728-8b7d564793b8","Type":"ContainerDied","Data":"153b5645a234882e59b772f646e4c39a5f297c9b7f3fbbd26a532bd72890a243"} Sep 18 14:52:20.507242 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:20.507208 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8jpr" event={"ID":"057c53d5-ba4b-4414-8728-8b7d564793b8","Type":"ContainerStarted","Data":"aca006ecbd9f75d025e4990b82029d3ef0e82d9faf324e628f01a48bafd8f124"} Sep 18 14:52:20.507704 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:20.507286 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8jpr" event={"ID":"057c53d5-ba4b-4414-8728-8b7d564793b8","Type":"ContainerStarted","Data":"cd547caa585e2be836bfb435a346d619a550f62ffb0914933838fa5ee6f5f447"} Sep 18 14:52:20.532447 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:20.532400 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r8jpr" podStartSLOduration=2.529590402 podStartE2EDuration="3.532386389s" totalImagesPullingTime="943.58779ms" totalInitContainerRuntime="59.208197ms" isStatefulPod=true podCreationTimestamp="2026-09-18 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:52:20.530706109 +0000 UTC m=+86.380125984" watchObservedRunningTime="2026-09-18 14:52:20.532386389 +0000 UTC m=+86.381806231" Sep 18 14:52:23.319666 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:23.319630 2548 patch_prober.go:28] interesting pod/image-registry-656d786556-4gkz5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 14:52:23.320068 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:23.319694 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-656d786556-4gkz5" podUID="066debd8-ab31-439b-ac2b-7aada7ed5586" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 14:52:24.422255 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:24.422224 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:25.427408 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:25.427380 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-656d786556-4gkz5" Sep 18 14:52:29.443819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.443774 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" podUID="741de162-8b82-4ea7-9abf-51135f28ddaa" containerName="registry" containerID="cri-o://dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477" gracePeriod=30 Sep 18 14:52:29.670976 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.670957 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:29.744179 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744113 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744179 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744149 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj96b\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744209 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744246 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744273 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744297 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744360 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744339 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744642 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744381 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets\") pod \"741de162-8b82-4ea7-9abf-51135f28ddaa\" (UID: \"741de162-8b82-4ea7-9abf-51135f28ddaa\") " Sep 18 14:52:29.744642 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744568 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:29.744955 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.744917 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:52:29.746735 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.746710 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b" (OuterVolumeSpecName: "kube-api-access-cj96b") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "kube-api-access-cj96b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:29.746914 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.746830 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:29.746914 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.746840 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:29.746914 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.746891 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:52:29.747042 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.746917 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 14:52:29.753090 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.753069 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "741de162-8b82-4ea7-9abf-51135f28ddaa" (UID: "741de162-8b82-4ea7-9abf-51135f28ddaa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:52:29.845254 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845233 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-tls\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845254 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845252 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-bound-sa-token\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845261 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-registry-certificates\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845271 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-image-registry-private-configuration\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845281 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/741de162-8b82-4ea7-9abf-51135f28ddaa-installation-pull-secrets\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845289 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/741de162-8b82-4ea7-9abf-51135f28ddaa-trusted-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845296 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj96b\" (UniqueName: \"kubernetes.io/projected/741de162-8b82-4ea7-9abf-51135f28ddaa-kube-api-access-cj96b\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:29.845378 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:29.845305 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/741de162-8b82-4ea7-9abf-51135f28ddaa-ca-trust-extracted\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:52:30.542369 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.542336 2548 generic.go:356] "Generic (PLEG): container finished" podID="741de162-8b82-4ea7-9abf-51135f28ddaa" containerID="dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477" exitCode=0 Sep 18 14:52:30.542717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.542392 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" Sep 18 14:52:30.542717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.542408 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" event={"ID":"741de162-8b82-4ea7-9abf-51135f28ddaa","Type":"ContainerDied","Data":"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477"} Sep 18 14:52:30.542717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.542451 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf48d778c-dsz9s" event={"ID":"741de162-8b82-4ea7-9abf-51135f28ddaa","Type":"ContainerDied","Data":"03dacd1241165c6e5bd94e5fddea14526a0c986109f56b49adaf68ce57b43464"} Sep 18 14:52:30.542717 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.542473 2548 scope.go:117] "RemoveContainer" containerID="dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477" Sep 18 14:52:30.550441 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.550419 2548 scope.go:117] "RemoveContainer" containerID="dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477" Sep 18 14:52:30.550740 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:52:30.550720 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477\": container with ID starting with dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477 not found: ID does not exist" containerID="dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477" Sep 18 14:52:30.550782 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.550749 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477"} err="failed to get container status \"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477\": rpc error: code = NotFound desc = could not find container \"dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477\": container with ID starting with dde9977e03b95df9acb6974ca27c526a6173a5bcabfe7d793507af723e8f1477 not found: ID does not exist" Sep 18 14:52:30.561986 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.561967 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:52:30.565757 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:30.565737 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf48d778c-dsz9s"] Sep 18 14:52:32.125099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:32.125067 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741de162-8b82-4ea7-9abf-51135f28ddaa" path="/var/lib/kubelet/pods/741de162-8b82-4ea7-9abf-51135f28ddaa/volumes" Sep 18 14:52:41.462063 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:41.462029 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nvd62" Sep 18 14:52:50.028425 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:52:50.028395 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w74qv_b13b134d-c0b9-4f32-be84-37210ba95417/serve-healthcheck-canary/0.log" Sep 18 14:55:56.053060 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:55:56.053030 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:55:56.055815 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:55:56.055796 2548 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 14:55:56.056747 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:55:56.056732 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 14:57:04.375562 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.375492 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn"] Sep 18 14:57:04.376020 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.375725 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741de162-8b82-4ea7-9abf-51135f28ddaa" containerName="registry" Sep 18 14:57:04.376020 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.375736 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="741de162-8b82-4ea7-9abf-51135f28ddaa" containerName="registry" Sep 18 14:57:04.376020 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.375790 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="741de162-8b82-4ea7-9abf-51135f28ddaa" containerName="registry" Sep 18 14:57:04.377615 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.377590 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.380359 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.380340 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rdcc8\"" Sep 18 14:57:04.380359 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.380353 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 18 14:57:04.381348 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.381333 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 18 14:57:04.381496 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.381478 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 18 14:57:04.381496 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.381483 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 18 14:57:04.381644 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.381517 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 18 14:57:04.389340 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.389323 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn"] Sep 18 14:57:04.437787 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.437767 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-manager-config\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.437906 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.437804 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlcsb\" (UniqueName: \"kubernetes.io/projected/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-kube-api-access-zlcsb\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.437906 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.437823 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-metrics-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.437997 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.437909 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.538327 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.538302 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-metrics-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.538434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.538345 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.538434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.538368 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-manager-config\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.538434 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.538417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlcsb\" (UniqueName: \"kubernetes.io/projected/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-kube-api-access-zlcsb\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.539027 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.539005 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-manager-config\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.540806 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.540782 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.540905 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.540839 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-metrics-cert\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.547837 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.547815 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlcsb\" (UniqueName: \"kubernetes.io/projected/1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028-kube-api-access-zlcsb\") pod \"lws-controller-manager-859bf4c848-vlqvn\" (UID: \"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028\") " pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.686187 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.686164 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:04.961028 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.961004 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn"] Sep 18 14:57:04.963455 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:57:04.963431 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7ca2dd_4ffd_4da0_a0e7_812d4c4f4028.slice/crio-404941f2527c6d337465ff66170e9da8de5c96013e7610376e626672c2d1a964 WatchSource:0}: Error finding container 404941f2527c6d337465ff66170e9da8de5c96013e7610376e626672c2d1a964: Status 404 returned error can't find the container with id 404941f2527c6d337465ff66170e9da8de5c96013e7610376e626672c2d1a964 Sep 18 14:57:04.965358 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:04.965341 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 14:57:05.436477 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:05.436451 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" event={"ID":"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028","Type":"ContainerStarted","Data":"404941f2527c6d337465ff66170e9da8de5c96013e7610376e626672c2d1a964"} Sep 18 14:57:08.436802 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.436767 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8"] Sep 18 14:57:08.438692 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.438677 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.441559 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.441538 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 14:57:08.441692 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.441664 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 14:57:08.441805 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.441696 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 14:57:08.441805 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.441696 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j9ltq\"" Sep 18 14:57:08.441988 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.441974 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 14:57:08.447555 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.447529 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" event={"ID":"1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028","Type":"ContainerStarted","Data":"710cd4d59d5141a18aadd3860222980c742c4b6ff96cfbe318a63189035d99ff"} Sep 18 14:57:08.447659 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.447643 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:08.459346 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.459326 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8"] Sep 18 14:57:08.509697 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.509648 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" podStartSLOduration=2.063602492 podStartE2EDuration="4.509630146s" totalImagesPullingTime="2.446027654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:08.509233069 +0000 UTC m=+374.358652912" watchObservedRunningTime="2026-09-18 14:57:08.509630146 +0000 UTC m=+374.359049993" Sep 18 14:57:08.569417 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.569394 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.569541 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.569433 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.569541 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.569449 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.569541 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.569500 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f8fz\" (UniqueName: \"kubernetes.io/projected/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-kube-api-access-7f8fz\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.569541 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.569533 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.670155 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.670129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.670261 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.670162 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.670261 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.670178 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.670261 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.670196 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f8fz\" (UniqueName: \"kubernetes.io/projected/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-kube-api-access-7f8fz\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.670261 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.670212 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.671725 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.671678 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-manifests\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.673284 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.673262 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.674508 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.674489 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.674914 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.674888 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-tmp\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.681770 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.681748 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f8fz\" (UniqueName: \"kubernetes.io/projected/1ce8ea9a-8bc4-437f-bb29-4971d5fbed23-kube-api-access-7f8fz\") pod \"opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8\" (UID: \"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:08.749402 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:08.749341 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:09.026776 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:09.026665 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8"] Sep 18 14:57:09.029333 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:57:09.029304 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce8ea9a_8bc4_437f_bb29_4971d5fbed23.slice/crio-b3c0281ec84a918d943f98d782a94f787cf01ddc4bda091f5c861d39d51a0801 WatchSource:0}: Error finding container b3c0281ec84a918d943f98d782a94f787cf01ddc4bda091f5c861d39d51a0801: Status 404 returned error can't find the container with id b3c0281ec84a918d943f98d782a94f787cf01ddc4bda091f5c861d39d51a0801 Sep 18 14:57:09.451884 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:09.451837 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" event={"ID":"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23","Type":"ContainerStarted","Data":"b3c0281ec84a918d943f98d782a94f787cf01ddc4bda091f5c861d39d51a0801"} Sep 18 14:57:12.465445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:12.465405 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" event={"ID":"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23","Type":"ContainerStarted","Data":"721076c14927cab690c69e16e966653293631dc3485b37e226aec1820ae6bddd"} Sep 18 14:57:13.470497 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:13.470466 2548 generic.go:356] "Generic (PLEG): container finished" podID="1ce8ea9a-8bc4-437f-bb29-4971d5fbed23" containerID="721076c14927cab690c69e16e966653293631dc3485b37e226aec1820ae6bddd" exitCode=0 Sep 18 14:57:13.470935 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:13.470543 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" event={"ID":"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23","Type":"ContainerDied","Data":"721076c14927cab690c69e16e966653293631dc3485b37e226aec1820ae6bddd"} Sep 18 14:57:14.476074 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:14.476038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" event={"ID":"1ce8ea9a-8bc4-437f-bb29-4971d5fbed23","Type":"ContainerStarted","Data":"2f717c8052ab352d631941cc4e74b28e43636a2422392df1332166ecb96f319e"} Sep 18 14:57:14.476496 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:14.476180 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:14.501656 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:14.501616 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" podStartSLOduration=2.20187801 podStartE2EDuration="6.501603458s" totalImagesPullingTime="3.275776678s" totalInitContainerRuntime="1.02394877s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:14.501513512 +0000 UTC m=+380.350933355" watchObservedRunningTime="2026-09-18 14:57:14.501603458 +0000 UTC m=+380.351023300" Sep 18 14:57:19.454591 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:19.454562 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-859bf4c848-vlqvn" Sep 18 14:57:25.481058 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:25.481029 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8" Sep 18 14:57:34.484532 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.484499 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:34.494373 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.494352 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.497357 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.497339 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 14:57:34.497702 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.497651 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 14:57:34.497810 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.497678 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 14:57:34.497810 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.497770 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9bwdk\"" Sep 18 14:57:34.501921 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.501897 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:34.649099 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649068 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649228 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649104 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649228 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649124 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649228 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649140 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649228 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649197 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649228 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649224 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649383 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649250 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfcw\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649383 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649323 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.649383 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.649351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750371 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750314 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfcw\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750371 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750348 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750371 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750410 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750444 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750470 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750495 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750522 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750552 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750547 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750832 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750814 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.750975 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.750957 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.751030 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.751010 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.751096 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.751081 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.751547 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.751527 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.752724 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.752700 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.753010 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.752993 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.766949 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.766927 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.767174 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.767159 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfcw\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8gptg\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.806624 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.806604 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:34.864616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.864584 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf"] Sep 18 14:57:34.872874 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.869014 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:34.880667 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:34.880643 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf"] Sep 18 14:57:35.052605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052529 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ccf160-8c54-4de9-82a2-9e9c7d959928-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052605 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052580 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052632 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052668 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052690 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052712 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052744 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.052819 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052762 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.053127 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.052865 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf6zc\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-kube-api-access-pf6zc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.076712 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.076684 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:35.079568 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:57:35.079538 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307b7a6f_786b_4b9b_a6f8_a39a9355d2d3.slice/crio-0801ce490a97521605da69b600d76347e27f83199c066da58e3e45fbe1802062 WatchSource:0}: Error finding container 0801ce490a97521605da69b600d76347e27f83199c066da58e3e45fbe1802062: Status 404 returned error can't find the container with id 0801ce490a97521605da69b600d76347e27f83199c066da58e3e45fbe1802062 Sep 18 14:57:35.153626 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153596 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153630 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153654 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153707 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf6zc\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-kube-api-access-pf6zc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153728 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ccf160-8c54-4de9-82a2-9e9c7d959928-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.153768 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153766 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153813 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.153922 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.154061 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.154075 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154276 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.154252 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154343 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.154321 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.154503 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.154486 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ccf160-8c54-4de9-82a2-9e9c7d959928-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.156018 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.155998 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.156221 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.156205 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.162366 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.162342 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.162502 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.162488 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf6zc\" (UniqueName: \"kubernetes.io/projected/14ccf160-8c54-4de9-82a2-9e9c7d959928-kube-api-access-pf6zc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf\" (UID: \"14ccf160-8c54-4de9-82a2-9e9c7d959928\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.183373 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.183351 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:35.453189 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.453167 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf"] Sep 18 14:57:35.454968 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:57:35.454942 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ccf160_8c54_4de9_82a2_9e9c7d959928.slice/crio-d6856a9aeeee03c466ec63806e5724fb52b3b8a26ca1644e29a38927de2b98a7 WatchSource:0}: Error finding container d6856a9aeeee03c466ec63806e5724fb52b3b8a26ca1644e29a38927de2b98a7: Status 404 returned error can't find the container with id d6856a9aeeee03c466ec63806e5724fb52b3b8a26ca1644e29a38927de2b98a7 Sep 18 14:57:35.551250 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.551220 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" event={"ID":"14ccf160-8c54-4de9-82a2-9e9c7d959928","Type":"ContainerStarted","Data":"d6856a9aeeee03c466ec63806e5724fb52b3b8a26ca1644e29a38927de2b98a7"} Sep 18 14:57:35.552422 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:35.552397 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" event={"ID":"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3","Type":"ContainerStarted","Data":"0801ce490a97521605da69b600d76347e27f83199c066da58e3e45fbe1802062"} Sep 18 14:57:38.193836 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.193799 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:38.194133 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.193895 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:38.194133 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.193928 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:38.566022 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.565941 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" event={"ID":"14ccf160-8c54-4de9-82a2-9e9c7d959928","Type":"ContainerStarted","Data":"eeca82dc3632fc48c66690ff6e7d713d9e713b930f2337f4f0c234b6c8df383c"} Sep 18 14:57:38.589454 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.589401 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" podStartSLOduration=1.852910791 podStartE2EDuration="4.589385732s" totalImagesPullingTime="2.736474941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:38.587412514 +0000 UTC m=+404.436832360" watchObservedRunningTime="2026-09-18 14:57:38.589385732 +0000 UTC m=+404.438805573" Sep 18 14:57:38.833943 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.833901 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:38.834048 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.833989 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:38.834048 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:38.834029 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:57:39.184594 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.184559 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:39.188706 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.188686 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:39.571114 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.571030 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" event={"ID":"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3","Type":"ContainerStarted","Data":"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707"} Sep 18 14:57:39.571496 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.571247 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:39.572040 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.572023 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf" Sep 18 14:57:39.591696 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.591650 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" podStartSLOduration=1.839547535 podStartE2EDuration="5.591636303s" totalImagesPullingTime="3.752088768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:39.590154386 +0000 UTC m=+405.439574228" watchObservedRunningTime="2026-09-18 14:57:39.591636303 +0000 UTC m=+405.441056145" Sep 18 14:57:39.643900 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.643871 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:39.807316 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.807281 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:39.808466 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.808444 2548 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body= Sep 18 14:57:39.808562 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:39.808497 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" Sep 18 14:57:40.807857 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:40.807808 2548 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body= Sep 18 14:57:40.808229 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:40.807894 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" Sep 18 14:57:41.577549 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:41.577512 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" containerID="cri-o://34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707" gracePeriod=30 Sep 18 14:57:46.813253 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.813228 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:46.835639 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835591 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835639 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835620 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835641 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsfcw\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835665 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835688 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835717 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835739 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.835785 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835763 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.836103 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835786 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket\") pod \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\" (UID: \"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3\") " Sep 18 14:57:46.836103 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.835880 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:57:46.836103 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.836030 2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-socket\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.836255 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.836150 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:57:46.836255 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.836226 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:57:46.836255 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.836241 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:57:46.836412 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.836263 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 14:57:46.839297 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.839236 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:57:46.839419 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.839362 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw" (OuterVolumeSpecName: "kube-api-access-bsfcw") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "kube-api-access-bsfcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:57:46.839908 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.839883 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 18 14:57:46.840278 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.840256 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" (UID: "307b7a6f-786b-4b9b-a6f8-a39a9355d2d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 14:57:46.936304 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936282 2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-workload-certs\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936304 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936301 2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-data\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936311 2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-token\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936319 2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istiod-ca-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936326 2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-credential-socket\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936334 2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-podinfo\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936342 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsfcw\" (UniqueName: \"kubernetes.io/projected/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-kube-api-access-bsfcw\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:46.936438 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:46.936351 2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3-istio-envoy\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:57:47.599889 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.599833 2548 generic.go:356] "Generic (PLEG): container finished" podID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerID="34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707" exitCode=0 Sep 18 14:57:47.599889 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.599876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" event={"ID":"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3","Type":"ContainerDied","Data":"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707"} Sep 18 14:57:47.600105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.599902 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" Sep 18 14:57:47.600105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.599932 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg" event={"ID":"307b7a6f-786b-4b9b-a6f8-a39a9355d2d3","Type":"ContainerDied","Data":"0801ce490a97521605da69b600d76347e27f83199c066da58e3e45fbe1802062"} Sep 18 14:57:47.600105 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.599956 2548 scope.go:117] "RemoveContainer" containerID="34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707" Sep 18 14:57:47.611126 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.611110 2548 scope.go:117] "RemoveContainer" containerID="34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707" Sep 18 14:57:47.611398 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:57:47.611380 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707\": container with ID starting with 34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707 not found: ID does not exist" containerID="34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707" Sep 18 14:57:47.611444 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.611407 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707"} err="failed to get container status \"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707\": rpc error: code = NotFound desc = could not find container \"34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707\": container with ID starting with 34ac06f7dd0e827a5876011663ea01755fb46caa6d40140bec871ba696644707 not found: ID does not exist" Sep 18 14:57:47.622458 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.622426 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:47.626632 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:47.626613 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8gptg"] Sep 18 14:57:48.126002 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.125969 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" path="/var/lib/kubelet/pods/307b7a6f-786b-4b9b-a6f8-a39a9355d2d3/volumes" Sep 18 14:57:48.864291 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.864262 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz"] Sep 18 14:57:48.864510 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.864498 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" Sep 18 14:57:48.864570 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.864513 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" Sep 18 14:57:48.864570 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.864563 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="307b7a6f-786b-4b9b-a6f8-a39a9355d2d3" containerName="istio-proxy" Sep 18 14:57:48.868479 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.868450 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:48.873494 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.873473 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 18 14:57:48.873654 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.873594 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-p9xhp\"" Sep 18 14:57:48.884341 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.884318 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz"] Sep 18 14:57:48.948834 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.948804 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:48.949011 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:48.948872 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67v5x\" (UniqueName: \"kubernetes.io/projected/1fefa8ae-eb09-41b8-9c58-01505499dd86-kube-api-access-67v5x\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.050000 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.049973 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.050104 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.050012 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67v5x\" (UniqueName: \"kubernetes.io/projected/1fefa8ae-eb09-41b8-9c58-01505499dd86-kube-api-access-67v5x\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.050153 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:57:49.050117 2548 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 18 14:57:49.050200 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:57:49.050189 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert podName:1fefa8ae-eb09-41b8-9c58-01505499dd86 nodeName:}" failed. No retries permitted until 2026-09-18 14:57:49.550168726 +0000 UTC m=+415.399588561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert") pod "llmisvc-controller-manager-777c6bd7d5-88zcz" (UID: "1fefa8ae-eb09-41b8-9c58-01505499dd86") : secret "llmisvc-webhook-server-cert" not found Sep 18 14:57:49.074722 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.074699 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67v5x\" (UniqueName: \"kubernetes.io/projected/1fefa8ae-eb09-41b8-9c58-01505499dd86-kube-api-access-67v5x\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.552863 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.552816 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.555227 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.555206 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fefa8ae-eb09-41b8-9c58-01505499dd86-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-88zcz\" (UID: \"1fefa8ae-eb09-41b8-9c58-01505499dd86\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:49.778728 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:49.778700 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:50.054862 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:50.054814 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz"] Sep 18 14:57:50.057754 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:57:50.057730 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1fefa8ae_eb09_41b8_9c58_01505499dd86.slice/crio-7c95db8e021a24d3eecc21788eccbcfb4edc8582e64269427b5598d7954a769e WatchSource:0}: Error finding container 7c95db8e021a24d3eecc21788eccbcfb4edc8582e64269427b5598d7954a769e: Status 404 returned error can't find the container with id 7c95db8e021a24d3eecc21788eccbcfb4edc8582e64269427b5598d7954a769e Sep 18 14:57:50.612708 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:50.612668 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" event={"ID":"1fefa8ae-eb09-41b8-9c58-01505499dd86","Type":"ContainerStarted","Data":"7c95db8e021a24d3eecc21788eccbcfb4edc8582e64269427b5598d7954a769e"} Sep 18 14:57:53.626530 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:53.626497 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" event={"ID":"1fefa8ae-eb09-41b8-9c58-01505499dd86","Type":"ContainerStarted","Data":"d671e448b83d8dc5979439f1151bc758d6339d47da1b41c9380b89ffc3879b78"} Sep 18 14:57:53.626896 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:53.626651 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:57:53.645862 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:57:53.645803 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" podStartSLOduration=2.927450264 podStartE2EDuration="5.645787291s" totalImagesPullingTime="2.718337027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:57:53.645230723 +0000 UTC m=+419.494650567" watchObservedRunningTime="2026-09-18 14:57:53.645787291 +0000 UTC m=+419.495207133" Sep 18 14:58:24.631672 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:24.631606 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-88zcz" Sep 18 14:58:56.560696 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.560664 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz"] Sep 18 14:58:56.563838 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.563821 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:56.566647 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.566627 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 14:58:56.567601 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.567585 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 14:58:56.567677 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.567611 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5cwcm\"" Sep 18 14:58:56.575243 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.575220 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz"] Sep 18 14:58:56.618975 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.618952 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vvp\" (UniqueName: \"kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp\") pod \"limitador-operator-controller-manager-74495c69f8-mnwwz\" (UID: \"3c2613ea-8643-41fa-b8ff-8cb25f92a106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:56.719514 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.719486 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvp\" (UniqueName: \"kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp\") pod \"limitador-operator-controller-manager-74495c69f8-mnwwz\" (UID: \"3c2613ea-8643-41fa-b8ff-8cb25f92a106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:56.728130 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.728103 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vvp\" (UniqueName: \"kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp\") pod \"limitador-operator-controller-manager-74495c69f8-mnwwz\" (UID: \"3c2613ea-8643-41fa-b8ff-8cb25f92a106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:56.873924 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:56.873828 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:57.146008 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:57.145985 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz"] Sep 18 14:58:57.148634 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:58:57.148608 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2613ea_8643_41fa_b8ff_8cb25f92a106.slice/crio-a16c4b55032b6602225da173a688e8ef1f2638554d4232729263ebd61841a9a0 WatchSource:0}: Error finding container a16c4b55032b6602225da173a688e8ef1f2638554d4232729263ebd61841a9a0: Status 404 returned error can't find the container with id a16c4b55032b6602225da173a688e8ef1f2638554d4232729263ebd61841a9a0 Sep 18 14:58:57.861424 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:57.861361 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" event={"ID":"3c2613ea-8643-41fa-b8ff-8cb25f92a106","Type":"ContainerStarted","Data":"a16c4b55032b6602225da173a688e8ef1f2638554d4232729263ebd61841a9a0"} Sep 18 14:58:59.870306 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:59.870229 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" event={"ID":"3c2613ea-8643-41fa-b8ff-8cb25f92a106","Type":"ContainerStarted","Data":"9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923"} Sep 18 14:58:59.870644 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:59.870362 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:58:59.889308 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:58:59.889264 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" podStartSLOduration=1.5496653870000001 podStartE2EDuration="3.889249895s" totalImagesPullingTime="2.339584508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:58:59.887783959 +0000 UTC m=+485.737203802" watchObservedRunningTime="2026-09-18 14:58:59.889249895 +0000 UTC m=+485.738669737" Sep 18 14:59:10.877020 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:10.876989 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:59:14.787302 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.787263 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p"] Sep 18 14:59:14.790195 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.790178 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:14.793076 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.793053 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 18 14:59:14.793207 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.793092 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 18 14:59:14.793207 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.793095 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b9dwb\"" Sep 18 14:59:14.800510 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.800491 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p"] Sep 18 14:59:14.950276 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.950246 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:14.950445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.950300 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:14.950445 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:14.950361 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvzzl\" (UniqueName: \"kubernetes.io/projected/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-kube-api-access-xvzzl\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.051614 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.051546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.051614 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.051589 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.051814 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.051622 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvzzl\" (UniqueName: \"kubernetes.io/projected/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-kube-api-access-xvzzl\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.051814 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:59:15.051720 2548 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 18 14:59:15.051814 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:59:15.051802 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert podName:3df4e115-5472-492f-ba9b-b4ac4fb2fa8d nodeName:}" failed. No retries permitted until 2026-09-18 14:59:15.551781066 +0000 UTC m=+501.401200892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-dq87p" (UID: "3df4e115-5472-492f-ba9b-b4ac4fb2fa8d") : secret "plugin-serving-cert" not found Sep 18 14:59:15.052253 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.052233 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.063350 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.063330 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvzzl\" (UniqueName: \"kubernetes.io/projected/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-kube-api-access-xvzzl\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.555049 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.555016 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.557330 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.557300 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df4e115-5472-492f-ba9b-b4ac4fb2fa8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq87p\" (UID: \"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.699047 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.699014 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" Sep 18 14:59:15.964108 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:15.964081 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p"] Sep 18 14:59:15.966815 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:59:15.966789 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3df4e115_5472_492f_ba9b_b4ac4fb2fa8d.slice/crio-a5063c70e832fa2a80cf20b21460ee95df35802cc9a7f3b9a22532eac6f94fbc WatchSource:0}: Error finding container a5063c70e832fa2a80cf20b21460ee95df35802cc9a7f3b9a22532eac6f94fbc: Status 404 returned error can't find the container with id a5063c70e832fa2a80cf20b21460ee95df35802cc9a7f3b9a22532eac6f94fbc Sep 18 14:59:16.941172 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:16.941132 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" event={"ID":"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d","Type":"ContainerStarted","Data":"a5063c70e832fa2a80cf20b21460ee95df35802cc9a7f3b9a22532eac6f94fbc"} Sep 18 14:59:20.961045 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:20.961011 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" event={"ID":"3df4e115-5472-492f-ba9b-b4ac4fb2fa8d","Type":"ContainerStarted","Data":"1610d6a0b5c41a99aa2a72125f647e7e59f9ba0a9d38ceb29587f18d8a1c80ff"} Sep 18 14:59:20.977829 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:20.977775 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq87p" podStartSLOduration=2.507984076 podStartE2EDuration="6.977759144s" totalImagesPullingTime="4.469775068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:59:20.977188873 +0000 UTC m=+506.826608714" watchObservedRunningTime="2026-09-18 14:59:20.977759144 +0000 UTC m=+506.827178986" Sep 18 14:59:26.061765 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.061732 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz"] Sep 18 14:59:26.062135 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.062062 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" containerName="manager" containerID="cri-o://9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923" gracePeriod=2 Sep 18 14:59:26.080117 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.080092 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz"] Sep 18 14:59:26.096868 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:59:26.096821 2548 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c2613ea-8643-41fa-b8ff-8cb25f92a106\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-mnwwz\": pods \"limitador-operator-controller-manager-74495c69f8-mnwwz\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:59:26.124716 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:59:26.124680 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mnwwz\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:59:26.293549 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.293528 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:59:26.441041 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.441019 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7vvp\" (UniqueName: \"kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp\") pod \"3c2613ea-8643-41fa-b8ff-8cb25f92a106\" (UID: \"3c2613ea-8643-41fa-b8ff-8cb25f92a106\") " Sep 18 14:59:26.443021 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.442992 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp" (OuterVolumeSpecName: "kube-api-access-s7vvp") pod "3c2613ea-8643-41fa-b8ff-8cb25f92a106" (UID: "3c2613ea-8643-41fa-b8ff-8cb25f92a106"). InnerVolumeSpecName "kube-api-access-s7vvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 14:59:26.542157 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.542133 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7vvp\" (UniqueName: \"kubernetes.io/projected/3c2613ea-8643-41fa-b8ff-8cb25f92a106-kube-api-access-s7vvp\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 14:59:26.986127 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.986097 2548 generic.go:356] "Generic (PLEG): container finished" podID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" containerID="9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923" exitCode=0 Sep 18 14:59:26.986329 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.986142 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mnwwz" Sep 18 14:59:26.986329 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.986161 2548 scope.go:117] "RemoveContainer" containerID="9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923" Sep 18 14:59:26.994394 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.994374 2548 scope.go:117] "RemoveContainer" containerID="9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923" Sep 18 14:59:26.994648 ip-10-0-133-129 kubenswrapper[2548]: E0918 14:59:26.994630 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923\": container with ID starting with 9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923 not found: ID does not exist" containerID="9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923" Sep 18 14:59:26.994693 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:26.994656 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923"} err="failed to get container status \"9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923\": rpc error: code = NotFound desc = could not find container \"9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923\": container with ID starting with 9389a8aa94a4450ee0a7164e41438508e30a0a2b80c68c21dfcd87a29f7e6923 not found: ID does not exist" Sep 18 14:59:28.125418 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:28.125384 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" path="/var/lib/kubelet/pods/3c2613ea-8643-41fa-b8ff-8cb25f92a106/volumes" Sep 18 14:59:54.407081 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.407010 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg"] Sep 18 14:59:54.407523 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.407305 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" containerName="manager" Sep 18 14:59:54.407523 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.407321 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" containerName="manager" Sep 18 14:59:54.407523 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.407380 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2613ea-8643-41fa-b8ff-8cb25f92a106" containerName="manager" Sep 18 14:59:54.426764 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.426740 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg"] Sep 18 14:59:54.426933 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.426866 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.429534 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.429511 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vl7qq\"" Sep 18 14:59:54.449346 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449319 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449451 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449349 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449451 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449367 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449451 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449383 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449456 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf31a32-c319-44bb-8708-18984eb680d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449501 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449555 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf31a32-c319-44bb-8708-18984eb680d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449616 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449593 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.449743 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.449634 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qqb\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-kube-api-access-v7qqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550880 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf31a32-c319-44bb-8708-18984eb680d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550886 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550916 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf31a32-c319-44bb-8708-18984eb680d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qqb\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-kube-api-access-v7qqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.550993 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.550988 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551218 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551218 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551045 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551218 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551069 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551377 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551354 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551480 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551453 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551591 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551532 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551674 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551653 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.551721 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.551660 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf31a32-c319-44bb-8708-18984eb680d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.553312 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.553292 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf31a32-c319-44bb-8708-18984eb680d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.553448 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.553430 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf31a32-c319-44bb-8708-18984eb680d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.563126 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.563107 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.563501 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.563481 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qqb\" (UniqueName: \"kubernetes.io/projected/ddf31a32-c319-44bb-8708-18984eb680d0-kube-api-access-v7qqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-z5fpg\" (UID: \"ddf31a32-c319-44bb-8708-18984eb680d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:54.737036 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:54.736998 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:55.011190 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.011165 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg"] Sep 18 14:59:55.012941 ip-10-0-133-129 kubenswrapper[2548]: W0918 14:59:55.012911 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf31a32_c319_44bb_8708_18984eb680d0.slice/crio-ce6ed3207030875b51a222bb76faa29ef481b762c7178f09a91f9f2ab0c8b578 WatchSource:0}: Error finding container ce6ed3207030875b51a222bb76faa29ef481b762c7178f09a91f9f2ab0c8b578: Status 404 returned error can't find the container with id ce6ed3207030875b51a222bb76faa29ef481b762c7178f09a91f9f2ab0c8b578 Sep 18 14:59:55.015118 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.015075 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:59:55.015220 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.015164 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:59:55.015220 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.015207 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 14:59:55.096951 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.096923 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" event={"ID":"ddf31a32-c319-44bb-8708-18984eb680d0","Type":"ContainerStarted","Data":"37ca3531b7693146eda35d752f8aecc1c6f1408d1678c19e2c159db8571641de"} Sep 18 14:59:55.097094 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.096971 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" event={"ID":"ddf31a32-c319-44bb-8708-18984eb680d0","Type":"ContainerStarted","Data":"ce6ed3207030875b51a222bb76faa29ef481b762c7178f09a91f9f2ab0c8b578"} Sep 18 14:59:55.122876 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.122804 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podStartSLOduration=1.122781818 podStartE2EDuration="1.122781818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:59:55.119989971 +0000 UTC m=+540.969409814" watchObservedRunningTime="2026-09-18 14:59:55.122781818 +0000 UTC m=+540.972201662" Sep 18 14:59:55.737935 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:55.737895 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:56.742769 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:56.742735 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:57.104881 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:57.104790 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 14:59:57.105624 ip-10-0-133-129 kubenswrapper[2548]: I0918 14:59:57.105606 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 15:00:08.658223 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.658185 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:08.662674 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.662659 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.665113 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.665092 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 18 15:00:08.668912 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.668890 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:08.750210 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.750165 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.750381 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.750233 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jbq\" (UniqueName: \"kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.752336 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.752306 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:08.850668 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.850643 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.850786 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.850682 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jbq\" (UniqueName: \"kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.851342 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.851324 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.863199 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.863176 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jbq\" (UniqueName: \"kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq\") pod \"limitador-limitador-8588749977-jk5qh\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:08.973247 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:08.973226 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:09.239553 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.239480 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:09.241659 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:09.241629 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eee52e2_b391_40a5_9baa_7d3937f46e98.slice/crio-419ed17f2a273762e3ea528dc5877af09eb2972a8f3fa8a0f69f8d714824cb86 WatchSource:0}: Error finding container 419ed17f2a273762e3ea528dc5877af09eb2972a8f3fa8a0f69f8d714824cb86: Status 404 returned error can't find the container with id 419ed17f2a273762e3ea528dc5877af09eb2972a8f3fa8a0f69f8d714824cb86 Sep 18 15:00:09.473766 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.473730 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:09.478004 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.477984 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:09.480505 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.480487 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cgjfp\"" Sep 18 15:00:09.484653 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.484627 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:09.555347 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.555275 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkgq\" (UniqueName: \"kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq\") pod \"authorino-7bcfd8f9cd-w9qkw\" (UID: \"cc413c4a-a65e-4d13-9a88-597ee65f4c2e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:09.656645 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.656618 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkgq\" (UniqueName: \"kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq\") pod \"authorino-7bcfd8f9cd-w9qkw\" (UID: \"cc413c4a-a65e-4d13-9a88-597ee65f4c2e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:09.665006 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.664980 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkgq\" (UniqueName: \"kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq\") pod \"authorino-7bcfd8f9cd-w9qkw\" (UID: \"cc413c4a-a65e-4d13-9a88-597ee65f4c2e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:09.787504 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:09.787478 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:10.051352 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:10.051318 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:10.054226 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:10.054197 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc413c4a_a65e_4d13_9a88_597ee65f4c2e.slice/crio-dcce69238fa51f2b143d02099ac376e7a1783da7592c993d2fc6e654626882ed WatchSource:0}: Error finding container dcce69238fa51f2b143d02099ac376e7a1783da7592c993d2fc6e654626882ed: Status 404 returned error can't find the container with id dcce69238fa51f2b143d02099ac376e7a1783da7592c993d2fc6e654626882ed Sep 18 15:00:10.154702 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:10.154637 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" event={"ID":"cc413c4a-a65e-4d13-9a88-597ee65f4c2e","Type":"ContainerStarted","Data":"dcce69238fa51f2b143d02099ac376e7a1783da7592c993d2fc6e654626882ed"} Sep 18 15:00:10.155706 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:10.155683 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" event={"ID":"8eee52e2-b391-40a5-9baa-7d3937f46e98","Type":"ContainerStarted","Data":"419ed17f2a273762e3ea528dc5877af09eb2972a8f3fa8a0f69f8d714824cb86"} Sep 18 15:00:11.161645 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:11.161609 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" event={"ID":"8eee52e2-b391-40a5-9baa-7d3937f46e98","Type":"ContainerStarted","Data":"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06"} Sep 18 15:00:11.162023 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:11.161743 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:11.178303 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:11.178258 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" podStartSLOduration=1.78842755 podStartE2EDuration="3.178239668s" totalImagesPullingTime="1.389812118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:11.176883202 +0000 UTC m=+557.026303040" watchObservedRunningTime="2026-09-18 15:00:11.178239668 +0000 UTC m=+557.027659510" Sep 18 15:00:12.166577 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:12.166542 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" event={"ID":"cc413c4a-a65e-4d13-9a88-597ee65f4c2e","Type":"ContainerStarted","Data":"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62"} Sep 18 15:00:12.181560 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:12.181515 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" podStartSLOduration=1.258168789 podStartE2EDuration="3.181500056s" totalImagesPullingTime="1.923331267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:12.180743309 +0000 UTC m=+558.030163150" watchObservedRunningTime="2026-09-18 15:00:12.181500056 +0000 UTC m=+558.030919914" Sep 18 15:00:13.245211 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:13.245174 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:14.173547 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:14.173507 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" podUID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" containerName="authorino" containerID="cri-o://6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62" gracePeriod=30 Sep 18 15:00:14.420353 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:14.420333 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:14.493393 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:14.493323 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bkgq\" (UniqueName: \"kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq\") pod \"cc413c4a-a65e-4d13-9a88-597ee65f4c2e\" (UID: \"cc413c4a-a65e-4d13-9a88-597ee65f4c2e\") " Sep 18 15:00:14.495417 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:14.495384 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq" (OuterVolumeSpecName: "kube-api-access-5bkgq") pod "cc413c4a-a65e-4d13-9a88-597ee65f4c2e" (UID: "cc413c4a-a65e-4d13-9a88-597ee65f4c2e"). InnerVolumeSpecName "kube-api-access-5bkgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:00:14.594631 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:14.594606 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bkgq\" (UniqueName: \"kubernetes.io/projected/cc413c4a-a65e-4d13-9a88-597ee65f4c2e-kube-api-access-5bkgq\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:00:15.180487 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.180454 2548 generic.go:356] "Generic (PLEG): container finished" podID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" containerID="6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62" exitCode=0 Sep 18 15:00:15.180662 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.180494 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" event={"ID":"cc413c4a-a65e-4d13-9a88-597ee65f4c2e","Type":"ContainerDied","Data":"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62"} Sep 18 15:00:15.180662 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.180497 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" Sep 18 15:00:15.180662 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.180536 2548 scope.go:117] "RemoveContainer" containerID="6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62" Sep 18 15:00:15.180662 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.180525 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w9qkw" event={"ID":"cc413c4a-a65e-4d13-9a88-597ee65f4c2e","Type":"ContainerDied","Data":"dcce69238fa51f2b143d02099ac376e7a1783da7592c993d2fc6e654626882ed"} Sep 18 15:00:15.190273 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.190250 2548 scope.go:117] "RemoveContainer" containerID="6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62" Sep 18 15:00:15.190812 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:00:15.190745 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62\": container with ID starting with 6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62 not found: ID does not exist" containerID="6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62" Sep 18 15:00:15.190812 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.190778 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62"} err="failed to get container status \"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62\": rpc error: code = NotFound desc = could not find container \"6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62\": container with ID starting with 6c6716ace6f1e5b954fc59920e05d0bb3b9d8c0dad356b68ea5d434a09a4bc62 not found: ID does not exist" Sep 18 15:00:15.203773 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.203747 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:15.210252 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:15.210230 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w9qkw"] Sep 18 15:00:16.126058 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:16.126032 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" path="/var/lib/kubelet/pods/cc413c4a-a65e-4d13-9a88-597ee65f4c2e/volumes" Sep 18 15:00:22.167620 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.167594 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:22.265095 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.265062 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:22.265287 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.265263 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" podUID="8eee52e2-b391-40a5-9baa-7d3937f46e98" containerName="limitador" containerID="cri-o://9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06" gracePeriod=30 Sep 18 15:00:22.804076 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.804055 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:22.846539 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.846484 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file\") pod \"8eee52e2-b391-40a5-9baa-7d3937f46e98\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " Sep 18 15:00:22.846539 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.846517 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2jbq\" (UniqueName: \"kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq\") pod \"8eee52e2-b391-40a5-9baa-7d3937f46e98\" (UID: \"8eee52e2-b391-40a5-9baa-7d3937f46e98\") " Sep 18 15:00:22.846797 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.846775 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file" (OuterVolumeSpecName: "config-file") pod "8eee52e2-b391-40a5-9baa-7d3937f46e98" (UID: "8eee52e2-b391-40a5-9baa-7d3937f46e98"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 15:00:22.848466 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.848444 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq" (OuterVolumeSpecName: "kube-api-access-t2jbq") pod "8eee52e2-b391-40a5-9baa-7d3937f46e98" (UID: "8eee52e2-b391-40a5-9baa-7d3937f46e98"). InnerVolumeSpecName "kube-api-access-t2jbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:00:22.947995 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.947964 2548 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eee52e2-b391-40a5-9baa-7d3937f46e98-config-file\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:00:22.947995 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:22.947992 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2jbq\" (UniqueName: \"kubernetes.io/projected/8eee52e2-b391-40a5-9baa-7d3937f46e98-kube-api-access-t2jbq\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:00:23.212351 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.212325 2548 generic.go:356] "Generic (PLEG): container finished" podID="8eee52e2-b391-40a5-9baa-7d3937f46e98" containerID="9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06" exitCode=0 Sep 18 15:00:23.212800 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.212363 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" Sep 18 15:00:23.212800 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.212402 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" event={"ID":"8eee52e2-b391-40a5-9baa-7d3937f46e98","Type":"ContainerDied","Data":"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06"} Sep 18 15:00:23.212800 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.212462 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jk5qh" event={"ID":"8eee52e2-b391-40a5-9baa-7d3937f46e98","Type":"ContainerDied","Data":"419ed17f2a273762e3ea528dc5877af09eb2972a8f3fa8a0f69f8d714824cb86"} Sep 18 15:00:23.212800 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.212497 2548 scope.go:117] "RemoveContainer" containerID="9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06" Sep 18 15:00:23.220830 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.220815 2548 scope.go:117] "RemoveContainer" containerID="9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06" Sep 18 15:00:23.221153 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:00:23.221121 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06\": container with ID starting with 9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06 not found: ID does not exist" containerID="9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06" Sep 18 15:00:23.221235 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.221157 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06"} err="failed to get container status \"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06\": rpc error: code = NotFound desc = could not find container \"9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06\": container with ID starting with 9b45045dd7ca397020b913fdb2cc0d21b2251c49d5cb097afe577a4d9fdaab06 not found: ID does not exist" Sep 18 15:00:23.233136 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.233116 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:23.236827 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:23.236808 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jk5qh"] Sep 18 15:00:24.126305 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:24.126277 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eee52e2-b391-40a5-9baa-7d3937f46e98" path="/var/lib/kubelet/pods/8eee52e2-b391-40a5-9baa-7d3937f46e98/volumes" Sep 18 15:00:28.900389 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900355 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2"] Sep 18 15:00:28.900833 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900775 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" containerName="authorino" Sep 18 15:00:28.900833 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900796 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" containerName="authorino" Sep 18 15:00:28.900833 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900820 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eee52e2-b391-40a5-9baa-7d3937f46e98" containerName="limitador" Sep 18 15:00:28.900833 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900831 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eee52e2-b391-40a5-9baa-7d3937f46e98" containerName="limitador" Sep 18 15:00:28.900984 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900927 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eee52e2-b391-40a5-9baa-7d3937f46e98" containerName="limitador" Sep 18 15:00:28.900984 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.900939 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc413c4a-a65e-4d13-9a88-597ee65f4c2e" containerName="authorino" Sep 18 15:00:28.905422 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.905402 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:28.908382 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.908358 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 18 15:00:28.908495 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.908393 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 15:00:28.909501 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.909484 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 15:00:28.909604 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.909513 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f7bxw\"" Sep 18 15:00:28.914233 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.914214 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2"] Sep 18 15:00:28.991666 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.991639 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87zj\" (UniqueName: \"kubernetes.io/projected/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-kube-api-access-s87zj\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:28.991787 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:28.991713 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-data\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.092206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.092176 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87zj\" (UniqueName: \"kubernetes.io/projected/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-kube-api-access-s87zj\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.092328 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.092232 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-data\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.092543 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.092529 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-data\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.100866 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.100826 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87zj\" (UniqueName: \"kubernetes.io/projected/af398a8a-d7a2-4b9b-9cc7-946ffbf22570-kube-api-access-s87zj\") pod \"postgres-69fb4594cf-fk5r2\" (UID: \"af398a8a-d7a2-4b9b-9cc7-946ffbf22570\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.215832 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.215811 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:29.484586 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:29.484457 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2"] Sep 18 15:00:29.487068 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:29.487045 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf398a8a_d7a2_4b9b_9cc7_946ffbf22570.slice/crio-561f30e6bde03eda94a976c82ef0566ce58d3c2d1b7a369cadb86f80d0e44a4f WatchSource:0}: Error finding container 561f30e6bde03eda94a976c82ef0566ce58d3c2d1b7a369cadb86f80d0e44a4f: Status 404 returned error can't find the container with id 561f30e6bde03eda94a976c82ef0566ce58d3c2d1b7a369cadb86f80d0e44a4f Sep 18 15:00:30.242366 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:30.242328 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" event={"ID":"af398a8a-d7a2-4b9b-9cc7-946ffbf22570","Type":"ContainerStarted","Data":"561f30e6bde03eda94a976c82ef0566ce58d3c2d1b7a369cadb86f80d0e44a4f"} Sep 18 15:00:35.266691 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:35.266654 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" event={"ID":"af398a8a-d7a2-4b9b-9cc7-946ffbf22570","Type":"ContainerStarted","Data":"cbb8ab94efd526204970e41fe9586a172fb035d69894a35f544ecfac533e1309"} Sep 18 15:00:35.267158 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:35.266779 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:35.283976 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:35.283934 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" podStartSLOduration=2.545718092 podStartE2EDuration="7.283921395s" totalImagesPullingTime="4.738203303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:35.282273117 +0000 UTC m=+581.131692958" watchObservedRunningTime="2026-09-18 15:00:35.283921395 +0000 UTC m=+581.133341286" Sep 18 15:00:41.297286 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.297261 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk5r2" Sep 18 15:00:41.866568 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.866535 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:41.868647 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.868630 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:41.871059 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.871036 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cgjfp\"" Sep 18 15:00:41.876893 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.876868 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:41.997580 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:41.997550 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6k5l\" (UniqueName: \"kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l\") pod \"authorino-557f876f69-29tnq\" (UID: \"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1\") " pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:42.098299 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.098277 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6k5l\" (UniqueName: \"kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l\") pod \"authorino-557f876f69-29tnq\" (UID: \"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1\") " pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:42.107281 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.107251 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6k5l\" (UniqueName: \"kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l\") pod \"authorino-557f876f69-29tnq\" (UID: \"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1\") " pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:42.113454 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.113434 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:42.113616 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.113605 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:42.218478 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.218449 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:00:42.220397 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.220382 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.222811 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.222790 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 18 15:00:42.228194 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.228176 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:00:42.300396 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.300374 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.300683 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.300401 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7q2x\" (UniqueName: \"kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.377258 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.377239 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:42.379538 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:42.379507 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7006bbd7_50c3_4f8e_99b1_efc2d4a98dd1.slice/crio-4debab25f09a33637534b04c10e211b15f42fa763e0aa7be5839bf4420983696 WatchSource:0}: Error finding container 4debab25f09a33637534b04c10e211b15f42fa763e0aa7be5839bf4420983696: Status 404 returned error can't find the container with id 4debab25f09a33637534b04c10e211b15f42fa763e0aa7be5839bf4420983696 Sep 18 15:00:42.400917 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.400899 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.401006 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.400928 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7q2x\" (UniqueName: \"kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.403098 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.403076 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.408928 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.408908 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7q2x\" (UniqueName: \"kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x\") pod \"authorino-695c59dc74-b8fdr\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.529639 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.529614 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:00:42.793450 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:42.793422 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:00:42.809941 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:42.809914 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda747670c_835f_481b_9d02_516c7973af51.slice/crio-a6e9f0c74901399a44082a7019f822e1c9838b4949740771e9fa0a7c090c90f6 WatchSource:0}: Error finding container a6e9f0c74901399a44082a7019f822e1c9838b4949740771e9fa0a7c090c90f6: Status 404 returned error can't find the container with id a6e9f0c74901399a44082a7019f822e1c9838b4949740771e9fa0a7c090c90f6 Sep 18 15:00:43.301277 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.301236 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695c59dc74-b8fdr" event={"ID":"a747670c-835f-481b-9d02-516c7973af51","Type":"ContainerStarted","Data":"a6e9f0c74901399a44082a7019f822e1c9838b4949740771e9fa0a7c090c90f6"} Sep 18 15:00:43.302612 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.302586 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-29tnq" event={"ID":"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1","Type":"ContainerStarted","Data":"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8"} Sep 18 15:00:43.302705 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.302626 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-29tnq" event={"ID":"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1","Type":"ContainerStarted","Data":"4debab25f09a33637534b04c10e211b15f42fa763e0aa7be5839bf4420983696"} Sep 18 15:00:43.302705 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.302653 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-29tnq" podUID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" containerName="authorino" containerID="cri-o://263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8" gracePeriod=30 Sep 18 15:00:43.317668 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.317625 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-29tnq" podStartSLOduration=1.919634131 podStartE2EDuration="2.317609844s" totalImagesPullingTime="397.975713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:43.317404937 +0000 UTC m=+589.166824780" watchObservedRunningTime="2026-09-18 15:00:43.317609844 +0000 UTC m=+589.167029720" Sep 18 15:00:43.605948 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.605923 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:43.710457 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.710438 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6k5l\" (UniqueName: \"kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l\") pod \"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1\" (UID: \"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1\") " Sep 18 15:00:43.712246 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.712216 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l" (OuterVolumeSpecName: "kube-api-access-s6k5l") pod "7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" (UID: "7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1"). InnerVolumeSpecName "kube-api-access-s6k5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:00:43.811087 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:43.811024 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6k5l\" (UniqueName: \"kubernetes.io/projected/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1-kube-api-access-s6k5l\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:00:44.307598 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.307570 2548 generic.go:356] "Generic (PLEG): container finished" podID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" containerID="263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8" exitCode=0 Sep 18 15:00:44.308090 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.307614 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-29tnq" Sep 18 15:00:44.308090 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.307658 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-29tnq" event={"ID":"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1","Type":"ContainerDied","Data":"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8"} Sep 18 15:00:44.308090 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.307703 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-29tnq" event={"ID":"7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1","Type":"ContainerDied","Data":"4debab25f09a33637534b04c10e211b15f42fa763e0aa7be5839bf4420983696"} Sep 18 15:00:44.308090 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.307730 2548 scope.go:117] "RemoveContainer" containerID="263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8" Sep 18 15:00:44.309523 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.309497 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695c59dc74-b8fdr" event={"ID":"a747670c-835f-481b-9d02-516c7973af51","Type":"ContainerStarted","Data":"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf"} Sep 18 15:00:44.315985 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.315936 2548 scope.go:117] "RemoveContainer" containerID="263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8" Sep 18 15:00:44.316203 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:00:44.316187 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8\": container with ID starting with 263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8 not found: ID does not exist" containerID="263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8" Sep 18 15:00:44.316252 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.316209 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8"} err="failed to get container status \"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8\": rpc error: code = NotFound desc = could not find container \"263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8\": container with ID starting with 263b35b4310ff1bef3ab3b485aed1ba73d54d396fc73d85a0e4696e22b5df3c8 not found: ID does not exist" Sep 18 15:00:44.324281 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.324262 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:44.330535 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.330511 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-29tnq"] Sep 18 15:00:44.343733 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:44.343690 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-695c59dc74-b8fdr" podStartSLOduration=1.520911433 podStartE2EDuration="2.343678792s" totalImagesPullingTime="822.767359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:44.343244413 +0000 UTC m=+590.192664258" watchObservedRunningTime="2026-09-18 15:00:44.343678792 +0000 UTC m=+590.193098633" Sep 18 15:00:46.130008 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:46.129972 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" path="/var/lib/kubelet/pods/7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1/volumes" Sep 18 15:00:49.916715 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.916684 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:00:49.917105 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.917089 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" containerName="authorino" Sep 18 15:00:49.917149 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.917108 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" containerName="authorino" Sep 18 15:00:49.917205 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.917195 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="7006bbd7-50c3-4f8e-99b1-efc2d4a98dd1" containerName="authorino" Sep 18 15:00:49.922038 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.922018 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:49.927249 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.927207 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 15:00:49.927356 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.927296 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 15:00:49.927405 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.927357 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 15:00:49.927405 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.927304 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcjcb\"" Sep 18 15:00:49.931407 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:49.931384 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:00:50.051383 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.051351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfpcb\" (UniqueName: \"kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.051526 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.051472 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.051526 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.051503 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.108691 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.108665 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:00:50.111083 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.111066 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.131478 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.131459 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:00:50.152413 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.152389 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.152525 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.152426 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.152525 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.152476 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfpcb\" (UniqueName: \"kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.152628 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:00:50.152567 2548 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 18 15:00:50.152628 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:00:50.152619 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert podName:706b1d54-8191-49b9-871e-c234d8ca97cb nodeName:}" failed. No retries permitted until 2026-09-18 15:00:50.652604128 +0000 UTC m=+596.502023952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert") pod "maas-controller-75dc6cbdf-rgp7c" (UID: "706b1d54-8191-49b9-871e-c234d8ca97cb") : secret "maas-controller-webhook-cert" not found Sep 18 15:00:50.154757 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.154739 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.161654 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.161632 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfpcb\" (UniqueName: \"kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.253464 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.253440 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.253559 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.253494 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6w6\" (UniqueName: \"kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.253609 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.253554 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.354005 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.353977 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.354128 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.354023 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6w6\" (UniqueName: \"kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.354128 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.354042 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.356282 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.356262 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.356431 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.356411 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.362551 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.362533 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6w6\" (UniqueName: \"kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6\") pod \"maas-controller-9c6bbf6d9-5nxww\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.421006 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.420985 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:50.657186 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.657111 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.659435 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.659417 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") pod \"maas-controller-75dc6cbdf-rgp7c\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:50.691230 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.691210 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:00:50.693255 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:50.693227 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead85159_c9b0_4962_aedc_9f75767c0899.slice/crio-844c8b44a2a0028c7bfc95bc6f4e6039e3c90e292718d84a4d11ac5f5bfb8609 WatchSource:0}: Error finding container 844c8b44a2a0028c7bfc95bc6f4e6039e3c90e292718d84a4d11ac5f5bfb8609: Status 404 returned error can't find the container with id 844c8b44a2a0028c7bfc95bc6f4e6039e3c90e292718d84a4d11ac5f5bfb8609 Sep 18 15:00:50.833639 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:50.833612 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:51.100671 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:51.100651 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:00:51.102461 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:00:51.102438 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706b1d54_8191_49b9_871e_c234d8ca97cb.slice/crio-a7362c2d4f4f5ffc82bf13cd581a96524687f1bc44c6327c3d75944505a21ca8 WatchSource:0}: Error finding container a7362c2d4f4f5ffc82bf13cd581a96524687f1bc44c6327c3d75944505a21ca8: Status 404 returned error can't find the container with id a7362c2d4f4f5ffc82bf13cd581a96524687f1bc44c6327c3d75944505a21ca8 Sep 18 15:00:51.338995 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:51.338955 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" event={"ID":"ead85159-c9b0-4962-aedc-9f75767c0899","Type":"ContainerStarted","Data":"844c8b44a2a0028c7bfc95bc6f4e6039e3c90e292718d84a4d11ac5f5bfb8609"} Sep 18 15:00:51.340389 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:51.340357 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" event={"ID":"706b1d54-8191-49b9-871e-c234d8ca97cb","Type":"ContainerStarted","Data":"a7362c2d4f4f5ffc82bf13cd581a96524687f1bc44c6327c3d75944505a21ca8"} Sep 18 15:00:54.355114 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.355079 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" event={"ID":"706b1d54-8191-49b9-871e-c234d8ca97cb","Type":"ContainerStarted","Data":"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00"} Sep 18 15:00:54.355575 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.355238 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:00:54.356592 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.356567 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" event={"ID":"ead85159-c9b0-4962-aedc-9f75767c0899","Type":"ContainerStarted","Data":"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83"} Sep 18 15:00:54.356730 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.356713 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:00:54.373157 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.373118 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" podStartSLOduration=3.161442234 podStartE2EDuration="5.373104478s" totalImagesPullingTime="2.211662244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:54.372426618 +0000 UTC m=+600.221846461" watchObservedRunningTime="2026-09-18 15:00:54.373104478 +0000 UTC m=+600.222524320" Sep 18 15:00:54.389298 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:54.389257 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" podStartSLOduration=1.772767081 podStartE2EDuration="4.389243469s" totalImagesPullingTime="2.616476388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:00:54.388818678 +0000 UTC m=+600.238238528" watchObservedRunningTime="2026-09-18 15:00:54.389243469 +0000 UTC m=+600.238663351" Sep 18 15:00:56.079953 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:56.079922 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 15:00:56.080356 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:00:56.080328 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 15:01:05.364598 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.364566 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:01:05.365099 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.364639 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:01:05.431760 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.431726 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:01:05.431992 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.431960 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" podUID="706b1d54-8191-49b9-871e-c234d8ca97cb" containerName="manager" containerID="cri-o://a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00" gracePeriod=30 Sep 18 15:01:05.675411 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.675388 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:01:05.781975 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.781948 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") pod \"706b1d54-8191-49b9-871e-c234d8ca97cb\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " Sep 18 15:01:05.781975 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.781978 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs\") pod \"706b1d54-8191-49b9-871e-c234d8ca97cb\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " Sep 18 15:01:05.782189 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.782063 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfpcb\" (UniqueName: \"kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb\") pod \"706b1d54-8191-49b9-871e-c234d8ca97cb\" (UID: \"706b1d54-8191-49b9-871e-c234d8ca97cb\") " Sep 18 15:01:05.784193 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.784158 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "706b1d54-8191-49b9-871e-c234d8ca97cb" (UID: "706b1d54-8191-49b9-871e-c234d8ca97cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:01:05.784193 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.784173 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "706b1d54-8191-49b9-871e-c234d8ca97cb" (UID: "706b1d54-8191-49b9-871e-c234d8ca97cb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:01:05.784371 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.784226 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb" (OuterVolumeSpecName: "kube-api-access-dfpcb") pod "706b1d54-8191-49b9-871e-c234d8ca97cb" (UID: "706b1d54-8191-49b9-871e-c234d8ca97cb"). InnerVolumeSpecName "kube-api-access-dfpcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:01:05.883316 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.883290 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfpcb\" (UniqueName: \"kubernetes.io/projected/706b1d54-8191-49b9-871e-c234d8ca97cb-kube-api-access-dfpcb\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:01:05.883316 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.883311 2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-webhook-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:01:05.883316 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:05.883320 2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706b1d54-8191-49b9-871e-c234d8ca97cb-metrics-certs\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:01:06.409084 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.409005 2548 generic.go:356] "Generic (PLEG): container finished" podID="706b1d54-8191-49b9-871e-c234d8ca97cb" containerID="a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00" exitCode=0 Sep 18 15:01:06.409084 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.409054 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" Sep 18 15:01:06.409084 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.409065 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" event={"ID":"706b1d54-8191-49b9-871e-c234d8ca97cb","Type":"ContainerDied","Data":"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00"} Sep 18 15:01:06.409547 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.409112 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-rgp7c" event={"ID":"706b1d54-8191-49b9-871e-c234d8ca97cb","Type":"ContainerDied","Data":"a7362c2d4f4f5ffc82bf13cd581a96524687f1bc44c6327c3d75944505a21ca8"} Sep 18 15:01:06.409547 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.409135 2548 scope.go:117] "RemoveContainer" containerID="a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00" Sep 18 15:01:06.416686 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.416669 2548 scope.go:117] "RemoveContainer" containerID="a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00" Sep 18 15:01:06.416993 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:01:06.416973 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00\": container with ID starting with a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00 not found: ID does not exist" containerID="a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00" Sep 18 15:01:06.417062 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.417006 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00"} err="failed to get container status \"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00\": rpc error: code = NotFound desc = could not find container \"a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00\": container with ID starting with a43b1544dbaa3546c64cc1e2dea1e3157f3a8ab0776aefa099d018b98b2b5f00 not found: ID does not exist" Sep 18 15:01:06.425489 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.425466 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:01:06.429568 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:06.429549 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-rgp7c"] Sep 18 15:01:08.126670 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:08.126643 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706b1d54-8191-49b9-871e-c234d8ca97cb" path="/var/lib/kubelet/pods/706b1d54-8191-49b9-871e-c234d8ca97cb/volumes" Sep 18 15:01:27.336628 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.336598 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:01:27.337004 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.336908 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706b1d54-8191-49b9-871e-c234d8ca97cb" containerName="manager" Sep 18 15:01:27.337004 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.336921 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="706b1d54-8191-49b9-871e-c234d8ca97cb" containerName="manager" Sep 18 15:01:27.337074 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.337006 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="706b1d54-8191-49b9-871e-c234d8ca97cb" containerName="manager" Sep 18 15:01:27.345168 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.345146 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.347954 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.347932 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-45zns\"" Sep 18 15:01:27.348083 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.347932 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 15:01:27.350941 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.350913 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:01:27.443572 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.443539 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8bdf\" (UniqueName: \"kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.443784 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.443624 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.443901 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.443885 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:01:27.446002 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.445985 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.458140 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.458117 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:01:27.544200 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.544173 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.544365 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.544214 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.544365 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.544270 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8bdf\" (UniqueName: \"kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.544365 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.544296 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnhfm\" (UniqueName: \"kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.544993 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.544974 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.552555 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.552529 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8bdf\" (UniqueName: \"kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf\") pod \"payload-pre-processing-59fbc47bf8-vnmc7\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.645243 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.645147 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnhfm\" (UniqueName: \"kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.645243 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.645225 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.645865 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.645829 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.654726 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.654693 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnhfm\" (UniqueName: \"kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm\") pod \"payload-processing-5b54b7fbb7-2cfgs\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.656544 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.656522 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:27.757715 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.757685 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:27.932622 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:27.932459 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:01:27.937605 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:01:27.937574 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1ed4e2_c88c_4218_b64f_147d3f2bbe3f.slice/crio-87c8db47d5bb5e79dab68e7ff9d2882199359eafb7e005eb8e992ff833532526 WatchSource:0}: Error finding container 87c8db47d5bb5e79dab68e7ff9d2882199359eafb7e005eb8e992ff833532526: Status 404 returned error can't find the container with id 87c8db47d5bb5e79dab68e7ff9d2882199359eafb7e005eb8e992ff833532526 Sep 18 15:01:28.036251 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:28.036224 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:01:28.038607 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:01:28.038585 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c906cf6_29a0_4492_ab73_29e20470e090.slice/crio-80a3ef5a0e5acc6d504d29958cfb3a67765795f0bd75a1b6b5c481d370d0236f WatchSource:0}: Error finding container 80a3ef5a0e5acc6d504d29958cfb3a67765795f0bd75a1b6b5c481d370d0236f: Status 404 returned error can't find the container with id 80a3ef5a0e5acc6d504d29958cfb3a67765795f0bd75a1b6b5c481d370d0236f Sep 18 15:01:28.501279 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:28.501229 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" event={"ID":"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f","Type":"ContainerStarted","Data":"87c8db47d5bb5e79dab68e7ff9d2882199359eafb7e005eb8e992ff833532526"} Sep 18 15:01:28.502863 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:28.502824 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" event={"ID":"2c906cf6-29a0-4492-ab73-29e20470e090","Type":"ContainerStarted","Data":"80a3ef5a0e5acc6d504d29958cfb3a67765795f0bd75a1b6b5c481d370d0236f"} Sep 18 15:01:31.521311 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.521274 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" event={"ID":"2c906cf6-29a0-4492-ab73-29e20470e090","Type":"ContainerStarted","Data":"0bf0a23157a22d07ff0a10f4f205c49a1a961d5e29fd85dbe68dae7d9bbc21ba"} Sep 18 15:01:31.521773 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.521459 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:31.522900 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.522877 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" event={"ID":"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f","Type":"ContainerStarted","Data":"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62"} Sep 18 15:01:31.523074 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.523057 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:31.537884 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.537828 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" podStartSLOduration=1.511891507 podStartE2EDuration="4.537815548s" totalImagesPullingTime="3.025924041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:01:31.536937158 +0000 UTC m=+637.386357000" watchObservedRunningTime="2026-09-18 15:01:31.537815548 +0000 UTC m=+637.387235389" Sep 18 15:01:31.553358 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:31.553314 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" podStartSLOduration=1.436173092 podStartE2EDuration="4.553302403s" totalImagesPullingTime="3.117129311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:01:31.551953702 +0000 UTC m=+637.401373545" watchObservedRunningTime="2026-09-18 15:01:31.553302403 +0000 UTC m=+637.402722307" Sep 18 15:01:36.544224 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.544163 2548 generic.go:356] "Generic (PLEG): container finished" podID="ddf31a32-c319-44bb-8708-18984eb680d0" containerID="37ca3531b7693146eda35d752f8aecc1c6f1408d1678c19e2c159db8571641de" exitCode=0 Sep 18 15:01:36.544586 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.544246 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" event={"ID":"ddf31a32-c319-44bb-8708-18984eb680d0","Type":"ContainerDied","Data":"37ca3531b7693146eda35d752f8aecc1c6f1408d1678c19e2c159db8571641de"} Sep 18 15:01:36.544627 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.544590 2548 scope.go:117] "RemoveContainer" containerID="37ca3531b7693146eda35d752f8aecc1c6f1408d1678c19e2c159db8571641de" Sep 18 15:01:36.545658 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.545626 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 15:01:36.545733 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.545715 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 15:01:36.545784 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:36.545770 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 15:01:37.551066 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:37.551029 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" event={"ID":"ddf31a32-c319-44bb-8708-18984eb680d0","Type":"ContainerStarted","Data":"ba8fb3eb90826c7ecadb1e25a2d36ede3c6aa8848a147f1eac439230e39d3b21"} Sep 18 15:01:37.737386 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:37.737350 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 15:01:37.738456 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:37.738429 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-z5fpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Sep 18 15:01:37.738576 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:37.738479 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podUID="ddf31a32-c319-44bb-8708-18984eb680d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Sep 18 15:01:38.737591 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:38.737556 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-z5fpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Sep 18 15:01:38.738005 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:38.737617 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podUID="ddf31a32-c319-44bb-8708-18984eb680d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Sep 18 15:01:39.738214 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:39.738180 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-z5fpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Sep 18 15:01:39.738588 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:39.738231 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podUID="ddf31a32-c319-44bb-8708-18984eb680d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Sep 18 15:01:40.737414 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:40.737377 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-z5fpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Sep 18 15:01:40.737587 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:40.737435 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podUID="ddf31a32-c319-44bb-8708-18984eb680d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Sep 18 15:01:41.737546 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:41.737508 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-z5fpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Sep 18 15:01:41.737983 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:41.737565 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" podUID="ddf31a32-c319-44bb-8708-18984eb680d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Sep 18 15:01:42.105210 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:42.105119 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 15:01:42.528935 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:42.528906 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:01:42.529100 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:42.528971 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:01:42.740894 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:42.740864 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 15:01:42.741958 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:01:42.741940 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-z5fpg" Sep 18 15:02:02.924354 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.924319 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt"] Sep 18 15:02:02.927676 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.927652 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:02.930220 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.930197 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 15:02:02.930342 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.930267 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 15:02:02.931595 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.931573 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l7zwm\"" Sep 18 15:02:02.931690 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.931626 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 18 15:02:02.940339 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:02.940311 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt"] Sep 18 15:02:03.030093 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030065 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.030206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030098 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.030206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030118 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.030206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030143 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.030206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030188 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.030206 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.030203 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c48z\" (UniqueName: \"kubernetes.io/projected/37e43608-9b85-4f82-b2c7-bcae9a9c6156-kube-api-access-2c48z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.130795 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130768 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.130795 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130795 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c48z\" (UniqueName: \"kubernetes.io/projected/37e43608-9b85-4f82-b2c7-bcae9a9c6156-kube-api-access-2c48z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131008 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130882 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131008 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130906 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131008 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130931 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131008 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.130967 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131243 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.131221 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131310 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.131287 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.131368 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.131353 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.133107 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.133087 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e43608-9b85-4f82-b2c7-bcae9a9c6156-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.133374 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.133356 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e43608-9b85-4f82-b2c7-bcae9a9c6156-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.139072 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.139052 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c48z\" (UniqueName: \"kubernetes.io/projected/37e43608-9b85-4f82-b2c7-bcae9a9c6156-kube-api-access-2c48z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q2pwt\" (UID: \"37e43608-9b85-4f82-b2c7-bcae9a9c6156\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.238277 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.238220 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:03.538372 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.538300 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt"] Sep 18 15:02:03.542717 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:02:03.542692 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e43608_9b85_4f82_b2c7_bcae9a9c6156.slice/crio-038df778f78b50a6474ddc9b255be383b523e1a0489c61c78372684762bc76a6 WatchSource:0}: Error finding container 038df778f78b50a6474ddc9b255be383b523e1a0489c61c78372684762bc76a6: Status 404 returned error can't find the container with id 038df778f78b50a6474ddc9b255be383b523e1a0489c61c78372684762bc76a6 Sep 18 15:02:03.665284 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:03.665243 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" event={"ID":"37e43608-9b85-4f82-b2c7-bcae9a9c6156","Type":"ContainerStarted","Data":"038df778f78b50a6474ddc9b255be383b523e1a0489c61c78372684762bc76a6"} Sep 18 15:02:04.671209 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:04.671184 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" event={"ID":"37e43608-9b85-4f82-b2c7-bcae9a9c6156","Type":"ContainerStarted","Data":"b82ef6f280758b23e5af39c0b772a510dcf912cc5f861a6ff4eff5fe154d811c"} Sep 18 15:02:04.690117 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:04.690070 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" podStartSLOduration=1.6251682170000001 podStartE2EDuration="2.690054986s" totalImagesPullingTime="1.064886769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:02:04.688602869 +0000 UTC m=+670.538022711" watchObservedRunningTime="2026-09-18 15:02:04.690054986 +0000 UTC m=+670.539474827" Sep 18 15:02:13.238653 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:13.238622 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:13.239141 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:13.238679 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:13.251317 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:13.251290 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:13.721026 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:13.720997 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q2pwt" Sep 18 15:02:22.245430 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.245400 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g"] Sep 18 15:02:22.248037 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.248022 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.250665 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.250635 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 18 15:02:22.258157 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.258137 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g"] Sep 18 15:02:22.279051 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279026 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.279140 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279081 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdlft\" (UniqueName: \"kubernetes.io/projected/23ba0a66-f31b-40fc-8192-1eebd7255049-kube-api-access-sdlft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.279140 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279131 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.279251 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279236 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.279305 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279291 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba0a66-f31b-40fc-8192-1eebd7255049-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.279367 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.279347 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380193 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380168 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380334 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380216 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380334 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380279 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba0a66-f31b-40fc-8192-1eebd7255049-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380427 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380347 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380427 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380381 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380427 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380409 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdlft\" (UniqueName: \"kubernetes.io/projected/23ba0a66-f31b-40fc-8192-1eebd7255049-kube-api-access-sdlft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380689 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380640 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380811 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380725 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.380905 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.380867 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.382403 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.382380 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ba0a66-f31b-40fc-8192-1eebd7255049-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.382588 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.382571 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba0a66-f31b-40fc-8192-1eebd7255049-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.390562 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.390534 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdlft\" (UniqueName: \"kubernetes.io/projected/23ba0a66-f31b-40fc-8192-1eebd7255049-kube-api-access-sdlft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g\" (UID: \"23ba0a66-f31b-40fc-8192-1eebd7255049\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.558886 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.558800 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:22.826187 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.826160 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g"] Sep 18 15:02:22.828620 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:02:22.828592 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ba0a66_f31b_40fc_8192_1eebd7255049.slice/crio-70f62a139c8bac625f5a1f1cd8f3865b011874347104818903ba0a4fe4c8c2b0 WatchSource:0}: Error finding container 70f62a139c8bac625f5a1f1cd8f3865b011874347104818903ba0a4fe4c8c2b0: Status 404 returned error can't find the container with id 70f62a139c8bac625f5a1f1cd8f3865b011874347104818903ba0a4fe4c8c2b0 Sep 18 15:02:22.829955 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:22.829936 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 15:02:23.754839 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:23.754805 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" event={"ID":"23ba0a66-f31b-40fc-8192-1eebd7255049","Type":"ContainerStarted","Data":"72a84f653ab30e21a744aef65622643471ab08b61e1b43d93f019d48fad32741"} Sep 18 15:02:23.755242 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:23.754892 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" event={"ID":"23ba0a66-f31b-40fc-8192-1eebd7255049","Type":"ContainerStarted","Data":"70f62a139c8bac625f5a1f1cd8f3865b011874347104818903ba0a4fe4c8c2b0"} Sep 18 15:02:23.777061 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:23.777018 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" podStartSLOduration=1.603037496 podStartE2EDuration="1.777004682s" totalImagesPullingTime="173.967186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:02:23.775368893 +0000 UTC m=+689.624788738" watchObservedRunningTime="2026-09-18 15:02:23.777004682 +0000 UTC m=+689.626424524" Sep 18 15:02:32.559776 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:32.559744 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:32.560170 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:32.559804 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:32.572115 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:32.572096 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:02:32.803804 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:02:32.803771 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwjd7g" Sep 18 15:04:00.573037 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.573003 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cd4c94bc-ljsq8"] Sep 18 15:04:00.575770 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.575754 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.581016 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.580992 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd4c94bc-ljsq8"] Sep 18 15:04:00.671029 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.671005 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e176613-959e-40f8-ad70-6968722d7363-tls-cert\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.671146 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.671057 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/6e176613-959e-40f8-ad70-6968722d7363-kube-api-access-zf925\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.772043 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.772021 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e176613-959e-40f8-ad70-6968722d7363-tls-cert\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.772160 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.772069 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/6e176613-959e-40f8-ad70-6968722d7363-kube-api-access-zf925\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.774419 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.774390 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e176613-959e-40f8-ad70-6968722d7363-tls-cert\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.780719 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.780702 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/6e176613-959e-40f8-ad70-6968722d7363-kube-api-access-zf925\") pod \"authorino-5cd4c94bc-ljsq8\" (UID: \"6e176613-959e-40f8-ad70-6968722d7363\") " pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:00.885781 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:00.885714 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" Sep 18 15:04:01.150362 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:01.150339 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd4c94bc-ljsq8"] Sep 18 15:04:01.152490 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:04:01.152462 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e176613_959e_40f8_ad70_6968722d7363.slice/crio-6aa97f75de7211af0a2da650fe756b80d06fff91449efe7cab43fa87f741085d WatchSource:0}: Error finding container 6aa97f75de7211af0a2da650fe756b80d06fff91449efe7cab43fa87f741085d: Status 404 returned error can't find the container with id 6aa97f75de7211af0a2da650fe756b80d06fff91449efe7cab43fa87f741085d Sep 18 15:04:01.158583 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:01.158533 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" event={"ID":"6e176613-959e-40f8-ad70-6968722d7363","Type":"ContainerStarted","Data":"6aa97f75de7211af0a2da650fe756b80d06fff91449efe7cab43fa87f741085d"} Sep 18 15:04:03.169107 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.169069 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" event={"ID":"6e176613-959e-40f8-ad70-6968722d7363","Type":"ContainerStarted","Data":"63bb989eea6508bc8b256c5e32447854a7fa3e8016a27a44001ca70106efb731"} Sep 18 15:04:03.186564 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.186519 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cd4c94bc-ljsq8" podStartSLOduration=1.9501740829999998 podStartE2EDuration="3.186503353s" totalImagesPullingTime="1.23632927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:04:03.18504995 +0000 UTC m=+789.034469799" watchObservedRunningTime="2026-09-18 15:04:03.186503353 +0000 UTC m=+789.035923195" Sep 18 15:04:03.229881 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.229288 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:04:03.230037 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.229968 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-695c59dc74-b8fdr" podUID="a747670c-835f-481b-9d02-516c7973af51" containerName="authorino" containerID="cri-o://f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf" gracePeriod=30 Sep 18 15:04:03.489465 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.489215 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:04:03.604507 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.604467 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7q2x\" (UniqueName: \"kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x\") pod \"a747670c-835f-481b-9d02-516c7973af51\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " Sep 18 15:04:03.604682 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.604588 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert\") pod \"a747670c-835f-481b-9d02-516c7973af51\" (UID: \"a747670c-835f-481b-9d02-516c7973af51\") " Sep 18 15:04:03.606668 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.606637 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x" (OuterVolumeSpecName: "kube-api-access-k7q2x") pod "a747670c-835f-481b-9d02-516c7973af51" (UID: "a747670c-835f-481b-9d02-516c7973af51"). InnerVolumeSpecName "kube-api-access-k7q2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:04:03.615401 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.615370 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a747670c-835f-481b-9d02-516c7973af51" (UID: "a747670c-835f-481b-9d02-516c7973af51"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:04:03.706320 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.706280 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7q2x\" (UniqueName: \"kubernetes.io/projected/a747670c-835f-481b-9d02-516c7973af51-kube-api-access-k7q2x\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:03.706320 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.706318 2548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a747670c-835f-481b-9d02-516c7973af51-tls-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:03.730084 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.730012 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:04:03.730271 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.730225 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" podUID="ead85159-c9b0-4962-aedc-9f75767c0899" containerName="manager" containerID="cri-o://d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83" gracePeriod=30 Sep 18 15:04:03.950207 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.950171 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:04:03.950422 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:03.950390 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" podUID="2c906cf6-29a0-4492-ab73-29e20470e090" containerName="payload-processing" containerID="cri-o://0bf0a23157a22d07ff0a10f4f205c49a1a961d5e29fd85dbe68dae7d9bbc21ba" gracePeriod=30 Sep 18 15:04:04.075113 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.075083 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:04:04.085244 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.085220 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:04:04.085561 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.085533 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" podUID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" containerName="payload-pre-processing" containerID="cri-o://b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62" gracePeriod=30 Sep 18 15:04:04.175553 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.175521 2548 generic.go:356] "Generic (PLEG): container finished" podID="2c906cf6-29a0-4492-ab73-29e20470e090" containerID="0bf0a23157a22d07ff0a10f4f205c49a1a961d5e29fd85dbe68dae7d9bbc21ba" exitCode=0 Sep 18 15:04:04.175974 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.175587 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" event={"ID":"2c906cf6-29a0-4492-ab73-29e20470e090","Type":"ContainerDied","Data":"0bf0a23157a22d07ff0a10f4f205c49a1a961d5e29fd85dbe68dae7d9bbc21ba"} Sep 18 15:04:04.177169 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.177142 2548 generic.go:356] "Generic (PLEG): container finished" podID="a747670c-835f-481b-9d02-516c7973af51" containerID="f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf" exitCode=0 Sep 18 15:04:04.177295 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.177206 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695c59dc74-b8fdr" Sep 18 15:04:04.177295 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.177217 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695c59dc74-b8fdr" event={"ID":"a747670c-835f-481b-9d02-516c7973af51","Type":"ContainerDied","Data":"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf"} Sep 18 15:04:04.177295 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.177255 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695c59dc74-b8fdr" event={"ID":"a747670c-835f-481b-9d02-516c7973af51","Type":"ContainerDied","Data":"a6e9f0c74901399a44082a7019f822e1c9838b4949740771e9fa0a7c090c90f6"} Sep 18 15:04:04.177295 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.177278 2548 scope.go:117] "RemoveContainer" containerID="f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf" Sep 18 15:04:04.179241 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.179132 2548 generic.go:356] "Generic (PLEG): container finished" podID="ead85159-c9b0-4962-aedc-9f75767c0899" containerID="d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83" exitCode=0 Sep 18 15:04:04.179241 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.179158 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" event={"ID":"ead85159-c9b0-4962-aedc-9f75767c0899","Type":"ContainerDied","Data":"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83"} Sep 18 15:04:04.179241 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.179193 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" Sep 18 15:04:04.179241 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.179207 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-5nxww" event={"ID":"ead85159-c9b0-4962-aedc-9f75767c0899","Type":"ContainerDied","Data":"844c8b44a2a0028c7bfc95bc6f4e6039e3c90e292718d84a4d11ac5f5bfb8609"} Sep 18 15:04:04.193802 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.193782 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:04:04.198773 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.198745 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-695c59dc74-b8fdr"] Sep 18 15:04:04.208562 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.208018 2548 scope.go:117] "RemoveContainer" containerID="f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf" Sep 18 15:04:04.208562 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:04.208481 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf\": container with ID starting with f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf not found: ID does not exist" containerID="f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf" Sep 18 15:04:04.208562 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.208513 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf"} err="failed to get container status \"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf\": rpc error: code = NotFound desc = could not find container \"f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf\": container with ID starting with f172979a19313b1b4186174ff312cf43013da0c8e45c30972a582722c1248ddf not found: ID does not exist" Sep 18 15:04:04.208562 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.208537 2548 scope.go:117] "RemoveContainer" containerID="d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83" Sep 18 15:04:04.212141 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.212091 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs\") pod \"ead85159-c9b0-4962-aedc-9f75767c0899\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " Sep 18 15:04:04.212243 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.212148 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert\") pod \"ead85159-c9b0-4962-aedc-9f75767c0899\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " Sep 18 15:04:04.212243 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.212198 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w6w6\" (UniqueName: \"kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6\") pod \"ead85159-c9b0-4962-aedc-9f75767c0899\" (UID: \"ead85159-c9b0-4962-aedc-9f75767c0899\") " Sep 18 15:04:04.214480 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.214445 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ead85159-c9b0-4962-aedc-9f75767c0899" (UID: "ead85159-c9b0-4962-aedc-9f75767c0899"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:04:04.214624 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.214598 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ead85159-c9b0-4962-aedc-9f75767c0899" (UID: "ead85159-c9b0-4962-aedc-9f75767c0899"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 15:04:04.214715 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.214658 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6" (OuterVolumeSpecName: "kube-api-access-5w6w6") pod "ead85159-c9b0-4962-aedc-9f75767c0899" (UID: "ead85159-c9b0-4962-aedc-9f75767c0899"). InnerVolumeSpecName "kube-api-access-5w6w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:04:04.217554 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.217532 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:04:04.218032 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.218014 2548 scope.go:117] "RemoveContainer" containerID="d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83" Sep 18 15:04:04.218301 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:04.218281 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83\": container with ID starting with d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83 not found: ID does not exist" containerID="d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83" Sep 18 15:04:04.218370 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.218305 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83"} err="failed to get container status \"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83\": rpc error: code = NotFound desc = could not find container \"d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83\": container with ID starting with d76df5cfede98d8972d188f4ee7cd3057b36a17f662c13022858ff4518747d83 not found: ID does not exist" Sep 18 15:04:04.313926 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.313649 2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-webhook-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.313926 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.313682 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w6w6\" (UniqueName: \"kubernetes.io/projected/ead85159-c9b0-4962-aedc-9f75767c0899-kube-api-access-5w6w6\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.313926 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.313697 2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ead85159-c9b0-4962-aedc-9f75767c0899-metrics-certs\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.344503 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.344479 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:04:04.414680 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.414647 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume\") pod \"2c906cf6-29a0-4492-ab73-29e20470e090\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " Sep 18 15:04:04.414826 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.414692 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnhfm\" (UniqueName: \"kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm\") pod \"2c906cf6-29a0-4492-ab73-29e20470e090\" (UID: \"2c906cf6-29a0-4492-ab73-29e20470e090\") " Sep 18 15:04:04.415001 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.414978 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c906cf6-29a0-4492-ab73-29e20470e090" (UID: "2c906cf6-29a0-4492-ab73-29e20470e090"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 15:04:04.416821 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.416784 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm" (OuterVolumeSpecName: "kube-api-access-nnhfm") pod "2c906cf6-29a0-4492-ab73-29e20470e090" (UID: "2c906cf6-29a0-4492-ab73-29e20470e090"). InnerVolumeSpecName "kube-api-access-nnhfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:04:04.499466 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.499439 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:04:04.502357 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.502332 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-5nxww"] Sep 18 15:04:04.515934 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.515913 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume\") pod \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " Sep 18 15:04:04.516043 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.515958 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8bdf\" (UniqueName: \"kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf\") pod \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\" (UID: \"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f\") " Sep 18 15:04:04.516144 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.516132 2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c906cf6-29a0-4492-ab73-29e20470e090-plugins-config-volume\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.516207 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.516144 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnhfm\" (UniqueName: \"kubernetes.io/projected/2c906cf6-29a0-4492-ab73-29e20470e090-kube-api-access-nnhfm\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.516335 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.516313 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" (UID: "5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 15:04:04.518061 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.518040 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf" (OuterVolumeSpecName: "kube-api-access-p8bdf") pod "5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" (UID: "5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f"). InnerVolumeSpecName "kube-api-access-p8bdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 15:04:04.616554 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.616485 2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-plugins-config-volume\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.616554 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.616512 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8bdf\" (UniqueName: \"kubernetes.io/projected/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f-kube-api-access-p8bdf\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Sep 18 15:04:04.764505 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.764467 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-klg6d"] Sep 18 15:04:04.764965 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.764944 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" containerName="payload-pre-processing" Sep 18 15:04:04.765006 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.764969 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" containerName="payload-pre-processing" Sep 18 15:04:04.765006 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.764994 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead85159-c9b0-4962-aedc-9f75767c0899" containerName="manager" Sep 18 15:04:04.765073 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765003 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead85159-c9b0-4962-aedc-9f75767c0899" containerName="manager" Sep 18 15:04:04.765073 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765023 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c906cf6-29a0-4492-ab73-29e20470e090" containerName="payload-processing" Sep 18 15:04:04.765073 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765032 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c906cf6-29a0-4492-ab73-29e20470e090" containerName="payload-processing" Sep 18 15:04:04.765073 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765047 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a747670c-835f-481b-9d02-516c7973af51" containerName="authorino" Sep 18 15:04:04.765073 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765057 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a747670c-835f-481b-9d02-516c7973af51" containerName="authorino" Sep 18 15:04:04.765215 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765155 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" containerName="payload-pre-processing" Sep 18 15:04:04.765215 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765167 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c906cf6-29a0-4492-ab73-29e20470e090" containerName="payload-processing" Sep 18 15:04:04.765215 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765183 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a747670c-835f-481b-9d02-516c7973af51" containerName="authorino" Sep 18 15:04:04.765215 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.765194 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead85159-c9b0-4962-aedc-9f75767c0899" containerName="manager" Sep 18 15:04:04.768725 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.768706 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:04.773317 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.773290 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 15:04:04.773445 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.773424 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 15:04:04.773592 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.773576 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcjcb\"" Sep 18 15:04:04.774473 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.774454 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 15:04:04.780721 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.780700 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-klg6d"] Sep 18 15:04:04.919557 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.919467 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-metrics-certs\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:04.919557 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.919542 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-webhook-cert\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:04.919764 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:04.919569 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2pmb\" (UniqueName: \"kubernetes.io/projected/865f876d-6427-40ab-96b0-c040176a6e26-kube-api-access-c2pmb\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.020736 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.020697 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-webhook-cert\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.020736 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.020738 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2pmb\" (UniqueName: \"kubernetes.io/projected/865f876d-6427-40ab-96b0-c040176a6e26-kube-api-access-c2pmb\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.020978 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.020800 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-metrics-certs\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.023191 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.023168 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-webhook-cert\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.023305 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.023216 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865f876d-6427-40ab-96b0-c040176a6e26-metrics-certs\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.028961 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.028943 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2pmb\" (UniqueName: \"kubernetes.io/projected/865f876d-6427-40ab-96b0-c040176a6e26-kube-api-access-c2pmb\") pod \"maas-controller-9c6bbf6d9-klg6d\" (UID: \"865f876d-6427-40ab-96b0-c040176a6e26\") " pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.078835 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.078804 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:05.185086 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.185005 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" Sep 18 15:04:05.185086 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.185044 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2cfgs" event={"ID":"2c906cf6-29a0-4492-ab73-29e20470e090","Type":"ContainerDied","Data":"80a3ef5a0e5acc6d504d29958cfb3a67765795f0bd75a1b6b5c481d370d0236f"} Sep 18 15:04:05.185593 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.185107 2548 scope.go:117] "RemoveContainer" containerID="0bf0a23157a22d07ff0a10f4f205c49a1a961d5e29fd85dbe68dae7d9bbc21ba" Sep 18 15:04:05.186434 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.186409 2548 generic.go:356] "Generic (PLEG): container finished" podID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" containerID="b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62" exitCode=0 Sep 18 15:04:05.186529 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.186445 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" Sep 18 15:04:05.186529 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.186489 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" event={"ID":"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f","Type":"ContainerDied","Data":"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62"} Sep 18 15:04:05.186650 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.186547 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7" event={"ID":"5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f","Type":"ContainerDied","Data":"87c8db47d5bb5e79dab68e7ff9d2882199359eafb7e005eb8e992ff833532526"} Sep 18 15:04:05.194022 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.193984 2548 scope.go:117] "RemoveContainer" containerID="b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62" Sep 18 15:04:05.201503 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.201489 2548 scope.go:117] "RemoveContainer" containerID="b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62" Sep 18 15:04:05.201774 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:05.201757 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62\": container with ID starting with b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62 not found: ID does not exist" containerID="b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62" Sep 18 15:04:05.201818 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.201781 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62"} err="failed to get container status \"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62\": rpc error: code = NotFound desc = could not find container \"b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62\": container with ID starting with b3921846300d0faddc302b39b523b00674566e9be24f96b263db1d4546777e62 not found: ID does not exist" Sep 18 15:04:05.211021 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.210995 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:04:05.215338 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.215315 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vnmc7"] Sep 18 15:04:05.224249 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.224229 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:04:05.228204 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.228183 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2cfgs"] Sep 18 15:04:05.349414 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:05.349312 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6bbf6d9-klg6d"] Sep 18 15:04:05.353294 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:04:05.353259 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865f876d_6427_40ab_96b0_c040176a6e26.slice/crio-e87e210de365d35d0d15c475b9bb2f1ee92888bb3efc578946e19ee417ef165a WatchSource:0}: Error finding container e87e210de365d35d0d15c475b9bb2f1ee92888bb3efc578946e19ee417ef165a: Status 404 returned error can't find the container with id e87e210de365d35d0d15c475b9bb2f1ee92888bb3efc578946e19ee417ef165a Sep 18 15:04:06.126899 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.126811 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c906cf6-29a0-4492-ab73-29e20470e090" path="/var/lib/kubelet/pods/2c906cf6-29a0-4492-ab73-29e20470e090/volumes" Sep 18 15:04:06.127228 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.127214 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f" path="/var/lib/kubelet/pods/5a1ed4e2-c88c-4218-b64f-147d3f2bbe3f/volumes" Sep 18 15:04:06.127574 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.127560 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a747670c-835f-481b-9d02-516c7973af51" path="/var/lib/kubelet/pods/a747670c-835f-481b-9d02-516c7973af51/volumes" Sep 18 15:04:06.127900 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.127888 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead85159-c9b0-4962-aedc-9f75767c0899" path="/var/lib/kubelet/pods/ead85159-c9b0-4962-aedc-9f75767c0899/volumes" Sep 18 15:04:06.194683 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.194649 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" event={"ID":"865f876d-6427-40ab-96b0-c040176a6e26","Type":"ContainerStarted","Data":"806dc453f5d4ec301a1570dc0f13fc02e59a653f90e6fd8c0f1496f0daba79d9"} Sep 18 15:04:06.195097 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.194692 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" event={"ID":"865f876d-6427-40ab-96b0-c040176a6e26","Type":"ContainerStarted","Data":"e87e210de365d35d0d15c475b9bb2f1ee92888bb3efc578946e19ee417ef165a"} Sep 18 15:04:06.195097 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.194781 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:06.212820 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:06.212778 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" podStartSLOduration=1.80981674 podStartE2EDuration="2.212765792s" totalImagesPullingTime="402.949052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:04:06.210835827 +0000 UTC m=+792.060255669" watchObservedRunningTime="2026-09-18 15:04:06.212765792 +0000 UTC m=+792.062185644" Sep 18 15:04:17.203624 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.203552 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c6bbf6d9-klg6d" Sep 18 15:04:17.473240 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.473165 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8"] Sep 18 15:04:17.476316 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.476301 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:17.478986 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.478959 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 18 15:04:17.478986 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.478975 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-gkdnk\"" Sep 18 15:04:17.485176 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.485152 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8"] Sep 18 15:04:17.519307 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.519274 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdk2z\" (UniqueName: \"kubernetes.io/projected/340b5297-0f99-4162-9847-c4594c1be6c2-kube-api-access-mdk2z\") pod \"ai-gateway-controller-9ffc87bf4-wf9p8\" (UID: \"340b5297-0f99-4162-9847-c4594c1be6c2\") " pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:17.619895 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.619839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdk2z\" (UniqueName: \"kubernetes.io/projected/340b5297-0f99-4162-9847-c4594c1be6c2-kube-api-access-mdk2z\") pod \"ai-gateway-controller-9ffc87bf4-wf9p8\" (UID: \"340b5297-0f99-4162-9847-c4594c1be6c2\") " pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:17.628782 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.628758 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdk2z\" (UniqueName: \"kubernetes.io/projected/340b5297-0f99-4162-9847-c4594c1be6c2-kube-api-access-mdk2z\") pod \"ai-gateway-controller-9ffc87bf4-wf9p8\" (UID: \"340b5297-0f99-4162-9847-c4594c1be6c2\") " pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:17.786876 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:17.786796 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:18.054689 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:18.054666 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8"] Sep 18 15:04:18.057274 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:04:18.057248 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340b5297_0f99_4162_9847_c4594c1be6c2.slice/crio-e7860723c6516200aad5c030bc4493fe1b5af486de815c3875b5e4f9adf50db7 WatchSource:0}: Error finding container e7860723c6516200aad5c030bc4493fe1b5af486de815c3875b5e4f9adf50db7: Status 404 returned error can't find the container with id e7860723c6516200aad5c030bc4493fe1b5af486de815c3875b5e4f9adf50db7 Sep 18 15:04:18.250730 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:18.250705 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerStarted","Data":"e7860723c6516200aad5c030bc4493fe1b5af486de815c3875b5e4f9adf50db7"} Sep 18 15:04:20.261066 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:20.261039 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="4b75908a699dbd1e85b7406dce660f36d5f4e2069131976eb22dd575e25f3684" exitCode=1 Sep 18 15:04:20.261444 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:20.261083 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"4b75908a699dbd1e85b7406dce660f36d5f4e2069131976eb22dd575e25f3684"} Sep 18 15:04:20.261444 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:20.261254 2548 scope.go:117] "RemoveContainer" containerID="4b75908a699dbd1e85b7406dce660f36d5f4e2069131976eb22dd575e25f3684" Sep 18 15:04:21.267275 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:21.267245 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" exitCode=1 Sep 18 15:04:21.267696 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:21.267337 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d"} Sep 18 15:04:21.267696 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:21.267416 2548 scope.go:117] "RemoveContainer" containerID="4b75908a699dbd1e85b7406dce660f36d5f4e2069131976eb22dd575e25f3684" Sep 18 15:04:21.267696 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:21.267580 2548 scope.go:117] "RemoveContainer" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" Sep 18 15:04:21.267820 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:21.267803 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:22.273450 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:22.273427 2548 scope.go:117] "RemoveContainer" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" Sep 18 15:04:22.273928 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:22.273660 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:27.786972 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:27.786939 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:27.787420 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:27.787403 2548 scope.go:117] "RemoveContainer" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" Sep 18 15:04:27.787625 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:27.787603 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:37.787175 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:37.787137 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:37.787612 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:37.787466 2548 scope.go:117] "RemoveContainer" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" Sep 18 15:04:38.344120 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:38.344083 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerStarted","Data":"d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c"} Sep 18 15:04:38.344324 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:38.344300 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:38.362250 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:38.362198 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podStartSLOduration=18.969956205 podStartE2EDuration="21.362179983s" totalImagesPullingTime="2.392223778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:04:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:04:38.36010242 +0000 UTC m=+824.209522263" watchObservedRunningTime="2026-09-18 15:04:38.362179983 +0000 UTC m=+824.211599838" Sep 18 15:04:39.351464 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:39.351423 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" exitCode=1 Sep 18 15:04:39.351896 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:39.351499 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c"} Sep 18 15:04:39.351896 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:39.351582 2548 scope.go:117] "RemoveContainer" containerID="18097f38e2fa3a694d8e14545df206f6a155468f9e2f2c04cbfd60cb4915256d" Sep 18 15:04:39.351896 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:39.351759 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:04:39.352021 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:39.351962 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:40.357644 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:40.357615 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:04:40.358037 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:40.357806 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:54.120892 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:54.120838 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:04:54.121349 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:54.121040 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:04:57.787110 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:57.787080 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:04:57.787489 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:04:57.787418 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:04:57.787614 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:04:57.787596 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:12.121581 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:12.121549 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:05:13.503434 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:13.503398 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" exitCode=1 Sep 18 15:05:13.503878 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:13.503470 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f"} Sep 18 15:05:13.503878 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:13.503529 2548 scope.go:117] "RemoveContainer" containerID="d87c76a4e9240a7e13ad1a9fc909b91fc89c065fe238d9c073f5f237171c586c" Sep 18 15:05:13.503878 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:13.503782 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:13.504017 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:13.504000 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:17.787213 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:17.787183 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:05:17.787665 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:17.787522 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:17.787711 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:17.787678 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:18.345300 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:18.345270 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:05:18.528770 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:18.528748 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:18.528941 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:18.528922 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:34.121090 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:34.121053 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:34.121567 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:34.121260 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:45.120969 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:45.120886 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:45.121495 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:45.121130 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:05:56.107916 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:56.107892 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 15:05:56.109570 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:56.109552 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvrdr_02709818-a206-4a14-80de-a59db838b9de/ovn-acl-logging/0.log" Sep 18 15:05:58.121268 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:58.121234 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:58.694048 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:58.694022 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" exitCode=1 Sep 18 15:05:58.694146 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:58.694098 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c"} Sep 18 15:05:58.694200 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:58.694180 2548 scope.go:117] "RemoveContainer" containerID="732f07c82047dee6aee71ca56386b5faf582f86f5aef89e177c8cf6c16b2062f" Sep 18 15:05:58.694446 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:05:58.694421 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:05:58.694642 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:05:58.694621 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:06:08.344436 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:08.344398 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:06:08.344928 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:08.344709 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:06:08.344928 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:06:08.344892 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:06:17.787599 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:17.787568 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:06:17.788084 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:17.787918 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:06:17.788127 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:06:17.788081 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:06:31.121502 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:31.121473 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:06:31.121908 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:06:31.121637 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:06:44.123067 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:44.121464 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:06:44.123067 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:06:44.121815 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:06:59.121180 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:06:59.121150 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:06:59.121585 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:06:59.121301 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:07:14.121130 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:14.121045 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:07:14.121689 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:07:14.121225 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:07:18.475548 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.475516 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fdt8r/must-gather-pgtzl"] Sep 18 15:07:18.478818 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.478802 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.481643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.481625 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fdt8r\"/\"default-dockercfg-zw8cr\"" Sep 18 15:07:18.482092 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.482077 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fdt8r\"/\"openshift-service-ca.crt\"" Sep 18 15:07:18.482273 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.482261 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fdt8r\"/\"kube-root-ca.crt\"" Sep 18 15:07:18.493831 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.493811 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/must-gather-pgtzl"] Sep 18 15:07:18.599242 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.599215 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2502f21a-a506-4f10-ac08-90f338e062b3-must-gather-output\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.599378 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.599259 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6htl\" (UniqueName: \"kubernetes.io/projected/2502f21a-a506-4f10-ac08-90f338e062b3-kube-api-access-w6htl\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.699729 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.699692 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6htl\" (UniqueName: \"kubernetes.io/projected/2502f21a-a506-4f10-ac08-90f338e062b3-kube-api-access-w6htl\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.699881 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.699794 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2502f21a-a506-4f10-ac08-90f338e062b3-must-gather-output\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.700105 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.700087 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2502f21a-a506-4f10-ac08-90f338e062b3-must-gather-output\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.710837 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.710819 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6htl\" (UniqueName: \"kubernetes.io/projected/2502f21a-a506-4f10-ac08-90f338e062b3-kube-api-access-w6htl\") pod \"must-gather-pgtzl\" (UID: \"2502f21a-a506-4f10-ac08-90f338e062b3\") " pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:18.787571 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:18.787511 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" Sep 18 15:07:19.061116 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:19.061072 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/must-gather-pgtzl"] Sep 18 15:07:19.063182 ip-10-0-133-129 kubenswrapper[2548]: W0918 15:07:19.063153 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2502f21a_a506_4f10_ac08_90f338e062b3.slice/crio-32d093a835950065c67c32811d7f5f0f46614f4a0a8ef6c1408d7b6e4aea2d5e WatchSource:0}: Error finding container 32d093a835950065c67c32811d7f5f0f46614f4a0a8ef6c1408d7b6e4aea2d5e: Status 404 returned error can't find the container with id 32d093a835950065c67c32811d7f5f0f46614f4a0a8ef6c1408d7b6e4aea2d5e Sep 18 15:07:20.051753 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:20.051650 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" event={"ID":"2502f21a-a506-4f10-ac08-90f338e062b3","Type":"ContainerStarted","Data":"e8368f4a3bcfc0e9b0d3a99afa11e071fbbfc92365956c8bed2558fff90f0791"} Sep 18 15:07:20.051753 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:20.051707 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" event={"ID":"2502f21a-a506-4f10-ac08-90f338e062b3","Type":"ContainerStarted","Data":"18d4a10a505db767e6cd578b48b4cb669cff73f6cc7042488f4e0d182ff88694"} Sep 18 15:07:20.051753 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:20.051725 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" event={"ID":"2502f21a-a506-4f10-ac08-90f338e062b3","Type":"ContainerStarted","Data":"32d093a835950065c67c32811d7f5f0f46614f4a0a8ef6c1408d7b6e4aea2d5e"} Sep 18 15:07:21.372125 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:21.372099 2548 ???:1] "http: TLS handshake error from 10.0.131.100:43938: EOF" Sep 18 15:07:21.376302 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:21.376274 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s9wc9_0fa25a9d-2606-4009-8289-f3d65d9d9274/global-pull-secret-syncer/0.log" Sep 18 15:07:21.480597 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:21.480565 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-scckj_9bb635d6-8336-43d2-b3ff-fe6ad04b453c/konnectivity-agent/0.log" Sep 18 15:07:21.525244 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:21.525218 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-129.ec2.internal_f42899217f0ec711059b689f33b26745/haproxy/0.log" Sep 18 15:07:25.626763 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:25.626728 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cd4c94bc-ljsq8_6e176613-959e-40f8-ad70-6968722d7363/authorino/0.log" Sep 18 15:07:25.746491 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:25.746458 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dq87p_3df4e115-5472-492f-ba9b-b4ac4fb2fa8d/kuadrant-console-plugin/0.log" Sep 18 15:07:26.128962 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:26.128931 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:07:26.129671 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:26.129657 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 15:07:27.103985 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:27.102701 2548 generic.go:356] "Generic (PLEG): container finished" podID="340b5297-0f99-4162-9847-c4594c1be6c2" containerID="e849001b831210f7666233cb04bbcb885472ba0692f5fcd0567859ffbc07d7a5" exitCode=1 Sep 18 15:07:27.103985 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:27.102791 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" event={"ID":"340b5297-0f99-4162-9847-c4594c1be6c2","Type":"ContainerDied","Data":"e849001b831210f7666233cb04bbcb885472ba0692f5fcd0567859ffbc07d7a5"} Sep 18 15:07:27.103985 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:27.102861 2548 scope.go:117] "RemoveContainer" containerID="b7f75721da268afb2735209541bafa141c3a5b84c1bead36d070a977ff4dcf8c" Sep 18 15:07:27.103985 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:27.103273 2548 scope.go:117] "RemoveContainer" containerID="e849001b831210f7666233cb04bbcb885472ba0692f5fcd0567859ffbc07d7a5" Sep 18 15:07:27.103985 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:07:27.103500 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:07:27.121823 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:27.121770 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fdt8r/must-gather-pgtzl" podStartSLOduration=8.461326259 podStartE2EDuration="9.121748896s" totalImagesPullingTime="660.422637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 15:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:07:20.068957581 +0000 UTC m=+985.918377424" watchObservedRunningTime="2026-09-18 15:07:27.121748896 +0000 UTC m=+992.971168740" Sep 18 15:07:28.022969 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:28.022867 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8jpr_057c53d5-ba4b-4414-8728-8b7d564793b8/node-exporter/0.log" Sep 18 15:07:28.053522 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:28.053454 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8jpr_057c53d5-ba4b-4414-8728-8b7d564793b8/kube-rbac-proxy/0.log" Sep 18 15:07:28.084501 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:28.084421 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8jpr_057c53d5-ba4b-4414-8728-8b7d564793b8/init-textfile/0.log" Sep 18 15:07:28.345163 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:28.345136 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:07:28.353987 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:28.353966 2548 scope.go:117] "RemoveContainer" containerID="e849001b831210f7666233cb04bbcb885472ba0692f5fcd0567859ffbc07d7a5" Sep 18 15:07:28.354387 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:07:28.354365 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:07:31.079793 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.079758 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4"] Sep 18 15:07:31.086458 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.086434 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.094000 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.093969 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4"] Sep 18 15:07:31.234803 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.234770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-podres\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.235022 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.234815 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-lib-modules\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.235022 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.234854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-proc\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.235022 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.235002 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-sys\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.235171 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.235035 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntnfg\" (UniqueName: \"kubernetes.io/projected/acce20d2-97f1-4724-82ed-1c25011d1a28-kube-api-access-ntnfg\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336423 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336339 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntnfg\" (UniqueName: \"kubernetes.io/projected/acce20d2-97f1-4724-82ed-1c25011d1a28-kube-api-access-ntnfg\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336423 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336400 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-podres\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336432 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-lib-modules\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336460 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-proc\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336595 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-sys\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336613 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-lib-modules\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336643 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336613 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-podres\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336867 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336659 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-proc\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.336867 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.336737 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acce20d2-97f1-4724-82ed-1c25011d1a28-sys\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.345050 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.345020 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntnfg\" (UniqueName: \"kubernetes.io/projected/acce20d2-97f1-4724-82ed-1c25011d1a28-kube-api-access-ntnfg\") pod \"perf-node-gather-daemonset-hzss4\" (UID: \"acce20d2-97f1-4724-82ed-1c25011d1a28\") " pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.415824 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.415793 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:31.717037 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:31.717006 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4"] Sep 18 15:07:32.141529 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:32.141427 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" event={"ID":"acce20d2-97f1-4724-82ed-1c25011d1a28","Type":"ContainerStarted","Data":"4d61b2098f997f815b709633b2f4bf5c25d1342eae4ae5c425ae2a1fe4e4de96"} Sep 18 15:07:32.141529 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:32.141502 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" event={"ID":"acce20d2-97f1-4724-82ed-1c25011d1a28","Type":"ContainerStarted","Data":"9fde55ff4aa3e9fdc171c4d90315de275604a0f5f526d4e50f2d6812660e7426"} Sep 18 15:07:32.142353 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:32.142324 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:32.159169 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:32.159115 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" podStartSLOduration=1.159095369 podStartE2EDuration="1.159095369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 15:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 15:07:32.157729182 +0000 UTC m=+998.007149025" watchObservedRunningTime="2026-09-18 15:07:32.159095369 +0000 UTC m=+998.008515212" Sep 18 15:07:33.272959 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:33.272930 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zpsdd_cd48db29-6dfe-4443-a916-daa8d44a82af/dns/0.log" Sep 18 15:07:33.292553 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:33.292525 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zpsdd_cd48db29-6dfe-4443-a916-daa8d44a82af/kube-rbac-proxy/0.log" Sep 18 15:07:33.345858 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:33.345823 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smzwk_428a1e96-15d7-414c-87a9-1f14c5dd253b/dns-node-resolver/0.log" Sep 18 15:07:33.907509 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:33.907471 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-656d786556-4gkz5_066debd8-ab31-439b-ac2b-7aada7ed5586/registry/0.log" Sep 18 15:07:33.949017 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:33.948988 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf86k_29802ef6-1a51-4063-b6c6-b6493c950c9c/node-ca/0.log" Sep 18 15:07:34.877385 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:34.877359 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf_14ccf160-8c54-4de9-82a2-9e9c7d959928/istio-proxy/0.log" Sep 18 15:07:35.011581 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:35.011551 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/1.log" Sep 18 15:07:35.011905 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:35.011877 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/0.log" Sep 18 15:07:35.648329 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:35.648282 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w74qv_b13b134d-c0b9-4f32-be84-37210ba95417/serve-healthcheck-canary/0.log" Sep 18 15:07:36.218551 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:36.218516 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fsrss_036734da-67ad-44f8-bf6f-e81a8afd441b/kube-rbac-proxy/0.log" Sep 18 15:07:36.240538 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:36.240513 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fsrss_036734da-67ad-44f8-bf6f-e81a8afd441b/exporter/0.log" Sep 18 15:07:36.263673 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:36.263648 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fsrss_036734da-67ad-44f8-bf6f-e81a8afd441b/extractor/0.log" Sep 18 15:07:37.787239 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:37.787212 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" Sep 18 15:07:37.787623 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:37.787563 2548 scope.go:117] "RemoveContainer" containerID="e849001b831210f7666233cb04bbcb885472ba0692f5fcd0567859ffbc07d7a5" Sep 18 15:07:37.787765 ip-10-0-133-129 kubenswrapper[2548]: E0918 15:07:37.787748 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-9ffc87bf4-wf9p8_opendatahub(340b5297-0f99-4162-9847-c4594c1be6c2)\"" pod="opendatahub/ai-gateway-controller-9ffc87bf4-wf9p8" podUID="340b5297-0f99-4162-9847-c4594c1be6c2" Sep 18 15:07:38.457315 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.457285 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-9ffc87bf4-wf9p8_340b5297-0f99-4162-9847-c4594c1be6c2/manager/5.log" Sep 18 15:07:38.457315 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.457311 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-9ffc87bf4-wf9p8_340b5297-0f99-4162-9847-c4594c1be6c2/manager/5.log" Sep 18 15:07:38.514100 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.514064 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-88zcz_1fefa8ae-eb09-41b8-9c58-01505499dd86/manager/0.log" Sep 18 15:07:38.535739 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.535712 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c6bbf6d9-klg6d_865f876d-6427-40ab-96b0-c040176a6e26/manager/0.log" Sep 18 15:07:38.733970 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.733894 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8_1ce8ea9a-8bc4-437f-bb29-4971d5fbed23/manager/0.log" Sep 18 15:07:38.753159 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:38.753134 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9d9f7dcc-jblt8_1ce8ea9a-8bc4-437f-bb29-4971d5fbed23/copy-manifests/0.log" Sep 18 15:07:39.163887 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:39.163799 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fdt8r/perf-node-gather-daemonset-hzss4" Sep 18 15:07:40.115044 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:40.115013 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-859bf4c848-vlqvn_1d7ca2dd-4ffd-4da0-a0e7-812d4c4f4028/manager/0.log" Sep 18 15:07:41.462503 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:41.462447 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf_14ccf160-8c54-4de9-82a2-9e9c7d959928/istio-proxy/0.log" Sep 18 15:07:41.576457 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:41.576430 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/1.log" Sep 18 15:07:41.576761 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:41.576732 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/0.log" Sep 18 15:07:42.739350 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:42.739275 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-nd4kf_14ccf160-8c54-4de9-82a2-9e9c7d959928/istio-proxy/0.log" Sep 18 15:07:42.843101 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:42.843074 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/1.log" Sep 18 15:07:42.843277 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:42.843258 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-z5fpg_ddf31a32-c319-44bb-8708-18984eb680d0/istio-proxy/0.log" Sep 18 15:07:45.349778 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:45.349732 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-g8w9h_62f807c6-8ad7-4703-b556-7db93fee1543/migrator/0.log" Sep 18 15:07:45.372234 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:45.372212 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-g8w9h_62f807c6-8ad7-4703-b556-7db93fee1543/graceful-termination/0.log" Sep 18 15:07:46.855061 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.855031 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/kube-multus-additional-cni-plugins/0.log" Sep 18 15:07:46.875685 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.875665 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/egress-router-binary-copy/0.log" Sep 18 15:07:46.898932 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.898911 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/cni-plugins/0.log" Sep 18 15:07:46.928427 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.928410 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/bond-cni-plugin/0.log" Sep 18 15:07:46.949278 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.949258 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/routeoverride-cni/0.log" Sep 18 15:07:46.968756 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.968736 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/whereabouts-cni-bincopy/0.log" Sep 18 15:07:46.989115 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:46.989100 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2hh2_fc965755-516b-4f4c-af7c-eac391af7854/whereabouts-cni/0.log" Sep 18 15:07:47.180010 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:47.179980 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h97zl_84daa28e-6647-4732-a07b-bbb87c80e34c/kube-multus/0.log" Sep 18 15:07:47.316475 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:47.316429 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qnvbc_bc5e545b-5a92-49c1-b638-50214247ce43/network-metrics-daemon/0.log" Sep 18 15:07:47.335247 ip-10-0-133-129 kubenswrapper[2548]: I0918 15:07:47.335227 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qnvbc_bc5e545b-5a92-49c1-b638-50214247ce43/kube-rbac-proxy/0.log"