Jul 15 15:33:09.271885 ip-10-0-132-85 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 15:33:09.271894 ip-10-0-132-85 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 15:33:09.271901 ip-10-0-132-85 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 15:33:09.272134 ip-10-0-132-85 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 15:33:19.436827 ip-10-0-132-85 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 15:33:19.436846 ip-10-0-132-85 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0c76b7728ced411087dae3ec4b2ec9ed -- Jul 15 15:35:21.141791 ip-10-0-132-85 systemd[1]: Starting Kubernetes Kubelet... Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:22.998733 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003717 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003730 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003734 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003738 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003741 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003744 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003747 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.044096 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003750 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003759 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003762 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003765 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003768 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003771 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003774 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003777 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003780 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003783 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003786 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003789 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003793 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003796 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003799 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003802 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003805 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003809 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003813 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003816 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.045424 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003819 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003822 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003825 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003830 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003835 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003839 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003847 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003853 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003859 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003863 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003866 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003869 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003872 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003876 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003879 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003882 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003885 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003888 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003891 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.050328 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003893 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003896 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003899 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003902 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003905 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003908 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003911 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003915 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003919 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003922 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003926 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003928 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003931 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003934 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003937 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003940 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003943 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003946 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003949 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003952 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.051219 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003955 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003957 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003960 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003963 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003966 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003969 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003972 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003975 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003978 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003981 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003983 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003986 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003989 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003992 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003995 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.003997 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004002 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004005 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004007 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004010 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.052115 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004013 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004016 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004019 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004021 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004024 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004029 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004032 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004035 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004038 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004041 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004044 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004047 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004050 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004801 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004811 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004816 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004820 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004824 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004827 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.054825 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004830 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004834 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004837 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004840 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004844 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004846 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004849 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004852 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004855 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004858 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004860 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004863 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004866 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004869 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004872 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004874 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004877 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004880 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004883 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.055724 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004886 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004890 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004893 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004897 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004900 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004902 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004905 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004908 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004911 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004916 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004919 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004922 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004925 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004928 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004931 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004934 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004936 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004940 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004943 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.059273 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004946 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004949 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004952 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004955 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004958 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004960 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004963 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004966 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004969 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004972 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004974 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004977 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004980 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004984 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004987 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004989 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004992 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004995 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.004998 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.060174 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005000 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005006 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005009 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005014 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005017 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005019 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005022 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005025 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005028 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005031 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005034 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005037 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005039 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005042 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005046 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005049 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005051 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005054 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005057 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005059 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005062 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.170925 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005065 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005068 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005071 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005073 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005076 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005079 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005082 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005085 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005087 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005090 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005093 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005096 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005101 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005103 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005111 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005521 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005527 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005531 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005534 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005538 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.171794 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005541 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005544 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005548 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005551 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005553 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005556 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005559 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005562 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005565 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005568 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005570 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005573 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005591 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005594 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005597 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005600 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005603 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005606 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005609 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005612 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.181559 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005614 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005617 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005620 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005623 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005628 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005631 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005635 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005638 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005641 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005643 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005646 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005649 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005652 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005655 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005658 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005661 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005664 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005666 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005669 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005672 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.182896 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005675 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005678 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005680 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005683 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005686 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005689 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005691 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005696 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005699 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005703 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005706 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005709 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005712 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005715 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005717 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005720 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005724 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005727 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005732 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.183797 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005735 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005737 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005740 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005743 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005746 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005750 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005752 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005755 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005759 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005761 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005764 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005767 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005769 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005772 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005775 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005777 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005780 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005783 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005786 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.185594 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005788 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005793 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005796 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005799 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005802 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005805 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005808 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005810 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005814 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005816 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005821 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005825 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005830 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005834 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005837 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.005839 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005898 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005905 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005912 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005917 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 15:35:23.186453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005921 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005924 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005934 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005938 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005942 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005945 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005949 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005952 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005956 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005959 2554 flags.go:64] FLAG: --cgroup-root="" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005962 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005965 2554 flags.go:64] FLAG: --client-ca-file="" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005968 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005971 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005976 2554 flags.go:64] FLAG: --cluster-domain="" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005979 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005983 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005986 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005989 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005993 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.005996 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006000 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006005 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006008 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 15 15:35:23.297930 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006012 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006016 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006019 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006022 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006026 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006030 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006033 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006036 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006039 2554 flags.go:64] FLAG: --enable-server="true" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006042 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006047 2554 flags.go:64] FLAG: --event-burst="100" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006051 2554 flags.go:64] FLAG: --event-qps="50" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006054 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006057 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006060 2554 flags.go:64] FLAG: --eviction-hard="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006064 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006067 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006071 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006074 2554 flags.go:64] FLAG: --eviction-soft="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006077 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006080 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006083 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006087 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006090 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006093 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 15:35:23.300391 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006096 2554 flags.go:64] FLAG: --feature-gates="" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006099 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006102 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006106 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006109 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006115 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006118 2554 flags.go:64] FLAG: --help="false" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006123 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006126 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006129 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006132 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006136 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006139 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006143 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006146 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006149 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006152 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006155 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006158 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006161 2554 flags.go:64] FLAG: --kube-reserved="" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006165 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006168 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006171 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006174 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 15:35:23.302127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006177 2554 flags.go:64] FLAG: --lock-file="" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006180 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006183 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006186 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006192 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006195 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006198 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006201 2554 flags.go:64] FLAG: --logging-format="text" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006204 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006208 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006210 2554 flags.go:64] FLAG: --manifest-url="" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006213 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006218 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006222 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006227 2554 flags.go:64] FLAG: --max-pods="110" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006231 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006234 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006237 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006240 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006244 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006247 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006250 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006257 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006260 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006263 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 15:35:23.305763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006266 2554 flags.go:64] FLAG: --pod-cidr="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006269 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006275 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006279 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006282 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006286 2554 flags.go:64] FLAG: --port="10250" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006289 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006292 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e9e1a3f6d6d26629" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006295 2554 flags.go:64] FLAG: --qos-reserved="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006298 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006302 2554 flags.go:64] FLAG: --register-node="true" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006305 2554 flags.go:64] FLAG: --register-with-taints="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006309 2554 flags.go:64] FLAG: --registry-burst="10" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006312 2554 flags.go:64] FLAG: --registry-qps="5" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006315 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006318 2554 flags.go:64] FLAG: --reserved-memory="" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006323 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006326 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006329 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006332 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006335 2554 flags.go:64] FLAG: --runonce="false" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006340 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006345 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006348 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006351 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 15:35:23.306471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006354 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006357 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006361 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006364 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006367 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006370 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006373 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006376 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006380 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006383 2554 flags.go:64] FLAG: --system-cgroups="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006386 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006392 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006395 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006398 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006402 2554 flags.go:64] FLAG: --tls-min-version="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006405 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006408 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006411 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006414 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006417 2554 flags.go:64] FLAG: --v="2" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006421 2554 flags.go:64] FLAG: --version="false" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006426 2554 flags.go:64] FLAG: --vmodule="" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006429 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.006433 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006549 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.307129 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006554 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006557 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006560 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006565 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006569 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006572 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006588 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006592 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006594 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006597 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006600 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006603 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006606 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006609 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006612 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006615 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006618 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006620 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006623 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006627 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.307827 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006630 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006633 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006636 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006639 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006642 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006645 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006648 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006651 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006653 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006656 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006659 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006662 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006664 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006667 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006670 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006675 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006679 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006682 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006685 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006687 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.308413 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006690 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006693 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006696 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006699 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006702 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006705 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006707 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006711 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006717 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006721 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006724 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006728 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006731 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006735 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006738 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006741 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006744 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006748 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006751 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.308960 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006754 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006757 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006759 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006762 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006765 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006768 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006771 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006774 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006778 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006782 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006786 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006788 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006793 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006796 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006799 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006802 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006805 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006808 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006811 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006814 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.309448 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006817 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006820 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006823 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006826 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006829 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006832 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006835 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006838 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006841 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006844 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006846 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006849 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006852 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006855 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006857 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006860 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006863 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006866 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.309980 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.006868 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.007484 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.258793 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.258821 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.258850 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.258860 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258951 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258961 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258967 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258972 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258976 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258982 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258986 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258991 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.258995 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.310434 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259000 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259004 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259009 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259013 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259017 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259021 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259026 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259030 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259034 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259039 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259043 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259048 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259053 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259057 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259062 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259066 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259070 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259074 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259079 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259084 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.310841 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259090 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259094 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259098 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259102 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259106 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259111 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259116 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259120 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259124 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259128 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259133 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259137 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259141 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259146 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259151 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259156 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259160 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259164 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259169 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259174 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.311357 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259178 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259182 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259186 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259190 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259194 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259198 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259202 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259206 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259210 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259214 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259219 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259224 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259229 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259234 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259240 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259247 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259253 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259257 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259261 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259266 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.311884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259270 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259276 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259282 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259287 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259291 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259296 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259301 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259305 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259312 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259317 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259330 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259337 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259342 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259347 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259351 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259356 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259360 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259365 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.312390 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259369 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259374 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259378 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259382 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259387 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259391 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259397 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259401 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259405 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259410 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259414 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259418 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.259426 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259639 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259649 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:35:23.312868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259654 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259659 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259665 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259670 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259674 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259678 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259683 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259687 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259692 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259696 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259714 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259719 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259724 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259728 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259732 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259737 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259742 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259745 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259750 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:35:23.313469 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259754 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259759 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259763 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259768 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259772 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259777 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259781 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259785 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259789 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259793 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259797 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259802 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259806 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259814 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259818 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259822 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259827 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259831 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259835 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259840 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:35:23.314110 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259844 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259848 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259854 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259859 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259872 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259877 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259881 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259885 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259890 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259894 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259899 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259903 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259907 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259912 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259915 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259920 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259925 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259932 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259938 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:35:23.314950 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259943 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259947 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259952 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259957 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259962 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259967 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259973 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259977 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259982 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259986 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259991 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259995 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.259999 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260003 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260007 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260011 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260015 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260020 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260032 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260036 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:35:23.315567 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260041 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260045 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260049 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260053 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260057 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260061 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260065 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260069 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260074 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260078 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260082 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260087 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260091 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260095 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260100 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260104 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260108 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260113 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:35:23.316108 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:23.260120 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.260128 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.260312 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.267471 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.269367 2554 server.go:1019] "Starting client certificate rotation" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.269481 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.269531 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.272872 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.276319 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.293623 2554 log.go:25] "Validated CRI v1 runtime API" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.296141 2554 log.go:25] "Validated CRI v1 image API" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.296984 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 15:35:23.316569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.299844 2554 fs.go:135] Filesystem UUIDs: map[3e4b233c-6fd5-4142-9237-e6fd79576575:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8cb6fad3-6c7a-4726-b484-933b9c7eed0d:/dev/nvme0n1p3] Jul 15 15:35:23.316900 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.299869 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.307023 2554 manager.go:216] Machine: {Timestamp:2026-07-15 15:35:23.305223089 +0000 UTC m=+2.047994036 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087300 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225262074d42d8ec4766ef84f349c8 SystemUUID:ec225262-074d-42d8-ec47-66ef84f349c8 BootID:0c76b772-8ced-4110-87da-e3ec4b2ec9ed Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:9f:69:72:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:9f:69:72:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:0b:55:e7:dd:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.307165 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.307325 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.308192 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.311255 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.311282 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 15:35:23.316933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.312053 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 15:35:23.317158 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.312065 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 15:35:23.317158 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.312072 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 15:35:23.317158 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.312896 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 15:35:23.317158 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.314680 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 15:35:23.319099 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319084 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 15 15:35:23.319229 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319218 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 15:35:23.319272 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319250 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 15 15:35:23.319272 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319260 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 15:35:23.319361 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319276 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 15:35:23.319361 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319286 2554 kubelet.go:398] "Adding apiserver pod source" Jul 15 15:35:23.319361 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319296 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 15:35:23.319708 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319685 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 15:35:23.319708 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.319704 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 15:35:23.322288 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.322268 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 15:35:23.324321 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324307 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 15:35:23.324378 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324339 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 15:35:23.324531 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324518 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 15:35:23.324604 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324539 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 15:35:23.324604 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324550 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 15:35:23.324604 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324556 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 15:35:23.324604 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324565 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 15:35:23.324604 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.324571 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 15:35:23.325365 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325355 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 15:35:23.325365 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325365 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 15:35:23.325440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325372 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 15:35:23.325440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325378 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 15:35:23.325440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325387 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 15:35:23.325440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.325395 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 15:35:23.327382 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.327372 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 15:35:23.327431 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.327382 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 15:35:23.330708 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.330691 2554 server.go:1268] "Started kubelet" Jul 15 15:35:23.330806 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.330772 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 15:35:23.330935 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.330873 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 15:35:23.330988 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.330956 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 15:35:23.331665 ip-10-0-132-85 systemd[1]: Started Kubernetes Kubelet. Jul 15 15:35:23.332442 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.332246 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 15:35:23.333859 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.333845 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 15 15:35:23.337636 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.337605 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 15:35:23.337875 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.337857 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 15:35:23.337940 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.337910 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 15:35:23.339514 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.338205 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-85.ec2.internal.18c28087d8571a0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-85.ec2.internal,UID:ip-10-0-132-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-85.ec2.internal,},FirstTimestamp:2026-07-15 15:35:23.330664971 +0000 UTC m=+2.073435914,LastTimestamp:2026-07-15 15:35:23.330664971 +0000 UTC m=+2.073435914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-85.ec2.internal,}" Jul 15 15:35:23.339514 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.339497 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 15:35:23.339722 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.339631 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.339722 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.339506 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 15:35:23.340228 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340209 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 15:35:23.340429 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340408 2554 factory.go:55] Registering systemd factory Jul 15 15:35:23.340569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340531 2554 factory.go:223] Registration of the systemd container factory successfully Jul 15 15:35:23.340694 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340425 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 15:35:23.340694 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340610 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 15:35:23.340789 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340725 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 15 15:35:23.340789 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340736 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 15 15:35:23.340942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340928 2554 factory.go:153] Registering CRI-O factory Jul 15 15:35:23.340988 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340943 2554 factory.go:223] Registration of the crio container factory successfully Jul 15 15:35:23.341021 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.340993 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 15:35:23.341021 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.341011 2554 factory.go:103] Registering Raw factory Jul 15 15:35:23.341094 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.341030 2554 manager.go:1196] Started watching for new ooms in manager Jul 15 15:35:23.341369 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.341352 2554 manager.go:349] Starting recovery of all containers Jul 15 15:35:23.344994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.344971 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 15:35:23.351481 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.351448 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 15:35:23.351565 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.351495 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 15:35:23.352161 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.352142 2554 manager.go:354] Recovery completed Jul 15 15:35:23.352511 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.352474 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 15:35:23.357735 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.357720 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.359563 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.359530 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.359644 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.359570 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.359644 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.359599 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.360098 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360084 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 15:35:23.360098 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360095 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 15:35:23.360098 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360097 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.360240 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360110 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 15 15:35:23.360833 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360818 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.360898 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360845 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.360898 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.360879 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.361752 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.361740 2554 policy_none.go:49] "None policy: Start" Jul 15 15:35:23.361799 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.361755 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 15:35:23.361799 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.361766 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 15:35:23.363249 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.363238 2554 policy_none.go:47] "Start" Jul 15 15:35:23.364175 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.364106 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-85.ec2.internal.18c28087da0fe755 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-85.ec2.internal,UID:ip-10-0-132-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-85.ec2.internal,},FirstTimestamp:2026-07-15 15:35:23.359553365 +0000 UTC m=+2.102324311,LastTimestamp:2026-07-15 15:35:23.359553365 +0000 UTC m=+2.102324311,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-85.ec2.internal,}" Jul 15 15:35:23.377160 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.377042 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj78t" Jul 15 15:35:23.379025 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.378938 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-85.ec2.internal.18c28087da108183 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-85.ec2.internal,UID:ip-10-0-132-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-85.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-85.ec2.internal,},FirstTimestamp:2026-07-15 15:35:23.359592835 +0000 UTC m=+2.102363780,LastTimestamp:2026-07-15 15:35:23.359592835 +0000 UTC m=+2.102363780,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-85.ec2.internal,}" Jul 15 15:35:23.390007 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.389985 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj78t" Jul 15 15:35:23.391550 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.391474 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-85.ec2.internal.18c28087da10ac52 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-85.ec2.internal,UID:ip-10-0-132-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-85.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-85.ec2.internal,},FirstTimestamp:2026-07-15 15:35:23.359603794 +0000 UTC m=+2.102374737,LastTimestamp:2026-07-15 15:35:23.359603794 +0000 UTC m=+2.102374737,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-85.ec2.internal,}" Jul 15 15:35:23.394183 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394170 2554 manager.go:337] "Starting Device Plugin manager" Jul 15 15:35:23.394256 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.394200 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 15:35:23.394256 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394211 2554 server.go:87] "Starting device plugin registration server" Jul 15 15:35:23.394451 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394439 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 15:35:23.394520 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394453 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 15:35:23.394593 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394564 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 15:35:23.394925 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394855 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 15:35:23.394925 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.394869 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 15:35:23.395132 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.395110 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 15:35:23.395241 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.395166 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.495032 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.494996 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.496691 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.496674 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.496761 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.496711 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.496761 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.496725 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.496761 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.496760 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.519497 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.519477 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.519584 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.519501 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-85.ec2.internal\": node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.531102 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.531080 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 15:35:23.531190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.531120 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 15:35:23.531190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.531139 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 15:35:23.531190 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.531174 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 15:35:23.544512 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.544492 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:35:23.571855 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.571830 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.632097 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.632072 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal"] Jul 15 15:35:23.632160 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.632138 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.635683 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.635669 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.635757 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.635695 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.635757 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.635706 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.637508 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.637496 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.637637 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.637622 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.637684 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.637663 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.638290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638272 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.638290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638293 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.638412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638302 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.638412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638313 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.638412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638345 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.638412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.638358 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.640306 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.640291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.640386 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.640315 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:35:23.641066 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641051 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:35:23.641066 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641074 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:35:23.641187 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641084 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:35:23.641783 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.641835 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.641835 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.641827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b26d51ebf8c0b9aef32c216d74a1ab12-config\") pod \"kube-apiserver-proxy-ip-10-0-132-85.ec2.internal\" (UID: \"b26d51ebf8c0b9aef32c216d74a1ab12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.667236 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.667218 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-85.ec2.internal\" not found" node="ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.671878 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.671862 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-85.ec2.internal\" not found" node="ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.672842 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.672827 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.742317 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.742423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b26d51ebf8c0b9aef32c216d74a1ab12-config\") pod \"kube-apiserver-proxy-ip-10-0-132-85.ec2.internal\" (UID: \"b26d51ebf8c0b9aef32c216d74a1ab12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.742423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.742423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.742423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742407 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b26d51ebf8c0b9aef32c216d74a1ab12-config\") pod \"kube-apiserver-proxy-ip-10-0-132-85.ec2.internal\" (UID: \"b26d51ebf8c0b9aef32c216d74a1ab12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.742423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.742417 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897e224843e5106a9a9258f3b28fcdb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal\" (UID: \"897e224843e5106a9a9258f3b28fcdb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.773845 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.773780 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.874978 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.874940 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:23.970597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.970563 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.974874 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:23.974786 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:23.975929 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:23.975913 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.077237 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:24.077174 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.177440 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:24.177404 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.268866 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.268831 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 15:35:24.269005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.268987 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 15:35:24.277763 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:24.277728 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.378452 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:24.378425 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.394692 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.394661 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 15:30:24 +0000 UTC" deadline="2027-12-22 07:01:29.092016502 +0000 UTC" Jul 15 15:35:24.394750 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.394693 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12591h26m4.697330863s" Jul 15 15:35:24.479373 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:24.479348 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-85.ec2.internal\" not found" Jul 15 15:35:24.499221 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.499202 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:35:24.514666 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.514643 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:35:24.540325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.540299 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" Jul 15 15:35:24.555210 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.555189 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 15:35:24.557118 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.557101 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" Jul 15 15:35:24.564302 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.564286 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 15:35:24.579269 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.579250 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:35:24.595889 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:24.595849 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26d51ebf8c0b9aef32c216d74a1ab12.slice/crio-280b4de9f5117916cc978bb3aae0fd0182425eeb4e071b90949227aa9c336a30 WatchSource:0}: Error finding container 280b4de9f5117916cc978bb3aae0fd0182425eeb4e071b90949227aa9c336a30: Status 404 returned error can't find the container with id 280b4de9f5117916cc978bb3aae0fd0182425eeb4e071b90949227aa9c336a30 Jul 15 15:35:24.602251 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:24.602236 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 15:35:25.181479 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.181445 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:35:25.320876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.320845 2554 apiserver.go:52] "Watching apiserver" Jul 15 15:35:25.330186 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.330164 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 15:35:25.332306 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.332282 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-555tn","kube-system/konnectivity-agent-mc98l","kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal","openshift-multus/multus-7t8hz","openshift-multus/multus-additional-cni-plugins-nlfzt","openshift-multus/network-metrics-daemon-268cf","openshift-network-diagnostics/network-check-target-f99qw","kube-system/global-pull-secret-syncer-64gml","openshift-cluster-node-tuning-operator/tuned-mj974","openshift-dns/node-resolver-glb4z","openshift-image-registry/node-ca-d9zv5","openshift-network-operator/iptables-alerter-xtgcg"] Jul 15 15:35:25.333874 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.333855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.335051 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.335027 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.336260 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.336240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.337083 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 15:35:25.337191 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337089 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.337191 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 15:35:25.337320 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337301 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.337511 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337489 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.337614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgtrw\"" Jul 15 15:35:25.337614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.337581 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.338255 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.338239 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 15:35:25.339048 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.339154 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339072 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j9bx\"" Jul 15 15:35:25.339154 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.339098 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:25.339281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339170 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.339342 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339312 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.339498 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.339614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339525 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 15:35:25.339614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.339559 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-crbn5\"" Jul 15 15:35:25.340133 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.340115 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 15:35:25.340351 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.340327 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.341179 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.341126 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.341288 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.341269 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q82vz\"" Jul 15 15:35:25.341387 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.341369 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.341441 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.341404 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 15:35:25.342002 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.341984 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:25.342078 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.342048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:25.342771 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.342754 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 15:35:25.343344 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.343325 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.344670 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.344654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.345785 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.345770 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dvc7d\"" Jul 15 15:35:25.346037 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.346008 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.346326 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.346083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:25.346709 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.346619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.347062 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.346708 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.347062 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.346623 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gz9fs\"" Jul 15 15:35:25.347713 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.347691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 15:35:25.347958 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.347938 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rkldf\"" Jul 15 15:35:25.348179 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.348163 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 15:35:25.348427 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.348408 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 15:35:25.350863 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.350501 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.352082 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-host\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.352163 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352087 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.352163 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-socket-dir-parent\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352163 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-kubelet\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352163 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-cnibin\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.352334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.352334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysconfig\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.352334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-cnibin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:25.352334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cznvp\" (UniqueName: \"kubernetes.io/projected/d8ca0860-a360-4ab7-a8db-ad649645f78f-kube-api-access-cznvp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-socket-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-registration-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352419 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-device-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2bx\" (UniqueName: \"kubernetes.io/projected/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kube-api-access-ht2bx\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-netns\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-hostroot\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352633 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwmp\" (UniqueName: \"kubernetes.io/projected/55b4db73-3664-45c6-bada-4c1271c8a2aa-kube-api-access-4kwmp\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-sys-fs\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352735 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w59v\" (UniqueName: \"kubernetes.io/projected/b27bb4a0-3726-496d-970f-50b4c5ae3842-kube-api-access-2w59v\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-conf-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.352790 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-modprobe-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-cni-binary-copy\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352885 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-k8s-cni-cncf-io\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-daemon-config\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zgqb\" (UniqueName: \"kubernetes.io/projected/a7df97ed-1354-455d-96c8-4294a8f04e31-kube-api-access-9zgqb\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-conf\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.352991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-systemd\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353017 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-tmp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353035 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17751178-9b47-4fb9-b7cf-015fecd8ffac-iptables-alerter-script\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-system-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-os-release\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-bin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353109 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-etc-kubernetes\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-sys\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-lib-modules\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-var-lib-kubelet\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-tuned\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17751178-9b47-4fb9-b7cf-015fecd8ffac-host-slash\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlq99\" (UniqueName: \"kubernetes.io/projected/17751178-9b47-4fb9-b7cf-015fecd8ffac-kube-api-access-qlq99\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353296 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-multus\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-multus-certs\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-os-release\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-kubernetes\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.353642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.353402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-run\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.354171 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.354154 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fj8dk\"" Jul 15 15:35:25.354467 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.354450 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356129 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356154 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356151 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356171 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356154 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 15:35:25.356296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.356132 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmcwq\"" Jul 15 15:35:25.360644 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.360561 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 15:35:25.394760 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.394737 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9l862" Jul 15 15:35:25.406166 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.406146 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9l862" Jul 15 15:35:25.442186 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.442123 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 15:35:25.454304 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454275 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-script-lib\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.454412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbsmv\" (UniqueName: \"kubernetes.io/projected/15f71a07-b9d4-4a7b-b7f9-76337e141c09-kube-api-access-gbsmv\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.454412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-dbus\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.454412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-modprobe-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454444 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-cni-binary-copy\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454469 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-k8s-cni-cncf-io\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zgqb\" (UniqueName: \"kubernetes.io/projected/a7df97ed-1354-455d-96c8-4294a8f04e31-kube-api-access-9zgqb\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c584\" (UniqueName: \"kubernetes.io/projected/23074da3-a235-4c06-892f-3a25623649e4-kube-api-access-5c584\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-konnectivity-ca\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.454610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-conf\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-tmp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17751178-9b47-4fb9-b7cf-015fecd8ffac-iptables-alerter-script\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454678 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-os-release\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-bin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-var-lib-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f71a07-b9d4-4a7b-b7f9-76337e141c09-tmp-dir\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-sys\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-tuned\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17751178-9b47-4fb9-b7cf-015fecd8ffac-host-slash\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454890 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlq99\" (UniqueName: \"kubernetes.io/projected/17751178-9b47-4fb9-b7cf-015fecd8ffac-kube-api-access-qlq99\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-multus\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-slash\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.455050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.454974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15f71a07-b9d4-4a7b-b7f9-76337e141c09-hosts-file\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455020 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-run\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-socket-dir-parent\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-os-release\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-kubelet-config\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455161 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-bin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-run\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455314 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455373 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-socket-dir-parent\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-cni-multus\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17751178-9b47-4fb9-b7cf-015fecd8ffac-host-slash\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-sys\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.455754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455466 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.455988 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-cni-binary-copy\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17751178-9b47-4fb9-b7cf-015fecd8ffac-iptables-alerter-script\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456076 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-k8s-cni-cncf-io\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-cnibin\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456162 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysconfig\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-ovn\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3718ce4-1a27-4981-8076-0cfec68e0011-ovn-node-metrics-cert\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-netns\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-log-socket\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456424 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-conf\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.456453 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23074da3-a235-4c06-892f-3a25623649e4-host\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysconfig\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cznvp\" (UniqueName: \"kubernetes.io/projected/d8ca0860-a360-4ab7-a8db-ad649645f78f-kube-api-access-cznvp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-socket-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456548 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-device-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456668 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2bx\" (UniqueName: \"kubernetes.io/projected/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kube-api-access-ht2bx\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-netns\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456738 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-socket-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-conf-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwmp\" (UniqueName: \"kubernetes.io/projected/55b4db73-3664-45c6-bada-4c1271c8a2aa-kube-api-access-4kwmp\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.457121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-sys-fs\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456932 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23074da3-a235-4c06-892f-3a25623649e4-serviceca\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.456980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-device-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-daemon-config\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-systemd\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-system-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-kubelet\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-etc-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-netd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457308 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-config\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.457822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-lib-modules\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-var-lib-kubelet\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-multus-certs\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457446 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-systemd\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457524 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-multus-certs\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457561 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-sys-fs\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457616 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-lib-modules\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457633 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-var-lib-kubelet\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457659 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-run-netns\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457722 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-conf-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457764 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-cnibin\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7df97ed-1354-455d-96c8-4294a8f04e31-multus-daemon-config\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-systemd-units\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457843 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-node-log\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.458528 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-os-release\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457943 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-modprobe-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457964 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-kubernetes\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.457993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-host\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-host\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-kubelet\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.458104 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-cnibin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458153 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-kubernetes\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458178 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-system-cni-dir\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-system-cni-dir\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458233 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-host-var-lib-kubelet\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.458247 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:25.95820936 +0000 UTC m=+4.700980293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:25.459281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458273 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rtr\" (UniqueName: \"kubernetes.io/projected/e3718ce4-1a27-4981-8076-0cfec68e0011-kube-api-access-p5rtr\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458274 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b4db73-3664-45c6-bada-4c1271c8a2aa-os-release\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458249 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-cnibin\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-systemd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-agent-certs\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-etc-kubernetes\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458463 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-etc-kubernetes\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-registration-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-hostroot\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-bin\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-env-overrides\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.459942 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w59v\" (UniqueName: \"kubernetes.io/projected/b27bb4a0-3726-496d-970f-50b4c5ae3842-kube-api-access-2w59v\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.460659 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.458836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-registration-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.460659 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.459098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.460659 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.459202 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-sysctl-d\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.460659 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.459244 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7df97ed-1354-455d-96c8-4294a8f04e31-hostroot\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.460659 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.459276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b4db73-3664-45c6-bada-4c1271c8a2aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.460939 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.460716 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-etc-tuned\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.460939 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.460768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ca0860-a360-4ab7-a8db-ad649645f78f-tmp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.473146 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.473017 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:25.473146 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.473039 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:25.473146 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.473052 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:25.473146 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.473118 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:25.97310021 +0000 UTC m=+4.715871144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:25.475329 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.475243 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlq99\" (UniqueName: \"kubernetes.io/projected/17751178-9b47-4fb9-b7cf-015fecd8ffac-kube-api-access-qlq99\") pod \"iptables-alerter-xtgcg\" (UID: \"17751178-9b47-4fb9-b7cf-015fecd8ffac\") " pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.476639 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.476613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwmp\" (UniqueName: \"kubernetes.io/projected/55b4db73-3664-45c6-bada-4c1271c8a2aa-kube-api-access-4kwmp\") pod \"multus-additional-cni-plugins-nlfzt\" (UID: \"55b4db73-3664-45c6-bada-4c1271c8a2aa\") " pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.478827 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.478804 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cznvp\" (UniqueName: \"kubernetes.io/projected/d8ca0860-a360-4ab7-a8db-ad649645f78f-kube-api-access-cznvp\") pod \"tuned-mj974\" (UID: \"d8ca0860-a360-4ab7-a8db-ad649645f78f\") " pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.479286 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.479264 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w59v\" (UniqueName: \"kubernetes.io/projected/b27bb4a0-3726-496d-970f-50b4c5ae3842-kube-api-access-2w59v\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.479879 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.479852 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2bx\" (UniqueName: \"kubernetes.io/projected/b06ced32-d6f0-4b1a-b811-e9c7c908c1ff-kube-api-access-ht2bx\") pod \"aws-ebs-csi-driver-node-bmpnv\" (UID: \"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.480574 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.480554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zgqb\" (UniqueName: \"kubernetes.io/projected/a7df97ed-1354-455d-96c8-4294a8f04e31-kube-api-access-9zgqb\") pod \"multus-7t8hz\" (UID: \"a7df97ed-1354-455d-96c8-4294a8f04e31\") " pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.536166 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.536107 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" event={"ID":"b26d51ebf8c0b9aef32c216d74a1ab12","Type":"ContainerStarted","Data":"280b4de9f5117916cc978bb3aae0fd0182425eeb4e071b90949227aa9c336a30"} Jul 15 15:35:25.559738 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-netns\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-log-socket\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23074da3-a235-4c06-892f-3a25623649e4-host\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23074da3-a235-4c06-892f-3a25623649e4-serviceca\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559835 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-netns\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.559876 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-log-socket\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23074da3-a235-4c06-892f-3a25623649e4-host\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.559917 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-kubelet\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-etc-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.559966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-netd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.559984 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:26.059968146 +0000 UTC m=+4.802739074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-netd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560003 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-kubelet\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560007 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-etc-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-config\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560075 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-systemd-units\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560077 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-node-log\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-systemd-units\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560170 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-node-log\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rtr\" (UniqueName: \"kubernetes.io/projected/e3718ce4-1a27-4981-8076-0cfec68e0011-kube-api-access-p5rtr\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-systemd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560240 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-agent-certs\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-bin\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-env-overrides\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560304 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23074da3-a235-4c06-892f-3a25623649e4-serviceca\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-script-lib\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-run-ovn-kubernetes\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbsmv\" (UniqueName: \"kubernetes.io/projected/15f71a07-b9d4-4a7b-b7f9-76337e141c09-kube-api-access-gbsmv\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560437 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-systemd\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-cni-bin\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.560821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560536 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-dbus\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c584\" (UniqueName: \"kubernetes.io/projected/23074da3-a235-4c06-892f-3a25623649e4-kube-api-access-5c584\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560598 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-konnectivity-ca\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-var-lib-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f71a07-b9d4-4a7b-b7f9-76337e141c09-tmp-dir\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560716 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-env-overrides\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-slash\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560755 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-host-slash\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15f71a07-b9d4-4a7b-b7f9-76337e141c09-hosts-file\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-kubelet-config\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560838 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-ovn\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-var-lib-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-dbus\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3718ce4-1a27-4981-8076-0cfec68e0011-ovn-node-metrics-cert\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.561597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560887 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-openvswitch\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560810 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15f71a07-b9d4-4a7b-b7f9-76337e141c09-hosts-file\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560915 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab14dec2-b6d2-4628-8bad-e6198903e125-kubelet-config\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560955 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3718ce4-1a27-4981-8076-0cfec68e0011-run-ovn\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.560965 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-script-lib\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.561257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f71a07-b9d4-4a7b-b7f9-76337e141c09-tmp-dir\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.561337 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3718ce4-1a27-4981-8076-0cfec68e0011-ovnkube-config\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.562290 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.561485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-konnectivity-ca\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.563408 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.563380 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3-agent-certs\") pod \"konnectivity-agent-mc98l\" (UID: \"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3\") " pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.563503 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.563445 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3718ce4-1a27-4981-8076-0cfec68e0011-ovn-node-metrics-cert\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.569833 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.569813 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbsmv\" (UniqueName: \"kubernetes.io/projected/15f71a07-b9d4-4a7b-b7f9-76337e141c09-kube-api-access-gbsmv\") pod \"node-resolver-glb4z\" (UID: \"15f71a07-b9d4-4a7b-b7f9-76337e141c09\") " pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.571586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.571567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rtr\" (UniqueName: \"kubernetes.io/projected/e3718ce4-1a27-4981-8076-0cfec68e0011-kube-api-access-p5rtr\") pod \"ovnkube-node-555tn\" (UID: \"e3718ce4-1a27-4981-8076-0cfec68e0011\") " pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.571703 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.571664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c584\" (UniqueName: \"kubernetes.io/projected/23074da3-a235-4c06-892f-3a25623649e4-kube-api-access-5c584\") pod \"node-ca-d9zv5\" (UID: \"23074da3-a235-4c06-892f-3a25623649e4\") " pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.643571 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.643536 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" Jul 15 15:35:25.651968 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.651947 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" Jul 15 15:35:25.659845 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.659816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mj974" Jul 15 15:35:25.665253 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.665235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtgcg" Jul 15 15:35:25.674167 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.674148 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7t8hz" Jul 15 15:35:25.682056 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.682036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d9zv5" Jul 15 15:35:25.689881 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.689855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:25.697812 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.697765 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:25.702933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.702916 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glb4z" Jul 15 15:35:25.964865 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:25.964803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:25.965000 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.964935 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:25.965000 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:25.964990 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:26.964976648 +0000 UTC m=+5.707747581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:26.065728 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.065683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:26.065728 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.065729 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:26.065957 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065861 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:26.065957 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065867 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:26.065957 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065894 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:26.065957 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065909 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:26.065957 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065926 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:27.065908585 +0000 UTC m=+5.808679513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:26.066171 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.065988 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:27.065969002 +0000 UTC m=+5.808739952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:26.325757 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.325725 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23074da3_a235_4c06_892f_3a25623649e4.slice/crio-70e4704f7c32e9b51ba44b216a08b2ae3dc1aaf1e57e4671251f22f1ab5b9d3b WatchSource:0}: Error finding container 70e4704f7c32e9b51ba44b216a08b2ae3dc1aaf1e57e4671251f22f1ab5b9d3b: Status 404 returned error can't find the container with id 70e4704f7c32e9b51ba44b216a08b2ae3dc1aaf1e57e4671251f22f1ab5b9d3b Jul 15 15:35:26.334993 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.334964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d79d339_0be3_4a4e_92eb_9ea4ee7c9cb3.slice/crio-f1104ac38b5c02d243438eeb181d8d256669ad92c88fe8f2d4303d3dea27da83 WatchSource:0}: Error finding container f1104ac38b5c02d243438eeb181d8d256669ad92c88fe8f2d4303d3dea27da83: Status 404 returned error can't find the container with id f1104ac38b5c02d243438eeb181d8d256669ad92c88fe8f2d4303d3dea27da83 Jul 15 15:35:26.336297 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.336268 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7df97ed_1354_455d_96c8_4294a8f04e31.slice/crio-134858221fb12698080fd4cb13b1f260b3f28043d3125fdff7844ef518154499 WatchSource:0}: Error finding container 134858221fb12698080fd4cb13b1f260b3f28043d3125fdff7844ef518154499: Status 404 returned error can't find the container with id 134858221fb12698080fd4cb13b1f260b3f28043d3125fdff7844ef518154499 Jul 15 15:35:26.337072 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.337042 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3718ce4_1a27_4981_8076_0cfec68e0011.slice/crio-1e181cd4eccbfe881c84f8fac9ea38667ee8abdf927c6718697b7d3d7f35fbde WatchSource:0}: Error finding container 1e181cd4eccbfe881c84f8fac9ea38667ee8abdf927c6718697b7d3d7f35fbde: Status 404 returned error can't find the container with id 1e181cd4eccbfe881c84f8fac9ea38667ee8abdf927c6718697b7d3d7f35fbde Jul 15 15:35:26.339172 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.339060 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ced32_d6f0_4b1a_b811_e9c7c908c1ff.slice/crio-3566890c157c0221402ec9eedfe969ec9605899b7675b6a34daa443222a920ee WatchSource:0}: Error finding container 3566890c157c0221402ec9eedfe969ec9605899b7675b6a34daa443222a920ee: Status 404 returned error can't find the container with id 3566890c157c0221402ec9eedfe969ec9605899b7675b6a34daa443222a920ee Jul 15 15:35:26.345881 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.345414 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ca0860_a360_4ab7_a8db_ad649645f78f.slice/crio-8ab6cd9a8c311d4b4279499a381ce13079f1b24c2854159669157703d06440de WatchSource:0}: Error finding container 8ab6cd9a8c311d4b4279499a381ce13079f1b24c2854159669157703d06440de: Status 404 returned error can't find the container with id 8ab6cd9a8c311d4b4279499a381ce13079f1b24c2854159669157703d06440de Jul 15 15:35:26.352802 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:35:26.352778 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897e224843e5106a9a9258f3b28fcdb6.slice/crio-6d783bd89e828a0cb6ed455c32ba13d58a40f3ff5315132730eae21d529f1ecd WatchSource:0}: Error finding container 6d783bd89e828a0cb6ed455c32ba13d58a40f3ff5315132730eae21d529f1ecd: Status 404 returned error can't find the container with id 6d783bd89e828a0cb6ed455c32ba13d58a40f3ff5315132730eae21d529f1ecd Jul 15 15:35:26.408614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.408565 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:26 +0000 UTC" deadline="2028-02-07 13:55:32.585576348 +0000 UTC" Jul 15 15:35:26.408614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.408614 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13726h20m6.176965693s" Jul 15 15:35:26.532220 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.532197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:26.532356 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.532316 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:26.538729 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.538704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d9zv5" event={"ID":"23074da3-a235-4c06-892f-3a25623649e4","Type":"ContainerStarted","Data":"70e4704f7c32e9b51ba44b216a08b2ae3dc1aaf1e57e4671251f22f1ab5b9d3b"} Jul 15 15:35:26.539834 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.539809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" event={"ID":"897e224843e5106a9a9258f3b28fcdb6","Type":"ContainerStarted","Data":"6d783bd89e828a0cb6ed455c32ba13d58a40f3ff5315132730eae21d529f1ecd"} Jul 15 15:35:26.540917 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.540890 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mj974" event={"ID":"d8ca0860-a360-4ab7-a8db-ad649645f78f","Type":"ContainerStarted","Data":"8ab6cd9a8c311d4b4279499a381ce13079f1b24c2854159669157703d06440de"} Jul 15 15:35:26.541990 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.541970 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerStarted","Data":"516a189039b61d19e7a9d9a76eb683ee12cb3e02a1a1dc1a779ef545ed557130"} Jul 15 15:35:26.543077 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.543058 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtgcg" event={"ID":"17751178-9b47-4fb9-b7cf-015fecd8ffac","Type":"ContainerStarted","Data":"f7b3ea8e8ff207b104ac3c6174afc2b3b90252b216bc264678fea0f3b330252e"} Jul 15 15:35:26.544060 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.544034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glb4z" event={"ID":"15f71a07-b9d4-4a7b-b7f9-76337e141c09","Type":"ContainerStarted","Data":"cbc451955f86c3c38e7460e332306d3d858d608bfb56474ca506695eb8778447"} Jul 15 15:35:26.545219 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.545200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"1e181cd4eccbfe881c84f8fac9ea38667ee8abdf927c6718697b7d3d7f35fbde"} Jul 15 15:35:26.546275 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.546248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7t8hz" event={"ID":"a7df97ed-1354-455d-96c8-4294a8f04e31","Type":"ContainerStarted","Data":"134858221fb12698080fd4cb13b1f260b3f28043d3125fdff7844ef518154499"} Jul 15 15:35:26.548077 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.548057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" event={"ID":"b26d51ebf8c0b9aef32c216d74a1ab12","Type":"ContainerStarted","Data":"c0c86a9bd2955c36b30abba4e34b0e84aeb97e6b78182c129f94c1405812614c"} Jul 15 15:35:26.549152 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.549130 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" event={"ID":"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff","Type":"ContainerStarted","Data":"3566890c157c0221402ec9eedfe969ec9605899b7675b6a34daa443222a920ee"} Jul 15 15:35:26.550122 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.550102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mc98l" event={"ID":"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3","Type":"ContainerStarted","Data":"f1104ac38b5c02d243438eeb181d8d256669ad92c88fe8f2d4303d3dea27da83"} Jul 15 15:35:26.566229 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.566184 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-85.ec2.internal" podStartSLOduration=1.566172705 podStartE2EDuration="1.566172705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:26.565943449 +0000 UTC m=+5.308714403" watchObservedRunningTime="2026-07-15 15:35:26.566172705 +0000 UTC m=+5.308943656" Jul 15 15:35:26.974868 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:26.973465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:26.974868 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.973679 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:26.974868 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:26.973744 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:28.973724748 +0000 UTC m=+7.716495685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:27.074806 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.074767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:27.074992 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.074826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:27.074992 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.074969 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:27.075114 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.075033 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:29.075015082 +0000 UTC m=+7.817786025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:27.075478 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.075458 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:27.075539 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.075486 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:27.075539 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.075502 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:27.075679 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.075548 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:29.075533244 +0000 UTC m=+7.818304177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:27.408855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.408781 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:26 +0000 UTC" deadline="2028-02-24 01:37:56.954652072 +0000 UTC" Jul 15 15:35:27.408855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.408823 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14122h2m29.545834424s" Jul 15 15:35:27.535569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.534818 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:27.535569 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.534950 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:27.535569 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:27.535361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:27.535569 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:27.535470 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:28.531623 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:28.531589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:28.532101 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:28.531780 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:28.992643 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:28.992591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:28.992875 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:28.992791 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:28.992875 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:28.992856 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.992837849 +0000 UTC m=+11.735608788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:29.093682 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:29.093643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:29.093861 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:29.093734 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:29.093933 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.093923 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:29.094002 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.093986 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:33.093966205 +0000 UTC m=+11.836737159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:29.094475 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.094451 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:29.094568 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.094483 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:29.094568 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.094496 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:29.094568 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.094546 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:33.094529053 +0000 UTC m=+11.837299983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:29.532408 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:29.532375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:29.532825 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:29.532544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:29.532825 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.532548 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:29.532825 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:29.532701 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:30.532472 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:30.532388 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:30.533054 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:30.532559 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:31.532548 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:31.532303 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:31.532548 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:31.532433 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:31.532548 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:31.532523 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:31.533177 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:31.532667 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:32.532148 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:32.532112 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:32.532375 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:32.532255 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:33.035223 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:33.034670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:33.035223 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.034864 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:33.035223 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.034954 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:41.034931148 +0000 UTC m=+19.777702098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:33.135692 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:33.135654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:33.135882 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:33.135712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:33.135882 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.135850 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:33.136008 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.135909 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:41.135891119 +0000 UTC m=+19.878662054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:33.136301 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.136242 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:33.136301 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.136273 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:33.136301 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.136288 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:33.136580 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.136349 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:41.13633055 +0000 UTC m=+19.879101502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:33.532976 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:33.532715 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:33.532976 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:33.532738 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:33.532976 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.532850 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:33.532976 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:33.532943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:34.531705 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:34.531654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:34.532207 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:34.531845 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:35.531658 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:35.531626 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:35.531819 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:35.531770 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:35.532190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:35.532113 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:35.532254 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:35.532232 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:36.531664 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:36.531629 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:36.531834 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:36.531764 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:37.532156 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:37.532121 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:37.532665 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:37.532123 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:37.532665 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:37.532276 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:37.532665 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:37.532331 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:38.531635 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:38.531595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:38.531834 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:38.531723 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:39.531639 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:39.531606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:39.532084 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:39.531608 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:39.532084 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:39.531737 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:39.532084 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:39.531840 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:40.532293 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:40.532259 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:40.532761 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:40.532368 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:41.100158 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:41.100125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:41.100403 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.100252 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:41.100403 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.100312 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.100292938 +0000 UTC m=+35.843063908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:41.200799 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:41.200760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:41.200974 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:41.200853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:41.200974 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.200936 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:41.200974 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.200967 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:41.201147 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.200983 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:41.201147 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.200996 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:41.201147 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.201019 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.200998987 +0000 UTC m=+35.943769919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:41.201147 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.201040 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.201027266 +0000 UTC m=+35.943798193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:41.531839 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:41.531764 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:41.532000 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.531891 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:41.532000 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:41.531963 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:41.532115 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:41.532080 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:42.532246 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:42.532212 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:42.532719 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:42.532316 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:43.534933 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:43.534889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:43.535390 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:43.535048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:43.535544 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:43.535524 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:43.535673 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:43.535654 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:44.531600 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:44.531564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:44.531913 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:44.531689 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:45.532019 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:45.531977 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:45.532470 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:45.532126 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:45.532470 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:45.532177 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:45.532470 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:45.532274 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:46.533025 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.532184 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:46.533025 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:46.532489 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:46.599611 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.599577 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mj974" event={"ID":"d8ca0860-a360-4ab7-a8db-ad649645f78f","Type":"ContainerStarted","Data":"cfb9c850cc77684629556d08886bb4dc16b61b82371b5fb831a7231f3f36e91f"} Jul 15 15:35:46.601190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.601166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"59b9bc43971f0715729c103afae1ab78351cd772dbcfc154c312358ed1f2fac8"} Jul 15 15:35:46.601286 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.601242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"28818c012df1d8d1a099d90a1d5fb36f745dbc2edbb21f877e39bb7fba23c031"} Jul 15 15:35:46.602633 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.602610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7t8hz" event={"ID":"a7df97ed-1354-455d-96c8-4294a8f04e31","Type":"ContainerStarted","Data":"2bd39f598162fb2941f8f17bd58806193f328ddbb819d8dd1468778855ca6ba6"} Jul 15 15:35:46.621281 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.620188 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mj974" podStartSLOduration=2.673648975 podStartE2EDuration="22.620170005s" totalImagesPullingTime="19.94652103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.619948357 +0000 UTC m=+25.362719309" watchObservedRunningTime="2026-07-15 15:35:46.620170005 +0000 UTC m=+25.362940957" Jul 15 15:35:46.639388 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:46.639334 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7t8hz" podStartSLOduration=2.652914027 podStartE2EDuration="22.639313918s" totalImagesPullingTime="19.986399891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.638766748 +0000 UTC m=+25.381537698" watchObservedRunningTime="2026-07-15 15:35:46.639313918 +0000 UTC m=+25.382084869" Jul 15 15:35:47.532200 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.531985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:47.532351 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:47.532305 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:47.532457 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.532013 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:47.532587 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:47.532568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:47.605434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.605407 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" event={"ID":"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff","Type":"ContainerStarted","Data":"2274b52bbd22c65ffbe5d7b4fa2795b67ee5bada220babd7d9a7f6580450fce6"} Jul 15 15:35:47.606842 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.606822 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mc98l" event={"ID":"4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3","Type":"ContainerStarted","Data":"c4b88ab4214f441b5afee88c75fc397de282a87ed8c9bf2bc83597bed1f2fa9e"} Jul 15 15:35:47.608084 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.608063 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d9zv5" event={"ID":"23074da3-a235-4c06-892f-3a25623649e4","Type":"ContainerStarted","Data":"9976e75fd93085fee5f56f4b17b0f81f287f5a36f6d46ef84159814bd2ea65f3"} Jul 15 15:35:47.609376 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.609346 2554 generic.go:356] "Generic (PLEG): container finished" podID="897e224843e5106a9a9258f3b28fcdb6" containerID="6f418e3200007867981eb7c341c7bf381bc2e70e2824cd567a8f4a0ec9a8a8c9" exitCode=0 Jul 15 15:35:47.609457 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.609418 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" event={"ID":"897e224843e5106a9a9258f3b28fcdb6","Type":"ContainerDied","Data":"6f418e3200007867981eb7c341c7bf381bc2e70e2824cd567a8f4a0ec9a8a8c9"} Jul 15 15:35:47.610843 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.610824 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="6e6a1b15c5c41381dff701915ff320953cc6c8eaa315673f21f03cdbfdf2c87a" exitCode=0 Jul 15 15:35:47.610925 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.610886 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"6e6a1b15c5c41381dff701915ff320953cc6c8eaa315673f21f03cdbfdf2c87a"} Jul 15 15:35:47.612309 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.612282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glb4z" event={"ID":"15f71a07-b9d4-4a7b-b7f9-76337e141c09","Type":"ContainerStarted","Data":"0f46e120dbe286b753bf7f51dc2a5df82f47f75087f2da636575ad72cd235cca"} Jul 15 15:35:47.615156 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.615137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"41505ea10508a57a480dc30fcf10e121ab23985899a4e8d6fcb18bdc01528efa"} Jul 15 15:35:47.615251 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.615238 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"5d8b34de5cb2bb914389fab1a15e68f6e886fd96e05b97d967eacea4a0030457"} Jul 15 15:35:47.615298 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.615273 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"8e47b7f11d14c0068f127dcb7680c3e17ea630035915b8dd12b4fab383d9ff3d"} Jul 15 15:35:47.615337 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.615302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"14971ec60891939916d42c4d27f581b98e4621f81fd67b4ddddd531e0d9ac5e5"} Jul 15 15:35:47.630971 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.630935 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mc98l" podStartSLOduration=3.673020572 podStartE2EDuration="23.630924435s" totalImagesPullingTime="19.957903863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:47.630882469 +0000 UTC m=+26.373653419" watchObservedRunningTime="2026-07-15 15:35:47.630924435 +0000 UTC m=+26.373695384" Jul 15 15:35:47.672904 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.672863 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-glb4z" podStartSLOduration=3.817690352 podStartE2EDuration="23.672851217s" totalImagesPullingTime="19.855160865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:47.65071724 +0000 UTC m=+26.393488179" watchObservedRunningTime="2026-07-15 15:35:47.672851217 +0000 UTC m=+26.415622166" Jul 15 15:35:47.724840 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:47.724790 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d9zv5" podStartSLOduration=3.790193017 podStartE2EDuration="23.724773125s" totalImagesPullingTime="19.934580108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:47.724387761 +0000 UTC m=+26.467158712" watchObservedRunningTime="2026-07-15 15:35:47.724773125 +0000 UTC m=+26.467544077" Jul 15 15:35:48.059174 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.059153 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 15:35:48.410881 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.410796 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T15:35:48.059171323Z","UUID":"940c6fa9-1ebf-4e0c-8dd9-f21743c9f92e","Handler":null,"Name":"","Endpoint":""} Jul 15 15:35:48.412179 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.412162 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 15:35:48.412278 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.412189 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 15:35:48.531744 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.531713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:48.531908 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:48.531810 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:48.619194 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.619158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" event={"ID":"897e224843e5106a9a9258f3b28fcdb6","Type":"ContainerStarted","Data":"385cef7718e375aadcbc2a2bd72af4b2f8bdfed2ecb756605a080dc33b7f25ce"} Jul 15 15:35:48.621226 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.621202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtgcg" event={"ID":"17751178-9b47-4fb9-b7cf-015fecd8ffac","Type":"ContainerStarted","Data":"03c4cfa9699e453091d084899dc845b5eb3d47d7250724e4a569443a7fb4abae"} Jul 15 15:35:48.622966 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.622944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" event={"ID":"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff","Type":"ContainerStarted","Data":"207e1177e9926cfde67108f517922fcc37e037f5522d6bd5c0edee08ded55ba6"} Jul 15 15:35:48.637389 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.637352 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-85.ec2.internal" podStartSLOduration=23.637339146 podStartE2EDuration="23.637339146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:48.636970765 +0000 UTC m=+27.379741713" watchObservedRunningTime="2026-07-15 15:35:48.637339146 +0000 UTC m=+27.380110094" Jul 15 15:35:48.653614 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:48.653577 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xtgcg" podStartSLOduration=4.826610029 podStartE2EDuration="24.653564791s" totalImagesPullingTime="19.826954762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:48.653212091 +0000 UTC m=+27.395983040" watchObservedRunningTime="2026-07-15 15:35:48.653564791 +0000 UTC m=+27.396335739" Jul 15 15:35:49.024219 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.024137 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:49.024787 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.024751 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:49.532064 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.532025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:49.532245 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.532071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:49.532245 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:49.532177 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:49.532357 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:49.532287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:49.629548 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.629513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"b99303afc4098cab4454798309395268fb263c7fd4d6d93b84c1cd99aab3d39a"} Jul 15 15:35:49.629988 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.629850 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:49.630180 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:49.630161 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mc98l" Jul 15 15:35:50.532227 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:50.532191 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:50.532420 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:50.532324 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:50.634116 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:50.634068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" event={"ID":"b06ced32-d6f0-4b1a-b811-e9c7c908c1ff","Type":"ContainerStarted","Data":"8b80a514717b559c0abc92cc2aa0a7cff0e8209a3a8d5341e94c0ac5cb5d809c"} Jul 15 15:35:50.655531 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:50.655464 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmpnv" podStartSLOduration=3.869574398 podStartE2EDuration="26.655441985s" totalImagesPullingTime="22.785867587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:50.655395907 +0000 UTC m=+29.398166858" watchObservedRunningTime="2026-07-15 15:35:50.655441985 +0000 UTC m=+29.398212930" Jul 15 15:35:51.532210 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:51.532174 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:51.532356 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:51.532174 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:51.532356 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:51.532305 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:51.532479 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:51.532397 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:52.532085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.532059 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:52.532415 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:52.532152 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:52.639826 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.639790 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerStarted","Data":"a8f5cb9a564a93395a62d1cc1af82859676e14c083ae4756f6fdb4c526ed54a8"} Jul 15 15:35:52.643557 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.643531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" event={"ID":"e3718ce4-1a27-4981-8076-0cfec68e0011","Type":"ContainerStarted","Data":"a450b55699ca741d12f4c1f2a165dee1a2d1e0eee8be687aa0b36c8289ada539"} Jul 15 15:35:52.643824 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.643773 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:52.643927 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.643828 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:52.643927 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.643874 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:52.658928 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.658906 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:52.661953 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.661936 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:35:52.694278 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:52.694234 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" podStartSLOduration=8.630913963 podStartE2EDuration="28.694218839s" totalImagesPullingTime="20.063304876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:52.692261782 +0000 UTC m=+31.435032731" watchObservedRunningTime="2026-07-15 15:35:52.694218839 +0000 UTC m=+31.436989788" Jul 15 15:35:53.532348 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:53.532314 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:53.533183 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:53.532380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:53.533183 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:53.532400 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:53.533183 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:53.532450 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:53.647265 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:53.647234 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="a8f5cb9a564a93395a62d1cc1af82859676e14c083ae4756f6fdb4c526ed54a8" exitCode=0 Jul 15 15:35:53.647411 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:53.647324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"a8f5cb9a564a93395a62d1cc1af82859676e14c083ae4756f6fdb4c526ed54a8"} Jul 15 15:35:54.532219 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.531993 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:54.532375 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:54.532318 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:54.929561 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.929490 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64gml"] Jul 15 15:35:54.929683 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.929667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:54.929790 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:54.929771 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:54.932073 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.931911 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f99qw"] Jul 15 15:35:54.932073 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.932011 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:54.932210 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:54.932105 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:54.946259 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.946216 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-268cf"] Jul 15 15:35:54.946373 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:54.946351 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:54.946521 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:54.946481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:55.653971 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:55.653934 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="dcc8fa61c4ccd7b517ab0b9defa1ecbd78c9dc78bd9162983dbc139bba204e27" exitCode=0 Jul 15 15:35:55.653971 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:55.653984 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"dcc8fa61c4ccd7b517ab0b9defa1ecbd78c9dc78bd9162983dbc139bba204e27"} Jul 15 15:35:56.531871 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:56.531840 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:56.532031 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:56.531948 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:56.532031 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:56.531964 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:56.532151 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:56.532048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:56.532151 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:56.532087 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:56.532151 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:56.532138 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:57.123599 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:57.123574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:57.123982 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.123961 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:57.124112 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.124100 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs podName:b27bb4a0-3726-496d-970f-50b4c5ae3842 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:29.124070576 +0000 UTC m=+67.866841519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs") pod "network-metrics-daemon-268cf" (UID: "b27bb4a0-3726-496d-970f-50b4c5ae3842") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:35:57.224330 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:57.224304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:57.224493 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:57.224340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:57.224493 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224432 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:57.224493 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224478 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret podName:ab14dec2-b6d2-4628-8bad-e6198903e125 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:29.224466874 +0000 UTC m=+67.967237800 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret") pod "global-pull-secret-syncer-64gml" (UID: "ab14dec2-b6d2-4628-8bad-e6198903e125") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:35:57.224493 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224485 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:35:57.224694 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224527 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:35:57.224694 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224542 2554 projected.go:196] Error preparing data for projected volume kube-api-access-nh85b for pod openshift-network-diagnostics/network-check-target-f99qw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:57.224694 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:57.224598 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b podName:5434d885-d25d-434f-a20f-1a27ea42b9ab nodeName:}" failed. No retries permitted until 2026-07-15 15:36:29.224581989 +0000 UTC m=+67.967352932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh85b" (UniqueName: "kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b") pod "network-check-target-f99qw" (UID: "5434d885-d25d-434f-a20f-1a27ea42b9ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:35:57.662724 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:57.662691 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="49bdc64dcd98924f4373021eba75068c4c02f67ebddc5104b7df77a55a72b184" exitCode=0 Jul 15 15:35:57.662902 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:57.662754 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"49bdc64dcd98924f4373021eba75068c4c02f67ebddc5104b7df77a55a72b184"} Jul 15 15:35:58.531626 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:58.531593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:35:58.532015 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:58.531686 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:35:58.532015 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:58.531694 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:35:58.532015 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:58.531692 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64gml" podUID="ab14dec2-b6d2-4628-8bad-e6198903e125" Jul 15 15:35:58.532015 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:58.531774 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-268cf" podUID="b27bb4a0-3726-496d-970f-50b4c5ae3842" Jul 15 15:35:58.532015 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:35:58.531827 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f99qw" podUID="5434d885-d25d-434f-a20f-1a27ea42b9ab" Jul 15 15:35:59.987034 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:35:59.986815 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glb4z_15f71a07-b9d4-4a7b-b7f9-76337e141c09/dns-node-resolver/0.log" Jul 15 15:36:00.108268 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.108243 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-85.ec2.internal" event="NodeReady" Jul 15 15:36:00.108430 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.108392 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 15:36:00.168483 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.168449 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dxsdm"] Jul 15 15:36:00.170667 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.170643 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cm46v"] Jul 15 15:36:00.170822 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.170799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.175135 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.173226 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.175135 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.173667 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dq8c7\"" Jul 15 15:36:00.175135 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.174052 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 15:36:00.175135 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.174089 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 15:36:00.175884 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.175860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 15:36:00.176423 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.176406 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvjqc\"" Jul 15 15:36:00.176995 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.176904 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 15:36:00.176995 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.176928 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 15:36:00.176995 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.176968 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 15:36:00.185497 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.185471 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxsdm"] Jul 15 15:36:00.186586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.186459 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cm46v"] Jul 15 15:36:00.195787 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.195766 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5ls28"] Jul 15 15:36:00.197702 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.197684 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.201783 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.201763 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 15:36:00.201896 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.201815 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 15:36:00.201962 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.201919 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qwxrd\"" Jul 15 15:36:00.202110 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.202075 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 15:36:00.213980 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.213959 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5ls28"] Jul 15 15:36:00.245431 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68ead6c0-89e2-4b81-88de-c8957e3e0af0-data-volume\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.245612 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245447 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.245612 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-tmp-dir\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.245612 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.245746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245611 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68ead6c0-89e2-4b81-88de-c8957e3e0af0-crio-socket\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.245746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2m9x\" (UniqueName: \"kubernetes.io/projected/694897f1-9f86-4f5b-959a-5123f80be7bd-kube-api-access-q2m9x\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.245746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbsk\" (UniqueName: \"kubernetes.io/projected/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-api-access-gfbsk\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.245746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrc26\" (UniqueName: \"kubernetes.io/projected/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-kube-api-access-qrc26\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.245924 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694897f1-9f86-4f5b-959a-5123f80be7bd-cert\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.245924 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-config-volume\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.245924 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.245814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.346952 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.346915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.346960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68ead6c0-89e2-4b81-88de-c8957e3e0af0-crio-socket\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.346984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2m9x\" (UniqueName: \"kubernetes.io/projected/694897f1-9f86-4f5b-959a-5123f80be7bd-kube-api-access-q2m9x\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbsk\" (UniqueName: \"kubernetes.io/projected/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-api-access-gfbsk\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347051 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrc26\" (UniqueName: \"kubernetes.io/projected/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-kube-api-access-qrc26\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.347126 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694897f1-9f86-4f5b-959a-5123f80be7bd-cert\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347132 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.847109642 +0000 UTC m=+39.589880583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : configmap "kube-rbac-proxy" not found Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-config-volume\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347211 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68ead6c0-89e2-4b81-88de-c8957e3e0af0-crio-socket\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68ead6c0-89e2-4b81-88de-c8957e3e0af0-data-volume\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347295 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-tmp-dir\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.347424 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347349 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls podName:ac7a2eae-2006-4908-a5ca-e640cd7e8b23 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.847331428 +0000 UTC m=+39.590102363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls") pod "dns-default-dxsdm" (UID: "ac7a2eae-2006-4908-a5ca-e640cd7e8b23") : secret "dns-default-metrics-tls" not found Jul 15 15:36:00.347782 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347433 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:36:00.347782 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.347482 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.847466269 +0000 UTC m=+39.590237204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : secret "insights-runtime-extractor-tls" not found Jul 15 15:36:00.347782 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68ead6c0-89e2-4b81-88de-c8957e3e0af0-data-volume\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.347782 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347701 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-tmp-dir\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.347972 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.347948 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-config-volume\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.352071 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.352047 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694897f1-9f86-4f5b-959a-5123f80be7bd-cert\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.357646 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.357623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbsk\" (UniqueName: \"kubernetes.io/projected/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-api-access-gfbsk\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.358010 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.357989 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrc26\" (UniqueName: \"kubernetes.io/projected/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-kube-api-access-qrc26\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.358819 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.358773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2m9x\" (UniqueName: \"kubernetes.io/projected/694897f1-9f86-4f5b-959a-5123f80be7bd-kube-api-access-q2m9x\") pod \"ingress-canary-5ls28\" (UID: \"694897f1-9f86-4f5b-959a-5123f80be7bd\") " pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.507542 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.507496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5ls28" Jul 15 15:36:00.531841 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.531810 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:36:00.531995 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.531851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:36:00.531995 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.531851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:36:00.535226 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\"" Jul 15 15:36:00.535226 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535156 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 15:36:00.535226 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535173 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\"" Jul 15 15:36:00.535549 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535292 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 15:36:00.535549 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 15:36:00.535643 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.535575 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 15:36:00.670213 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.670161 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5ls28"] Jul 15 15:36:00.673967 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:00.673937 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694897f1_9f86_4f5b_959a_5123f80be7bd.slice/crio-55bc8a844f5817a30228b65eb354ca872a5916b5e81932b88f1ae58adc22fe04 WatchSource:0}: Error finding container 55bc8a844f5817a30228b65eb354ca872a5916b5e81932b88f1ae58adc22fe04: Status 404 returned error can't find the container with id 55bc8a844f5817a30228b65eb354ca872a5916b5e81932b88f1ae58adc22fe04 Jul 15 15:36:00.850891 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.850849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.851085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.850948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:00.851085 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.850986 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:36:00.851085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.851022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:00.851085 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.851068 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.851045932 +0000 UTC m=+40.593816864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : configmap "kube-rbac-proxy" not found Jul 15 15:36:00.851294 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.851114 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:36:00.851294 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.851189 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls podName:ac7a2eae-2006-4908-a5ca-e640cd7e8b23 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.851167816 +0000 UTC m=+40.593938767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls") pod "dns-default-dxsdm" (UID: "ac7a2eae-2006-4908-a5ca-e640cd7e8b23") : secret "dns-default-metrics-tls" not found Jul 15 15:36:00.851294 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.851120 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:36:00.851294 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:00.851272 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.851252849 +0000 UTC m=+40.594023796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : secret "insights-runtime-extractor-tls" not found Jul 15 15:36:00.969085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:00.968995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d9zv5_23074da3-a235-4c06-892f-3a25623649e4/node-ca/0.log" Jul 15 15:36:01.400727 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.400527 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kz6ll"] Jul 15 15:36:01.403629 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.403610 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.406468 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.406446 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 15:36:01.407994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.407894 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 15:36:01.407994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.407916 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 15:36:01.407994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.407958 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fk4sm\"" Jul 15 15:36:01.408198 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.408081 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 15:36:01.418144 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.418113 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kz6ll"] Jul 15 15:36:01.455354 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.455327 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.455812 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.455780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9lt\" (UniqueName: \"kubernetes.io/projected/142e0d05-bb38-4e93-8638-66ccf126f8a6-kube-api-access-wt9lt\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.455936 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.455881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-key\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.556469 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.556436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-key\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.556654 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.556536 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.556654 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.556605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9lt\" (UniqueName: \"kubernetes.io/projected/142e0d05-bb38-4e93-8638-66ccf126f8a6-kube-api-access-wt9lt\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.557475 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.557445 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-cabundle\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.559746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.559724 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142e0d05-bb38-4e93-8638-66ccf126f8a6-signing-key\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.565548 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.565526 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9lt\" (UniqueName: \"kubernetes.io/projected/142e0d05-bb38-4e93-8638-66ccf126f8a6-kube-api-access-wt9lt\") pod \"service-ca-79f68b9f4f-kz6ll\" (UID: \"142e0d05-bb38-4e93-8638-66ccf126f8a6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.674737 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.674632 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5ls28" event={"ID":"694897f1-9f86-4f5b-959a-5123f80be7bd","Type":"ContainerStarted","Data":"55bc8a844f5817a30228b65eb354ca872a5916b5e81932b88f1ae58adc22fe04"} Jul 15 15:36:01.714154 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.714118 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" Jul 15 15:36:01.859198 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.859161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:01.859382 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.859260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:01.859382 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:01.859298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:01.859382 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859331 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:36:01.859547 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859383 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:36:01.859547 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls podName:ac7a2eae-2006-4908-a5ca-e640cd7e8b23 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.859389375 +0000 UTC m=+42.602160323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls") pod "dns-default-dxsdm" (UID: "ac7a2eae-2006-4908-a5ca-e640cd7e8b23") : secret "dns-default-metrics-tls" not found Jul 15 15:36:01.859547 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859409 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:36:01.859547 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859434 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.85941913 +0000 UTC m=+42.602190062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : configmap "kube-rbac-proxy" not found Jul 15 15:36:01.859547 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:01.859477 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.85946178 +0000 UTC m=+42.602232709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : secret "insights-runtime-extractor-tls" not found Jul 15 15:36:02.315462 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:02.315433 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kz6ll"] Jul 15 15:36:02.321191 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:02.321166 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142e0d05_bb38_4e93_8638_66ccf126f8a6.slice/crio-ce293b8f4f64ecdad92dd25df26f85be3da4f79a2933332e7d38b3863bbf3269 WatchSource:0}: Error finding container ce293b8f4f64ecdad92dd25df26f85be3da4f79a2933332e7d38b3863bbf3269: Status 404 returned error can't find the container with id ce293b8f4f64ecdad92dd25df26f85be3da4f79a2933332e7d38b3863bbf3269 Jul 15 15:36:02.680293 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:02.680256 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="3ff1d800533d44541f7d9fba0a3c71ffb470837b24916cd7b260b8cac761ef03" exitCode=0 Jul 15 15:36:02.680741 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:02.680333 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"3ff1d800533d44541f7d9fba0a3c71ffb470837b24916cd7b260b8cac761ef03"} Jul 15 15:36:02.681694 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:02.681671 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" event={"ID":"142e0d05-bb38-4e93-8638-66ccf126f8a6","Type":"ContainerStarted","Data":"ce293b8f4f64ecdad92dd25df26f85be3da4f79a2933332e7d38b3863bbf3269"} Jul 15 15:36:03.689229 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:03.689064 2554 generic.go:356] "Generic (PLEG): container finished" podID="55b4db73-3664-45c6-bada-4c1271c8a2aa" containerID="ec72afbf97ed7fd9cba8e2a696ee2c4e84e702aef2023ddc680b81e1c5a0ae34" exitCode=0 Jul 15 15:36:03.689229 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:03.689143 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerDied","Data":"ec72afbf97ed7fd9cba8e2a696ee2c4e84e702aef2023ddc680b81e1c5a0ae34"} Jul 15 15:36:03.877882 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:03.877845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:03.878059 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:03.877920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:03.878059 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:03.877951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:03.878059 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.877995 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:36:03.878059 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.878024 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:36:03.878267 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.878065 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls podName:ac7a2eae-2006-4908-a5ca-e640cd7e8b23 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.878046653 +0000 UTC m=+46.620817595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls") pod "dns-default-dxsdm" (UID: "ac7a2eae-2006-4908-a5ca-e640cd7e8b23") : secret "dns-default-metrics-tls" not found Jul 15 15:36:03.878267 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.878073 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:36:03.878267 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.878080 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.878074065 +0000 UTC m=+46.620844992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : configmap "kube-rbac-proxy" not found Jul 15 15:36:03.878267 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:03.878144 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.878124173 +0000 UTC m=+46.620895114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : secret "insights-runtime-extractor-tls" not found Jul 15 15:36:05.697640 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.697601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" event={"ID":"55b4db73-3664-45c6-bada-4c1271c8a2aa","Type":"ContainerStarted","Data":"d9f6d36691ca6cc495334331263b66c2e0f795b2f33ea7b5c41d685ac3ede76f"} Jul 15 15:36:05.699164 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.699140 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5ls28" event={"ID":"694897f1-9f86-4f5b-959a-5123f80be7bd","Type":"ContainerStarted","Data":"a6daa3b3fd52d42e12ae8bfa68336d0d9320b178345de40aef09c316c78dccb4"} Jul 15 15:36:05.700483 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.700460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" event={"ID":"142e0d05-bb38-4e93-8638-66ccf126f8a6","Type":"ContainerStarted","Data":"09e55e0c9699730947693637ef3869938f0ac0bb534b04626567e3f3395616d3"} Jul 15 15:36:05.755085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.755038 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nlfzt" podStartSLOduration=10.080576796 podStartE2EDuration="41.755023645s" totalImagesPullingTime="31.674446849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:05.754589738 +0000 UTC m=+44.497360687" watchObservedRunningTime="2026-07-15 15:36:05.755023645 +0000 UTC m=+44.497794594" Jul 15 15:36:05.788201 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.788149 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-kz6ll" podStartSLOduration=2.075264954 podStartE2EDuration="4.788131109s" totalImagesPullingTime="2.712866155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:05.787361059 +0000 UTC m=+44.530132008" watchObservedRunningTime="2026-07-15 15:36:05.788131109 +0000 UTC m=+44.530902052" Jul 15 15:36:05.820917 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:05.820876 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5ls28" podStartSLOduration=1.465714701 podStartE2EDuration="5.820862106s" totalImagesPullingTime="4.355147405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:05.817669046 +0000 UTC m=+44.560439996" watchObservedRunningTime="2026-07-15 15:36:05.820862106 +0000 UTC m=+44.563633054" Jul 15 15:36:07.912075 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:07.912041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:07.912103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:07.912132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:07.912189 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:07.912250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls podName:ac7a2eae-2006-4908-a5ca-e640cd7e8b23 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:15.912235633 +0000 UTC m=+54.655006559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls") pod "dns-default-dxsdm" (UID: "ac7a2eae-2006-4908-a5ca-e640cd7e8b23") : secret "dns-default-metrics-tls" not found Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:07.912258 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:36:07.912426 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:07.912309 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls podName:68ead6c0-89e2-4b81-88de-c8957e3e0af0 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:15.912294659 +0000 UTC m=+54.655065594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cm46v" (UID: "68ead6c0-89e2-4b81-88de-c8957e3e0af0") : secret "insights-runtime-extractor-tls" not found Jul 15 15:36:07.912672 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:07.912655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68ead6c0-89e2-4b81-88de-c8957e3e0af0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:15.970958 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:15.970920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:15.971589 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:15.971008 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:15.974254 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:15.974225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68ead6c0-89e2-4b81-88de-c8957e3e0af0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cm46v\" (UID: \"68ead6c0-89e2-4b81-88de-c8957e3e0af0\") " pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:15.974360 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:15.974235 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7a2eae-2006-4908-a5ca-e640cd7e8b23-metrics-tls\") pod \"dns-default-dxsdm\" (UID: \"ac7a2eae-2006-4908-a5ca-e640cd7e8b23\") " pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:16.085607 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.085579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:16.092717 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.092695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cm46v" Jul 15 15:36:16.266896 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.266872 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxsdm"] Jul 15 15:36:16.269262 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:16.269233 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7a2eae_2006_4908_a5ca_e640cd7e8b23.slice/crio-bba722dc9c0bbf98b138936eb32254c30c8325b478129a6614888e14fba2d242 WatchSource:0}: Error finding container bba722dc9c0bbf98b138936eb32254c30c8325b478129a6614888e14fba2d242: Status 404 returned error can't find the container with id bba722dc9c0bbf98b138936eb32254c30c8325b478129a6614888e14fba2d242 Jul 15 15:36:16.286067 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.286042 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cm46v"] Jul 15 15:36:16.291810 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:16.289007 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ead6c0_89e2_4b81_88de_c8957e3e0af0.slice/crio-27575cd75b0c7bf589fc2795fb85bf6ba46c37106ee9b75b63f02401f03198eb WatchSource:0}: Error finding container 27575cd75b0c7bf589fc2795fb85bf6ba46c37106ee9b75b63f02401f03198eb: Status 404 returned error can't find the container with id 27575cd75b0c7bf589fc2795fb85bf6ba46c37106ee9b75b63f02401f03198eb Jul 15 15:36:16.733451 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.733413 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxsdm" event={"ID":"ac7a2eae-2006-4908-a5ca-e640cd7e8b23","Type":"ContainerStarted","Data":"bba722dc9c0bbf98b138936eb32254c30c8325b478129a6614888e14fba2d242"} Jul 15 15:36:16.734719 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:16.734688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm46v" event={"ID":"68ead6c0-89e2-4b81-88de-c8957e3e0af0","Type":"ContainerStarted","Data":"27575cd75b0c7bf589fc2795fb85bf6ba46c37106ee9b75b63f02401f03198eb"} Jul 15 15:36:18.742390 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:18.742346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxsdm" event={"ID":"ac7a2eae-2006-4908-a5ca-e640cd7e8b23","Type":"ContainerStarted","Data":"382bc3aa91290b4ece10c99e67647aaa20f9cd5c117298ff74abf12a1909a93e"} Jul 15 15:36:18.742975 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:18.742413 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxsdm" event={"ID":"ac7a2eae-2006-4908-a5ca-e640cd7e8b23","Type":"ContainerStarted","Data":"19f28deaf07d0da7fdf1265edd8502f1fc9a3e253108b953b1c366ac369972bc"} Jul 15 15:36:18.742975 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:18.742495 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:18.764905 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:18.764862 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dxsdm" podStartSLOduration=16.641375419 podStartE2EDuration="18.764847922s" totalImagesPullingTime="2.123472503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:18.763444553 +0000 UTC m=+57.506215507" watchObservedRunningTime="2026-07-15 15:36:18.764847922 +0000 UTC m=+57.507618871" Jul 15 15:36:21.722302 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.722271 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85"] Jul 15 15:36:21.724791 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.724715 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.730411 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.730381 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 15:36:21.730645 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.730615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 15:36:21.732374 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.732349 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 15:36:21.732657 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.732635 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 15:36:21.732756 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.732729 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 15:36:21.733182 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.733162 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 15:36:21.737836 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.737806 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 15:36:21.742719 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.742698 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85"] Jul 15 15:36:21.751550 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.751497 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm46v" event={"ID":"68ead6c0-89e2-4b81-88de-c8957e3e0af0","Type":"ContainerStarted","Data":"a9e3fd9699992c47c5a05663fb4817325d6d0b6219ee68fa8274dec18de9c00d"} Jul 15 15:36:21.811103 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.811071 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-w862g"] Jul 15 15:36:21.813069 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.813049 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:21.816405 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.816387 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 15:36:21.817742 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.817833 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.817833 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817800 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.817833 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.818106 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.818106 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.817968 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfjq\" (UniqueName: \"kubernetes.io/projected/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-kube-api-access-cxfjq\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.818196 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.818168 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 15:36:21.818379 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.818367 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p8pms\"" Jul 15 15:36:21.829576 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.829550 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w862g"] Jul 15 15:36:21.919177 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919102 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfjq\" (UniqueName: \"kubernetes.io/projected/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-kube-api-access-cxfjq\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.919177 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2s8\" (UniqueName: \"kubernetes.io/projected/27dc7972-4b01-4b39-989c-9f0c3958a433-kube-api-access-6v2s8\") pod \"downloads-68c9cbb497-w862g\" (UID: \"27dc7972-4b01-4b39-989c-9f0c3958a433\") " pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:21.919352 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.919352 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.919352 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.919444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.919444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.919417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.920355 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.920324 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.921703 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.921675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-ca\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.921812 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.921684 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.921872 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.921812 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.921928 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.921869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:21.933333 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:21.933302 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfjq\" (UniqueName: \"kubernetes.io/projected/7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2-kube-api-access-cxfjq\") pod \"cluster-proxy-proxy-agent-6674897dc8-cwl85\" (UID: \"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:22.020661 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.020624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2s8\" (UniqueName: \"kubernetes.io/projected/27dc7972-4b01-4b39-989c-9f0c3958a433-kube-api-access-6v2s8\") pod \"downloads-68c9cbb497-w862g\" (UID: \"27dc7972-4b01-4b39-989c-9f0c3958a433\") " pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:22.032300 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.032269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2s8\" (UniqueName: \"kubernetes.io/projected/27dc7972-4b01-4b39-989c-9f0c3958a433-kube-api-access-6v2s8\") pod \"downloads-68c9cbb497-w862g\" (UID: \"27dc7972-4b01-4b39-989c-9f0c3958a433\") " pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:22.043650 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.043624 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" Jul 15 15:36:22.121794 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.121684 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:22.202323 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.202251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85"] Jul 15 15:36:22.205893 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:22.205856 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dfe50ed_eaf3_41c8_b0ca_2b0fdf988aa2.slice/crio-b1838ec6d82c019fe42a9fbbce0fff040d8ee02cf4311fc23a7d89fcf8a925e2 WatchSource:0}: Error finding container b1838ec6d82c019fe42a9fbbce0fff040d8ee02cf4311fc23a7d89fcf8a925e2: Status 404 returned error can't find the container with id b1838ec6d82c019fe42a9fbbce0fff040d8ee02cf4311fc23a7d89fcf8a925e2 Jul 15 15:36:22.287287 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.287249 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w862g"] Jul 15 15:36:22.291279 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:22.291239 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dc7972_4b01_4b39_989c_9f0c3958a433.slice/crio-069d197eebeaf95cc39adb86b9a75fde2fdd0ee3eabf7e9d3bcb048ae4b80e98 WatchSource:0}: Error finding container 069d197eebeaf95cc39adb86b9a75fde2fdd0ee3eabf7e9d3bcb048ae4b80e98: Status 404 returned error can't find the container with id 069d197eebeaf95cc39adb86b9a75fde2fdd0ee3eabf7e9d3bcb048ae4b80e98 Jul 15 15:36:22.756331 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.756290 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w862g" event={"ID":"27dc7972-4b01-4b39-989c-9f0c3958a433","Type":"ContainerStarted","Data":"069d197eebeaf95cc39adb86b9a75fde2fdd0ee3eabf7e9d3bcb048ae4b80e98"} Jul 15 15:36:22.757794 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:22.757761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" event={"ID":"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2","Type":"ContainerStarted","Data":"b1838ec6d82c019fe42a9fbbce0fff040d8ee02cf4311fc23a7d89fcf8a925e2"} Jul 15 15:36:24.671848 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:24.671811 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-555tn" Jul 15 15:36:26.119048 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.119005 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:36:26.144080 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.144045 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:36:26.144247 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.144171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.151009 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.150979 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 15:36:26.151150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.151013 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 15:36:26.151150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.151037 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 15:36:26.151273 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.151152 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 15:36:26.151412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.151395 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mwl68\"" Jul 15 15:36:26.151760 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.151741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 15:36:26.259153 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.259318 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.259318 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259251 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw925\" (UniqueName: \"kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.259318 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.259452 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.259452 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.259410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360657 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw925\" (UniqueName: \"kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.360948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.360827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.361693 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.361630 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.361809 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.361741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.361809 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.361789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.363442 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.363418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.363709 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.363678 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.372688 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.372440 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw925\" (UniqueName: \"kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925\") pod \"console-5ffc9c9699-g2wtg\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:26.456981 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:26.456884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:28.410240 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.410210 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:36:28.414046 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:28.414020 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d683df2_f062_48f6_9e6c_4eec50f1a374.slice/crio-b1a080e55885ba8d315a284e7397243dfe306faf39b3e4601848e9df44b0ef0a WatchSource:0}: Error finding container b1a080e55885ba8d315a284e7397243dfe306faf39b3e4601848e9df44b0ef0a: Status 404 returned error can't find the container with id b1a080e55885ba8d315a284e7397243dfe306faf39b3e4601848e9df44b0ef0a Jul 15 15:36:28.747696 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.747659 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxsdm" Jul 15 15:36:28.780793 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.780753 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm46v" event={"ID":"68ead6c0-89e2-4b81-88de-c8957e3e0af0","Type":"ContainerStarted","Data":"c54ffaf5e5aef1b33abd04efdc082eb01b9924d2dfc98a1f46ca6f88e5a955ec"} Jul 15 15:36:28.783776 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.783729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" event={"ID":"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2","Type":"ContainerStarted","Data":"9b1112299f0c360ae72e6fcfe76aaa82aebfe7f215e38e5195418c3180591008"} Jul 15 15:36:28.783776 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.783776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" event={"ID":"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2","Type":"ContainerStarted","Data":"6b0022c55202f8117ae9716392f49dcfeacfa5b1fddbca8b4cb41adf95557544"} Jul 15 15:36:28.784065 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.783795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" event={"ID":"7dfe50ed-eaf3-41c8-b0ca-2b0fdf988aa2","Type":"ContainerStarted","Data":"e60612bc863fbab0ac1bedadb974f74456891a0da789e891784b0257afb96c08"} Jul 15 15:36:28.785871 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.785842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc9c9699-g2wtg" event={"ID":"3d683df2-f062-48f6-9e6c-4eec50f1a374","Type":"ContainerStarted","Data":"b1a080e55885ba8d315a284e7397243dfe306faf39b3e4601848e9df44b0ef0a"} Jul 15 15:36:28.806586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:28.806454 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674897dc8-cwl85" podStartSLOduration=1.7442575489999999 podStartE2EDuration="7.806432427s" totalImagesPullingTime="6.062174878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:28.805734975 +0000 UTC m=+67.548505925" watchObservedRunningTime="2026-07-15 15:36:28.806432427 +0000 UTC m=+67.549203378" Jul 15 15:36:29.183972 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.183937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:36:29.189129 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.189096 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 15:36:29.197495 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.197464 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b27bb4a0-3726-496d-970f-50b4c5ae3842-metrics-certs\") pod \"network-metrics-daemon-268cf\" (UID: \"b27bb4a0-3726-496d-970f-50b4c5ae3842\") " pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:36:29.285122 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.285078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:36:29.285122 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.285135 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:36:29.288460 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.288432 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 15:36:29.288612 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.288459 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 15:36:29.298865 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.298833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab14dec2-b6d2-4628-8bad-e6198903e125-original-pull-secret\") pod \"global-pull-secret-syncer-64gml\" (UID: \"ab14dec2-b6d2-4628-8bad-e6198903e125\") " pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:36:29.298999 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.298875 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 15:36:29.309270 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.309247 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh85b\" (UniqueName: \"kubernetes.io/projected/5434d885-d25d-434f-a20f-1a27ea42b9ab-kube-api-access-nh85b\") pod \"network-check-target-f99qw\" (UID: \"5434d885-d25d-434f-a20f-1a27ea42b9ab\") " pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:36:29.345373 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.345334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64gml" Jul 15 15:36:29.354851 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.354635 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\"" Jul 15 15:36:29.362203 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.362164 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:36:29.362577 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.362557 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\"" Jul 15 15:36:29.367289 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.367245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-268cf" Jul 15 15:36:29.524724 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.524647 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64gml"] Jul 15 15:36:29.554985 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.554937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f99qw"] Jul 15 15:36:29.591422 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.591389 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-268cf"] Jul 15 15:36:29.596650 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.596574 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh"] Jul 15 15:36:29.600490 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.599645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:29.618305 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.618280 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 15:36:29.618305 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.618299 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6kmkc\"" Jul 15 15:36:29.644523 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.638021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh"] Jul 15 15:36:29.689737 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.689698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bc94c31-4e16-4f80-bd2f-6df0c66fa59e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x2jfh\" (UID: \"5bc94c31-4e16-4f80-bd2f-6df0c66fa59e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:29.790178 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.790080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bc94c31-4e16-4f80-bd2f-6df0c66fa59e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x2jfh\" (UID: \"5bc94c31-4e16-4f80-bd2f-6df0c66fa59e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:29.791436 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.791346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64gml" event={"ID":"ab14dec2-b6d2-4628-8bad-e6198903e125","Type":"ContainerStarted","Data":"25ec14d1592ce97e7a94085dd1fda349b698246bce33a2d15f37db49d1f5de5b"} Jul 15 15:36:29.793094 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.793057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-268cf" event={"ID":"b27bb4a0-3726-496d-970f-50b4c5ae3842","Type":"ContainerStarted","Data":"59c374d95ce6646e8e42b949bc5714f39084075a8cde77b1f59e3fafb6910fac"} Jul 15 15:36:29.793232 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.793211 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bc94c31-4e16-4f80-bd2f-6df0c66fa59e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x2jfh\" (UID: \"5bc94c31-4e16-4f80-bd2f-6df0c66fa59e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:29.794525 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.794483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f99qw" event={"ID":"5434d885-d25d-434f-a20f-1a27ea42b9ab","Type":"ContainerStarted","Data":"04a683ecf4c6667e86aa434b8c36290221865fc30c4599413b15963be6653a3b"} Jul 15 15:36:29.914359 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:29.914321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:30.070473 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:30.070361 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh"] Jul 15 15:36:30.074834 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:30.074804 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc94c31_4e16_4f80_bd2f_6df0c66fa59e.slice/crio-4e7364491be54e6e07738f2ca0ed4e615873d4993832572c67ab709a74ab36b6 WatchSource:0}: Error finding container 4e7364491be54e6e07738f2ca0ed4e615873d4993832572c67ab709a74ab36b6: Status 404 returned error can't find the container with id 4e7364491be54e6e07738f2ca0ed4e615873d4993832572c67ab709a74ab36b6 Jul 15 15:36:30.804152 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:30.804089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" event={"ID":"5bc94c31-4e16-4f80-bd2f-6df0c66fa59e","Type":"ContainerStarted","Data":"4e7364491be54e6e07738f2ca0ed4e615873d4993832572c67ab709a74ab36b6"} Jul 15 15:36:33.874562 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:33.874484 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:36:33.899891 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:33.899862 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:36:33.900053 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:33.899934 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:33.909164 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:33.909138 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 15:36:34.024986 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.024935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025159 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqnkj\" (UniqueName: \"kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025159 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025052 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025159 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025350 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025350 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.025350 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.025256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqnkj\" (UniqueName: \"kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126543 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126543 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126543 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126543 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.126543 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.126470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.127389 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.127289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.127389 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.127295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.127389 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.127334 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.127632 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.127584 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.129443 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.129421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.129556 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.129532 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.136980 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.136957 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqnkj\" (UniqueName: \"kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj\") pod \"console-7dd5747ddc-jv4kp\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:34.212603 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:34.212568 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:45.844724 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.844643 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:36:45.849692 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:45.849493 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19b6220_7a0f_477d_9b7b_91f15aed718b.slice/crio-4be713f0674ba607f92f373a3b88c3059db3d374b926755369aa6913a7ea7623 WatchSource:0}: Error finding container 4be713f0674ba607f92f373a3b88c3059db3d374b926755369aa6913a7ea7623: Status 404 returned error can't find the container with id 4be713f0674ba607f92f373a3b88c3059db3d374b926755369aa6913a7ea7623 Jul 15 15:36:45.876736 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.876591 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f99qw" event={"ID":"5434d885-d25d-434f-a20f-1a27ea42b9ab","Type":"ContainerStarted","Data":"7ea4d79ee631310bf0db783f12cc81adf24ea3c05ae44b330cf09a190c3ae0e3"} Jul 15 15:36:45.876736 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.876698 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:36:45.883642 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.882974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" event={"ID":"5bc94c31-4e16-4f80-bd2f-6df0c66fa59e","Type":"ContainerStarted","Data":"d63154c42f80d7442cf273cefa72c1efc8c1f681ce924f8966897b87c2805a14"} Jul 15 15:36:45.883778 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.883758 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:45.892559 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.892488 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" Jul 15 15:36:45.896763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.893470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w862g" event={"ID":"27dc7972-4b01-4b39-989c-9f0c3958a433","Type":"ContainerStarted","Data":"08fe4a39ef7c853186af0c517a45c7fc7ada4fe5e25395cc4416a6157410cab8"} Jul 15 15:36:45.896763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.896630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:45.897005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.896962 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f99qw" podStartSLOduration=65.778268304 podStartE2EDuration="1m21.896948826s" totalImagesPullingTime="16.118680522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.89543938 +0000 UTC m=+84.638210331" watchObservedRunningTime="2026-07-15 15:36:45.896948826 +0000 UTC m=+84.639719770" Jul 15 15:36:45.897744 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.897714 2554 patch_prober.go:28] interesting pod/downloads-68c9cbb497-w862g container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" start-of-body= Jul 15 15:36:45.897853 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.897767 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-w862g" podUID="27dc7972-4b01-4b39-989c-9f0c3958a433" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" Jul 15 15:36:45.902733 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.902661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cm46v" event={"ID":"68ead6c0-89e2-4b81-88de-c8957e3e0af0","Type":"ContainerStarted","Data":"e43927de257b016ebd805404e139078804705951417318d5988fe998acef45df"} Jul 15 15:36:45.909474 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.909442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64gml" event={"ID":"ab14dec2-b6d2-4628-8bad-e6198903e125","Type":"ContainerStarted","Data":"7809ea1e2b96f101aa3aefc3165ba4bf2c5077da4835c813fb2b0ec15bac31e4"} Jul 15 15:36:45.911911 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.911849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5747ddc-jv4kp" event={"ID":"b19b6220-7a0f-477d-9b7b-91f15aed718b","Type":"ContainerStarted","Data":"4be713f0674ba607f92f373a3b88c3059db3d374b926755369aa6913a7ea7623"} Jul 15 15:36:45.914532 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.914130 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc9c9699-g2wtg" event={"ID":"3d683df2-f062-48f6-9e6c-4eec50f1a374","Type":"ContainerStarted","Data":"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758"} Jul 15 15:36:45.918288 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.918243 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-w862g" podStartSLOduration=1.532183901 podStartE2EDuration="24.918227499s" totalImagesPullingTime="23.386043598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.917774424 +0000 UTC m=+84.660545368" watchObservedRunningTime="2026-07-15 15:36:45.918227499 +0000 UTC m=+84.660998449" Jul 15 15:36:45.921665 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.920495 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-268cf" event={"ID":"b27bb4a0-3726-496d-970f-50b4c5ae3842","Type":"ContainerStarted","Data":"786bf80ccadaa6f386c0686520acb027f63b692d7a69fd2d612cef86cb0b559b"} Jul 15 15:36:45.935019 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.934975 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x2jfh" podStartSLOduration=1.292972392 podStartE2EDuration="16.934959648s" totalImagesPullingTime="15.641987256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.934072647 +0000 UTC m=+84.676843597" watchObservedRunningTime="2026-07-15 15:36:45.934959648 +0000 UTC m=+84.677730596" Jul 15 15:36:45.963144 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.963088 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cm46v" podStartSLOduration=16.709275128 podStartE2EDuration="45.963067344s" totalImagesPullingTime="29.253792216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:36:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.961710652 +0000 UTC m=+84.704481602" watchObservedRunningTime="2026-07-15 15:36:45.963067344 +0000 UTC m=+84.705838296" Jul 15 15:36:45.981019 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:45.980944 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-64gml" podStartSLOduration=65.836678733 podStartE2EDuration="1m21.980924624s" totalImagesPullingTime="16.144245891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.979127503 +0000 UTC m=+84.721898454" watchObservedRunningTime="2026-07-15 15:36:45.980924624 +0000 UTC m=+84.723695573" Jul 15 15:36:46.001402 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.001344 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ffc9c9699-g2wtg" podStartSLOduration=2.738075528 podStartE2EDuration="20.001325745s" totalImagesPullingTime="17.263250217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:45.999952736 +0000 UTC m=+84.742723686" watchObservedRunningTime="2026-07-15 15:36:46.001325745 +0000 UTC m=+84.744096694" Jul 15 15:36:46.458165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.458122 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:46.458355 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.458219 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:46.463586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.463561 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:46.650447 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.650409 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gz27t"] Jul 15 15:36:46.682101 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.682062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gz27t"] Jul 15 15:36:46.682272 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.682226 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.685294 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.685269 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wp6sm\"" Jul 15 15:36:46.685470 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.685308 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 15:36:46.685845 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.685826 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 15:36:46.686089 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.686074 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 15:36:46.686325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.686304 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 15:36:46.686814 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.686642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 15:36:46.730417 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.730307 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.730417 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.730380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tdf\" (UniqueName: \"kubernetes.io/projected/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-kube-api-access-f5tdf\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.730675 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.730426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.730675 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.730470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.831082 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.831038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tdf\" (UniqueName: \"kubernetes.io/projected/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-kube-api-access-f5tdf\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.831250 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.831099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.831250 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.831148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.831250 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.831222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.831416 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:46.831315 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 15:36:46.831416 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:46.831379 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls podName:a99d9766-7cb2-45ba-914e-2b4fcf232ff1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:47.33135858 +0000 UTC m=+86.074129522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls") pod "prometheus-operator-64785b6675-gz27t" (UID: "a99d9766-7cb2-45ba-914e-2b4fcf232ff1") : secret "prometheus-operator-tls" not found Jul 15 15:36:46.832004 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.831975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.834147 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.834123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.840663 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.840631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tdf\" (UniqueName: \"kubernetes.io/projected/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-kube-api-access-f5tdf\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:46.927318 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.927275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5747ddc-jv4kp" event={"ID":"b19b6220-7a0f-477d-9b7b-91f15aed718b","Type":"ContainerStarted","Data":"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2"} Jul 15 15:36:46.929591 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.929563 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-268cf" event={"ID":"b27bb4a0-3726-496d-970f-50b4c5ae3842","Type":"ContainerStarted","Data":"e8631f4b3dc5023534a6c19e7231ecd96b61890d9c3af3db92ec8e032db3aa94"} Jul 15 15:36:46.934248 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.934226 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:36:46.943523 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:46.943476 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-w862g" Jul 15 15:36:47.001725 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.001624 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd5747ddc-jv4kp" podStartSLOduration=14.001605133 podStartE2EDuration="14.001605133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:46.972228492 +0000 UTC m=+85.714999442" watchObservedRunningTime="2026-07-15 15:36:47.001605133 +0000 UTC m=+85.744376083" Jul 15 15:36:47.075674 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.075618 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-268cf" podStartSLOduration=67.264234361 podStartE2EDuration="1m23.075595948s" totalImagesPullingTime="15.811361587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:47.072033466 +0000 UTC m=+85.814804417" watchObservedRunningTime="2026-07-15 15:36:47.075595948 +0000 UTC m=+85.818366897" Jul 15 15:36:47.335813 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.335724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:47.338907 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.338872 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99d9766-7cb2-45ba-914e-2b4fcf232ff1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gz27t\" (UID: \"a99d9766-7cb2-45ba-914e-2b4fcf232ff1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:47.596460 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.596415 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" Jul 15 15:36:47.786757 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.786673 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gz27t"] Jul 15 15:36:47.790971 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:47.790934 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99d9766_7cb2_45ba_914e_2b4fcf232ff1.slice/crio-d25d39cb56dd4639adc09071cd778974f5d872447c6e83b28da03295630cd760 WatchSource:0}: Error finding container d25d39cb56dd4639adc09071cd778974f5d872447c6e83b28da03295630cd760: Status 404 returned error can't find the container with id d25d39cb56dd4639adc09071cd778974f5d872447c6e83b28da03295630cd760 Jul 15 15:36:47.935051 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:47.934908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" event={"ID":"a99d9766-7cb2-45ba-914e-2b4fcf232ff1","Type":"ContainerStarted","Data":"d25d39cb56dd4639adc09071cd778974f5d872447c6e83b28da03295630cd760"} Jul 15 15:36:50.951993 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:50.951954 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" event={"ID":"a99d9766-7cb2-45ba-914e-2b4fcf232ff1","Type":"ContainerStarted","Data":"02b66504c3a5a70504be27f71c556cb65ceb7fd374d51dd0be08babfd7dcbd56"} Jul 15 15:36:50.952414 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:50.952023 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" event={"ID":"a99d9766-7cb2-45ba-914e-2b4fcf232ff1","Type":"ContainerStarted","Data":"51b72a6ba5a8c324d10762c2ea64cbe2117d69d5eadb19c7233d6960fb69d091"} Jul 15 15:36:50.971684 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:50.971628 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-gz27t" podStartSLOduration=2.577125536 podStartE2EDuration="4.971607623s" totalImagesPullingTime="2.394482087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:50.970947141 +0000 UTC m=+89.713718092" watchObservedRunningTime="2026-07-15 15:36:50.971607623 +0000 UTC m=+89.714378570" Jul 15 15:36:53.102250 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.102213 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-btqkz"] Jul 15 15:36:53.153085 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.152655 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.156150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.155274 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 15:36:53.156150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.155785 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 15:36:53.156150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.156002 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 15:36:53.156150 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.156131 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf856\"" Jul 15 15:36:53.182469 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-metrics-client-ca\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182649 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-root\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182649 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-wtmp\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182755 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlwpg\" (UniqueName: \"kubernetes.io/projected/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-kube-api-access-zlwpg\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182755 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182726 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-sys\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182754 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-textfile\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182906 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.182906 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.183003 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.182913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-sys\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-textfile\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-metrics-client-ca\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-root\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-wtmp\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284320 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlwpg\" (UniqueName: \"kubernetes.io/projected/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-kube-api-access-zlwpg\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.284727 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-sys\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.285057 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-textfile\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:53.285159 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:36:53.285214 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls podName:b96cf416-09f3-4b87-90ca-306ddc3bc6cd nodeName:}" failed. No retries permitted until 2026-07-15 15:36:53.78519336 +0000 UTC m=+92.527964295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls") pod "node-exporter-btqkz" (UID: "b96cf416-09f3-4b87-90ca-306ddc3bc6cd") : secret "node-exporter-tls" not found Jul 15 15:36:53.286271 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.285930 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.287704 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.287527 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-metrics-client-ca\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.287704 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.287667 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-wtmp\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.287923 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.287896 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-root\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.288724 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.288704 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.318141 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.318101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlwpg\" (UniqueName: \"kubernetes.io/projected/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-kube-api-access-zlwpg\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.797601 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.797554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:53.800104 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:53.800071 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96cf416-09f3-4b87-90ca-306ddc3bc6cd-node-exporter-tls\") pod \"node-exporter-btqkz\" (UID: \"b96cf416-09f3-4b87-90ca-306ddc3bc6cd\") " pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:54.067282 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.067187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btqkz" Jul 15 15:36:54.106669 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:36:54.106635 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96cf416_09f3_4b87_90ca_306ddc3bc6cd.slice/crio-fc1165631c05a9347b72cc4b070a4029ada83f1c58e13e25475acd07407eb418 WatchSource:0}: Error finding container fc1165631c05a9347b72cc4b070a4029ada83f1c58e13e25475acd07407eb418: Status 404 returned error can't find the container with id fc1165631c05a9347b72cc4b070a4029ada83f1c58e13e25475acd07407eb418 Jul 15 15:36:54.213313 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.213270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:54.213490 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.213410 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:54.219055 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.219030 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:54.968717 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.968679 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btqkz" event={"ID":"b96cf416-09f3-4b87-90ca-306ddc3bc6cd","Type":"ContainerStarted","Data":"fc1165631c05a9347b72cc4b070a4029ada83f1c58e13e25475acd07407eb418"} Jul 15 15:36:54.973328 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:54.973292 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:36:55.064246 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:55.064210 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:36:55.973560 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:55.973525 2554 generic.go:356] "Generic (PLEG): container finished" podID="b96cf416-09f3-4b87-90ca-306ddc3bc6cd" containerID="eede416118573ea3a7549597455d58d75f48da0ee89cb15772f4c047aa16c72c" exitCode=0 Jul 15 15:36:55.973913 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:55.973596 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btqkz" event={"ID":"b96cf416-09f3-4b87-90ca-306ddc3bc6cd","Type":"ContainerDied","Data":"eede416118573ea3a7549597455d58d75f48da0ee89cb15772f4c047aa16c72c"} Jul 15 15:36:56.979610 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:56.979574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btqkz" event={"ID":"b96cf416-09f3-4b87-90ca-306ddc3bc6cd","Type":"ContainerStarted","Data":"5f46453202318dec3f08d49f051a8badc5dcd72b09e3d0645301b19141566b08"} Jul 15 15:36:56.979987 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:36:56.979637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btqkz" event={"ID":"b96cf416-09f3-4b87-90ca-306ddc3bc6cd","Type":"ContainerStarted","Data":"24764db51c5a3541622b8859f6e3ff7168d8ccb1b6b5d2d5a1c1087d03ef9777"} Jul 15 15:37:04.886949 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.886890 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-btqkz" podStartSLOduration=10.454107548 podStartE2EDuration="11.886873185s" totalImagesPullingTime="1.34318173s" totalInitContainerRuntime="89.583907ms" isStatefulPod=true podCreationTimestamp="2026-07-15 15:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:57.006972784 +0000 UTC m=+95.749743735" watchObservedRunningTime="2026-07-15 15:37:04.886873185 +0000 UTC m=+103.629644132" Jul 15 15:37:04.887373 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.887086 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:37:04.937817 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.937781 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:37:04.937981 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.937881 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984358 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984529 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984375 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984529 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfc77\" (UniqueName: \"kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984529 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984529 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984525 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984689 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984541 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:04.984689 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:04.984568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.085792 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.085792 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfc77\" (UniqueName: \"kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.085997 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.085997 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.085997 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.086152 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.085996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.086215 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.086189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.086496 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.086464 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.086640 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.086613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.086731 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.086711 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.087003 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.086982 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.088432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.088414 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.088485 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.088462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.094644 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.094619 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfc77\" (UniqueName: \"kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77\") pod \"console-868c8c64b9-97cs4\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.247190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.247105 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:05.401665 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:05.401632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:37:05.404187 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:37:05.404165 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7703bc4d_e248_4196_93f3_63f0952aea73.slice/crio-7472159699d646bbc9192b4bb69091db3a12fe3ec793dce7059090fc6d99a666 WatchSource:0}: Error finding container 7472159699d646bbc9192b4bb69091db3a12fe3ec793dce7059090fc6d99a666: Status 404 returned error can't find the container with id 7472159699d646bbc9192b4bb69091db3a12fe3ec793dce7059090fc6d99a666 Jul 15 15:37:06.013743 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:06.013707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c8c64b9-97cs4" event={"ID":"7703bc4d-e248-4196-93f3-63f0952aea73","Type":"ContainerStarted","Data":"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3"} Jul 15 15:37:06.014094 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:06.013752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c8c64b9-97cs4" event={"ID":"7703bc4d-e248-4196-93f3-63f0952aea73","Type":"ContainerStarted","Data":"7472159699d646bbc9192b4bb69091db3a12fe3ec793dce7059090fc6d99a666"} Jul 15 15:37:06.035981 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:06.035933 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868c8c64b9-97cs4" podStartSLOduration=2.035916843 podStartE2EDuration="2.035916843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:06.035650858 +0000 UTC m=+104.778421806" watchObservedRunningTime="2026-07-15 15:37:06.035916843 +0000 UTC m=+104.778687794" Jul 15 15:37:15.247461 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:15.247410 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:15.248051 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:15.247493 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:15.252039 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:15.252018 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:16.050357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:16.050328 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:37:16.100413 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:16.100380 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:37:16.932755 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:16.932722 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f99qw" Jul 15 15:37:20.083737 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.083671 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ffc9c9699-g2wtg" podUID="3d683df2-f062-48f6-9e6c-4eec50f1a374" containerName="console" containerID="cri-o://3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758" gracePeriod=15 Jul 15 15:37:20.346419 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.346395 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:37:20.514424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514387 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514440 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514461 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514516 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw925\" (UniqueName: \"kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514534 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514579 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config\") pod \"3d683df2-f062-48f6-9e6c-4eec50f1a374\" (UID: \"3d683df2-f062-48f6-9e6c-4eec50f1a374\") " Jul 15 15:37:20.514920 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514892 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:20.514981 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514900 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:20.514981 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.514938 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config" (OuterVolumeSpecName: "console-config") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:20.516888 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.516851 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:37:20.516994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.516889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:37:20.516994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.516950 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925" (OuterVolumeSpecName: "kube-api-access-bw925") pod "3d683df2-f062-48f6-9e6c-4eec50f1a374" (UID: "3d683df2-f062-48f6-9e6c-4eec50f1a374"). InnerVolumeSpecName "kube-api-access-bw925". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:37:20.615236 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615153 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-oauth-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:20.615236 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615187 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:20.615236 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615203 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-oauth-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:20.615236 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615216 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw925\" (UniqueName: \"kubernetes.io/projected/3d683df2-f062-48f6-9e6c-4eec50f1a374-kube-api-access-bw925\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:20.615236 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615230 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:20.615541 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:20.615241 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d683df2-f062-48f6-9e6c-4eec50f1a374-console-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:21.064444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.064367 2554 generic.go:356] "Generic (PLEG): container finished" podID="3d683df2-f062-48f6-9e6c-4eec50f1a374" containerID="3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758" exitCode=0 Jul 15 15:37:21.064444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.064418 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc9c9699-g2wtg" Jul 15 15:37:21.064444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.064435 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc9c9699-g2wtg" event={"ID":"3d683df2-f062-48f6-9e6c-4eec50f1a374","Type":"ContainerDied","Data":"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758"} Jul 15 15:37:21.064734 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.064479 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc9c9699-g2wtg" event={"ID":"3d683df2-f062-48f6-9e6c-4eec50f1a374","Type":"ContainerDied","Data":"b1a080e55885ba8d315a284e7397243dfe306faf39b3e4601848e9df44b0ef0a"} Jul 15 15:37:21.064734 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.064498 2554 scope.go:117] "RemoveContainer" containerID="3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758" Jul 15 15:37:21.073005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.072986 2554 scope.go:117] "RemoveContainer" containerID="3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758" Jul 15 15:37:21.073271 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:37:21.073250 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758\": container with ID starting with 3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758 not found: ID does not exist" containerID="3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758" Jul 15 15:37:21.073325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.073280 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758"} err="failed to get container status \"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758\": rpc error: code = NotFound desc = could not find container \"3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758\": container with ID starting with 3d3bf5eb708fb8b37a2b026ef2b5cf9352007519d3ace5700dbbdfd59d39e758 not found: ID does not exist" Jul 15 15:37:21.091865 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.091834 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:37:21.094639 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.094614 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ffc9c9699-g2wtg"] Jul 15 15:37:21.536477 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:21.536442 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d683df2-f062-48f6-9e6c-4eec50f1a374" path="/var/lib/kubelet/pods/3d683df2-f062-48f6-9e6c-4eec50f1a374/volumes" Jul 15 15:37:41.125656 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.125617 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dd5747ddc-jv4kp" podUID="b19b6220-7a0f-477d-9b7b-91f15aed718b" containerName="console" containerID="cri-o://8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2" gracePeriod=15 Jul 15 15:37:41.358561 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.358540 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:37:41.374047 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374030 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374112 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374059 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374112 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374090 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374112 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374106 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374291 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374134 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374291 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqnkj\" (UniqueName: \"kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374291 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374227 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config\") pod \"b19b6220-7a0f-477d-9b7b-91f15aed718b\" (UID: \"b19b6220-7a0f-477d-9b7b-91f15aed718b\") " Jul 15 15:37:41.374431 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374380 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:41.374575 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374549 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:41.374630 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374612 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:41.374678 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.374630 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config" (OuterVolumeSpecName: "console-config") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:37:41.376136 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.376090 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:37:41.376244 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.376223 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:37:41.376282 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.376259 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj" (OuterVolumeSpecName: "kube-api-access-gqnkj") pod "b19b6220-7a0f-477d-9b7b-91f15aed718b" (UID: "b19b6220-7a0f-477d-9b7b-91f15aed718b"). InnerVolumeSpecName "kube-api-access-gqnkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:37:41.474710 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474671 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474710 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474703 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-trusted-ca-bundle\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474710 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474714 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474710 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474723 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqnkj\" (UniqueName: \"kubernetes.io/projected/b19b6220-7a0f-477d-9b7b-91f15aed718b-kube-api-access-gqnkj\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474966 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474732 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-oauth-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474966 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474740 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b19b6220-7a0f-477d-9b7b-91f15aed718b-oauth-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:41.474966 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:41.474748 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b19b6220-7a0f-477d-9b7b-91f15aed718b-console-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:37:42.137924 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.137893 2554 generic.go:356] "Generic (PLEG): container finished" podID="b19b6220-7a0f-477d-9b7b-91f15aed718b" containerID="8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2" exitCode=0 Jul 15 15:37:42.138394 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.137945 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5747ddc-jv4kp" Jul 15 15:37:42.138394 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.137982 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5747ddc-jv4kp" event={"ID":"b19b6220-7a0f-477d-9b7b-91f15aed718b","Type":"ContainerDied","Data":"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2"} Jul 15 15:37:42.138394 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.138034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5747ddc-jv4kp" event={"ID":"b19b6220-7a0f-477d-9b7b-91f15aed718b","Type":"ContainerDied","Data":"4be713f0674ba607f92f373a3b88c3059db3d374b926755369aa6913a7ea7623"} Jul 15 15:37:42.138394 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.138055 2554 scope.go:117] "RemoveContainer" containerID="8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2" Jul 15 15:37:42.145594 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.145568 2554 scope.go:117] "RemoveContainer" containerID="8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2" Jul 15 15:37:42.145848 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:37:42.145830 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2\": container with ID starting with 8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2 not found: ID does not exist" containerID="8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2" Jul 15 15:37:42.145909 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.145856 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2"} err="failed to get container status \"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2\": rpc error: code = NotFound desc = could not find container \"8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2\": container with ID starting with 8e77854b3c9eab294fe32e81556e3fc9286fb24a930a0ae3648f656377f6c7b2 not found: ID does not exist" Jul 15 15:37:42.158429 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.156403 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:37:42.160434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:42.160404 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd5747ddc-jv4kp"] Jul 15 15:37:43.536110 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:37:43.536079 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19b6220-7a0f-477d-9b7b-91f15aed718b" path="/var/lib/kubelet/pods/b19b6220-7a0f-477d-9b7b-91f15aed718b/volumes" Jul 15 15:38:28.887497 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:28.887468 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:38:53.906991 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:53.906934 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-868c8c64b9-97cs4" podUID="7703bc4d-e248-4196-93f3-63f0952aea73" containerName="console" containerID="cri-o://74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3" gracePeriod=15 Jul 15 15:38:54.145757 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.145736 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:38:54.289595 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289496 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289595 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289562 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289595 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289586 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289856 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289608 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289856 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289640 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289856 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289671 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfc77\" (UniqueName: \"kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.289856 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289734 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca\") pod \"7703bc4d-e248-4196-93f3-63f0952aea73\" (UID: \"7703bc4d-e248-4196-93f3-63f0952aea73\") " Jul 15 15:38:54.290057 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.289873 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:38:54.290057 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290000 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config" (OuterVolumeSpecName: "console-config") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:38:54.290154 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290116 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:38:54.290211 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290192 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca" (OuterVolumeSpecName: "service-ca") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:38:54.290293 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290274 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-trusted-ca-bundle\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.290334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290298 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-console-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.290334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290307 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.290334 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.290315 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7703bc4d-e248-4196-93f3-63f0952aea73-oauth-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.291697 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.291666 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:38:54.292066 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.292043 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:38:54.292135 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.292061 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77" (OuterVolumeSpecName: "kube-api-access-dfc77") pod "7703bc4d-e248-4196-93f3-63f0952aea73" (UID: "7703bc4d-e248-4196-93f3-63f0952aea73"). InnerVolumeSpecName "kube-api-access-dfc77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:38:54.376005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.375970 2554 generic.go:356] "Generic (PLEG): container finished" podID="7703bc4d-e248-4196-93f3-63f0952aea73" containerID="74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3" exitCode=0 Jul 15 15:38:54.376005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.376009 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868c8c64b9-97cs4" Jul 15 15:38:54.376253 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.376022 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c8c64b9-97cs4" event={"ID":"7703bc4d-e248-4196-93f3-63f0952aea73","Type":"ContainerDied","Data":"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3"} Jul 15 15:38:54.376253 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.376070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868c8c64b9-97cs4" event={"ID":"7703bc4d-e248-4196-93f3-63f0952aea73","Type":"ContainerDied","Data":"7472159699d646bbc9192b4bb69091db3a12fe3ec793dce7059090fc6d99a666"} Jul 15 15:38:54.376253 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.376096 2554 scope.go:117] "RemoveContainer" containerID="74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3" Jul 15 15:38:54.384665 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.384646 2554 scope.go:117] "RemoveContainer" containerID="74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3" Jul 15 15:38:54.384908 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:38:54.384890 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3\": container with ID starting with 74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3 not found: ID does not exist" containerID="74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3" Jul 15 15:38:54.384962 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.384916 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3"} err="failed to get container status \"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3\": rpc error: code = NotFound desc = could not find container \"74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3\": container with ID starting with 74dfb648beed292b72e83b73455eae7f4a7dc9cccf97ad50637b89bd73240cb3 not found: ID does not exist" Jul 15 15:38:54.390787 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.390768 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-serving-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.390787 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.390786 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfc77\" (UniqueName: \"kubernetes.io/projected/7703bc4d-e248-4196-93f3-63f0952aea73-kube-api-access-dfc77\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.390899 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.390796 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7703bc4d-e248-4196-93f3-63f0952aea73-console-oauth-config\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:38:54.398220 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.398196 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:38:54.400582 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:54.400561 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868c8c64b9-97cs4"] Jul 15 15:38:55.536457 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:38:55.536424 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7703bc4d-e248-4196-93f3-63f0952aea73" path="/var/lib/kubelet/pods/7703bc4d-e248-4196-93f3-63f0952aea73/volumes" Jul 15 15:39:41.312559 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312522 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln"] Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312854 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7703bc4d-e248-4196-93f3-63f0952aea73" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312870 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7703bc4d-e248-4196-93f3-63f0952aea73" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312886 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d683df2-f062-48f6-9e6c-4eec50f1a374" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312895 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d683df2-f062-48f6-9e6c-4eec50f1a374" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312903 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19b6220-7a0f-477d-9b7b-91f15aed718b" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312911 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19b6220-7a0f-477d-9b7b-91f15aed718b" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312981 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d683df2-f062-48f6-9e6c-4eec50f1a374" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.312995 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b19b6220-7a0f-477d-9b7b-91f15aed718b" containerName="console" Jul 15 15:39:41.313121 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.313002 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7703bc4d-e248-4196-93f3-63f0952aea73" containerName="console" Jul 15 15:39:41.315672 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.315651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.318514 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.318486 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kgncn\"" Jul 15 15:39:41.318938 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.318923 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:39:41.319027 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.318961 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 15:39:41.337656 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.337632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln"] Jul 15 15:39:41.396602 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.396563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krknk\" (UniqueName: \"kubernetes.io/projected/bb7966e9-7fe7-404d-bb49-437100476ad2-kube-api-access-krknk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.396762 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.396625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb7966e9-7fe7-404d-bb49-437100476ad2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.497379 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.497350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krknk\" (UniqueName: \"kubernetes.io/projected/bb7966e9-7fe7-404d-bb49-437100476ad2-kube-api-access-krknk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.497473 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.497389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb7966e9-7fe7-404d-bb49-437100476ad2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.497807 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.497788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb7966e9-7fe7-404d-bb49-437100476ad2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.506311 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.506286 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krknk\" (UniqueName: \"kubernetes.io/projected/bb7966e9-7fe7-404d-bb49-437100476ad2-kube-api-access-krknk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5tnln\" (UID: \"bb7966e9-7fe7-404d-bb49-437100476ad2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.623954 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.623929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" Jul 15 15:39:41.757202 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:41.757178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln"] Jul 15 15:39:41.759807 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:39:41.759774 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7966e9_7fe7_404d_bb49_437100476ad2.slice/crio-3293810387f47634934845ed60e2f97f90894a0146daf09810119ca0bcbc17c8 WatchSource:0}: Error finding container 3293810387f47634934845ed60e2f97f90894a0146daf09810119ca0bcbc17c8: Status 404 returned error can't find the container with id 3293810387f47634934845ed60e2f97f90894a0146daf09810119ca0bcbc17c8 Jul 15 15:39:42.528849 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:42.528812 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" event={"ID":"bb7966e9-7fe7-404d-bb49-437100476ad2","Type":"ContainerStarted","Data":"3293810387f47634934845ed60e2f97f90894a0146daf09810119ca0bcbc17c8"} Jul 15 15:39:44.538376 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:44.538283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" event={"ID":"bb7966e9-7fe7-404d-bb49-437100476ad2","Type":"ContainerStarted","Data":"c77a082a9d49bb295c9a6f61fa5260cbe078cd3c471fbdfd6775c274660d75f5"} Jul 15 15:39:44.566896 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:44.566841 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5tnln" podStartSLOduration=1.177497463 podStartE2EDuration="3.566822535s" totalImagesPullingTime="2.389325072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:39:44.566192452 +0000 UTC m=+263.308963401" watchObservedRunningTime="2026-07-15 15:39:44.566822535 +0000 UTC m=+263.309593482" Jul 15 15:39:50.372944 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.372911 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx"] Jul 15 15:39:50.375347 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.375330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.378103 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.378078 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 15:39:50.378232 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.378159 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n52lc\"" Jul 15 15:39:50.378232 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.378159 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 15:39:50.386392 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.386371 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx"] Jul 15 15:39:50.450247 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.450220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.450374 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.450251 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwtp7\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-kube-api-access-pwtp7\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.550650 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.550619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.550650 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.550652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwtp7\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-kube-api-access-pwtp7\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.562377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.562348 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwtp7\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-kube-api-access-pwtp7\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.566980 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.566959 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a0dd569-7850-437e-8903-b73441ca9a4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pcxkx\" (UID: \"8a0dd569-7850-437e-8903-b73441ca9a4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.684154 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.684088 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" Jul 15 15:39:50.811427 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:50.811394 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx"] Jul 15 15:39:50.814486 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:39:50.814458 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a0dd569_7850_437e_8903_b73441ca9a4f.slice/crio-b03d3a83dcbf4f656d676ee122e9ccb23f6f2c2ca5a7020099336305ea47c3b8 WatchSource:0}: Error finding container b03d3a83dcbf4f656d676ee122e9ccb23f6f2c2ca5a7020099336305ea47c3b8: Status 404 returned error can't find the container with id b03d3a83dcbf4f656d676ee122e9ccb23f6f2c2ca5a7020099336305ea47c3b8 Jul 15 15:39:51.561918 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:51.561882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" event={"ID":"8a0dd569-7850-437e-8903-b73441ca9a4f","Type":"ContainerStarted","Data":"b03d3a83dcbf4f656d676ee122e9ccb23f6f2c2ca5a7020099336305ea47c3b8"} Jul 15 15:39:53.571420 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:53.571390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" event={"ID":"8a0dd569-7850-437e-8903-b73441ca9a4f","Type":"ContainerStarted","Data":"1f29acd751a68267e8396fcfe8080c6e2140fd1b329f9bdb0c8c5903a7c21dbe"} Jul 15 15:39:53.591065 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:53.591022 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pcxkx" podStartSLOduration=1.052703464 podStartE2EDuration="3.591006927s" totalImagesPullingTime="2.538303463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:39:53.590632251 +0000 UTC m=+272.333403197" watchObservedRunningTime="2026-07-15 15:39:53.591006927 +0000 UTC m=+272.333777874" Jul 15 15:39:59.992587 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:59.992553 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p"] Jul 15 15:39:59.994708 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:59.994692 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:39:59.997599 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:59.997578 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 15:39:59.998754 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:59.998735 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:39:59.998845 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:39:59.998735 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g6g4c\"" Jul 15 15:40:00.007447 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.007424 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p"] Jul 15 15:40:00.013649 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.013629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qbq\" (UniqueName: \"kubernetes.io/projected/bbf8460f-4d2e-4e32-9113-c80be261f27d-kube-api-access-64qbq\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.013716 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.013676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf8460f-4d2e-4e32-9113-c80be261f27d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.114918 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.114880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf8460f-4d2e-4e32-9113-c80be261f27d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.115050 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.114938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qbq\" (UniqueName: \"kubernetes.io/projected/bbf8460f-4d2e-4e32-9113-c80be261f27d-kube-api-access-64qbq\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.115234 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.115215 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf8460f-4d2e-4e32-9113-c80be261f27d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.124178 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.124158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qbq\" (UniqueName: \"kubernetes.io/projected/bbf8460f-4d2e-4e32-9113-c80be261f27d-kube-api-access-64qbq\") pod \"openshift-lws-operator-fd8ccff4c-xwx8p\" (UID: \"bbf8460f-4d2e-4e32-9113-c80be261f27d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.303108 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.303011 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" Jul 15 15:40:00.423422 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.423399 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p"] Jul 15 15:40:00.425891 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:40:00.425862 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbf8460f_4d2e_4e32_9113_c80be261f27d.slice/crio-04dcec5cf5e7ae12b919f8275d5665665924e9dbfa5f662f7e2350851635cff3 WatchSource:0}: Error finding container 04dcec5cf5e7ae12b919f8275d5665665924e9dbfa5f662f7e2350851635cff3: Status 404 returned error can't find the container with id 04dcec5cf5e7ae12b919f8275d5665665924e9dbfa5f662f7e2350851635cff3 Jul 15 15:40:00.595671 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:00.595637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" event={"ID":"bbf8460f-4d2e-4e32-9113-c80be261f27d","Type":"ContainerStarted","Data":"04dcec5cf5e7ae12b919f8275d5665665924e9dbfa5f662f7e2350851635cff3"} Jul 15 15:40:03.609763 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:03.609727 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" event={"ID":"bbf8460f-4d2e-4e32-9113-c80be261f27d","Type":"ContainerStarted","Data":"b539b009738dbd4ae36d31c70fc64304ccfd8beeb8a58fba05acdfc4d7f4a986"} Jul 15 15:40:03.629631 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:03.629455 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xwx8p" podStartSLOduration=1.948111442 podStartE2EDuration="4.629437982s" totalImagesPullingTime="2.68132654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:03.627249476 +0000 UTC m=+282.370020424" watchObservedRunningTime="2026-07-15 15:40:03.629437982 +0000 UTC m=+282.372208930" Jul 15 15:40:22.302248 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.302217 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw"] Jul 15 15:40:22.307597 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.307580 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.310252 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.310231 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 15:40:22.310678 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.310660 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkffr\"" Jul 15 15:40:22.310825 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.310806 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 15:40:22.310900 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.310834 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 15:40:22.311606 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.311589 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 15:40:22.329540 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.329516 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw"] Jul 15 15:40:22.380252 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.380220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.380424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.380260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.380424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.380284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.380424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.380357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdfh\" (UniqueName: \"kubernetes.io/projected/ede0e428-7924-4af7-abcf-47622e406231-kube-api-access-5rdfh\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.380424 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.380409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.480993 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.480954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.481199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.481014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.481199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.481062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.481199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.481084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.481199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.481130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdfh\" (UniqueName: \"kubernetes.io/projected/ede0e428-7924-4af7-abcf-47622e406231-kube-api-access-5rdfh\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.481527 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.481470 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.483382 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.483352 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ede0e428-7924-4af7-abcf-47622e406231-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.483477 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.483434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.483540 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.483513 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ede0e428-7924-4af7-abcf-47622e406231-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.498735 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.498710 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdfh\" (UniqueName: \"kubernetes.io/projected/ede0e428-7924-4af7-abcf-47622e406231-kube-api-access-5rdfh\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw\" (UID: \"ede0e428-7924-4af7-abcf-47622e406231\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.617193 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.617162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:22.756451 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:22.756428 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw"] Jul 15 15:40:22.758963 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:40:22.758936 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede0e428_7924_4af7_abcf_47622e406231.slice/crio-21dc0272df41fb4145d5edf46a35b3881ecb1000278c79de065494a104cb440b WatchSource:0}: Error finding container 21dc0272df41fb4145d5edf46a35b3881ecb1000278c79de065494a104cb440b: Status 404 returned error can't find the container with id 21dc0272df41fb4145d5edf46a35b3881ecb1000278c79de065494a104cb440b Jul 15 15:40:23.359428 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:23.359391 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 15:40:23.680927 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:23.680849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" event={"ID":"ede0e428-7924-4af7-abcf-47622e406231","Type":"ContainerStarted","Data":"21dc0272df41fb4145d5edf46a35b3881ecb1000278c79de065494a104cb440b"} Jul 15 15:40:26.695823 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:26.695784 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" event={"ID":"ede0e428-7924-4af7-abcf-47622e406231","Type":"ContainerStarted","Data":"eea95506b2801957b26bd5a42351031b5f22054c56144aaad73f64767b14be22"} Jul 15 15:40:27.701242 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:27.701207 2554 generic.go:356] "Generic (PLEG): container finished" podID="ede0e428-7924-4af7-abcf-47622e406231" containerID="eea95506b2801957b26bd5a42351031b5f22054c56144aaad73f64767b14be22" exitCode=0 Jul 15 15:40:27.701637 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:27.701255 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" event={"ID":"ede0e428-7924-4af7-abcf-47622e406231","Type":"ContainerDied","Data":"eea95506b2801957b26bd5a42351031b5f22054c56144aaad73f64767b14be22"} Jul 15 15:40:27.701802 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:27.701784 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 15:40:28.707485 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:28.707440 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" event={"ID":"ede0e428-7924-4af7-abcf-47622e406231","Type":"ContainerStarted","Data":"b54f93815f4cae50cba4d637ea11f8e7320b0a6c51a0d0a512821a8061ae2e69"} Jul 15 15:40:28.707904 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:28.707557 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:28.793025 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:28.792970 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" podStartSLOduration=2.099798426 podStartE2EDuration="6.792955003s" totalImagesPullingTime="3.657052229s" totalInitContainerRuntime="1.036104348s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:28.788343647 +0000 UTC m=+307.531114594" watchObservedRunningTime="2026-07-15 15:40:28.792955003 +0000 UTC m=+307.535725949" Jul 15 15:40:39.713837 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:39.713804 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw" Jul 15 15:40:42.443172 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.443136 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs"] Jul 15 15:40:42.450890 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.450869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.453769 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.453749 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qn2m8\"" Jul 15 15:40:42.455243 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.455218 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 15:40:42.455492 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.455438 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 15:40:42.456087 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.456066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 15:40:42.460312 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.460290 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 15:40:42.471267 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.471244 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs"] Jul 15 15:40:42.535551 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.535494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/837df392-990b-4b05-9ce4-b3cd8b0346ce-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.535689 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.535591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wn28\" (UniqueName: \"kubernetes.io/projected/837df392-990b-4b05-9ce4-b3cd8b0346ce-kube-api-access-2wn28\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.535689 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.535612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/837df392-990b-4b05-9ce4-b3cd8b0346ce-tmp\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.636787 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.636751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/837df392-990b-4b05-9ce4-b3cd8b0346ce-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.636958 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.636815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wn28\" (UniqueName: \"kubernetes.io/projected/837df392-990b-4b05-9ce4-b3cd8b0346ce-kube-api-access-2wn28\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.636958 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.636928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/837df392-990b-4b05-9ce4-b3cd8b0346ce-tmp\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.639234 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.639210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/837df392-990b-4b05-9ce4-b3cd8b0346ce-tmp\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.639575 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.639553 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/837df392-990b-4b05-9ce4-b3cd8b0346ce-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.650419 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.650392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wn28\" (UniqueName: \"kubernetes.io/projected/837df392-990b-4b05-9ce4-b3cd8b0346ce-kube-api-access-2wn28\") pod \"kube-auth-proxy-7cbcc54d95-cpxcs\" (UID: \"837df392-990b-4b05-9ce4-b3cd8b0346ce\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.765387 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.765291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" Jul 15 15:40:42.931813 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:42.931779 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs"] Jul 15 15:40:42.936493 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:40:42.936455 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837df392_990b_4b05_9ce4_b3cd8b0346ce.slice/crio-bb44afbff49f6bcd1e329d7006b09193fbc7c4970d5d0d049a60a386d2f78a2b WatchSource:0}: Error finding container bb44afbff49f6bcd1e329d7006b09193fbc7c4970d5d0d049a60a386d2f78a2b: Status 404 returned error can't find the container with id bb44afbff49f6bcd1e329d7006b09193fbc7c4970d5d0d049a60a386d2f78a2b Jul 15 15:40:43.767676 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:43.767614 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" event={"ID":"837df392-990b-4b05-9ce4-b3cd8b0346ce","Type":"ContainerStarted","Data":"bb44afbff49f6bcd1e329d7006b09193fbc7c4970d5d0d049a60a386d2f78a2b"} Jul 15 15:40:46.781575 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:46.781541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" event={"ID":"837df392-990b-4b05-9ce4-b3cd8b0346ce","Type":"ContainerStarted","Data":"e6ea35cb6a8593378ea3f1c839ffe1e1b94464ab9807556d3850f55b572d841c"} Jul 15 15:40:46.800317 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:46.800264 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-cpxcs" podStartSLOduration=1.991373023 podStartE2EDuration="4.800247918s" totalImagesPullingTime="2.808874895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:46.798916385 +0000 UTC m=+325.541687335" watchObservedRunningTime="2026-07-15 15:40:46.800247918 +0000 UTC m=+325.543018878" Jul 15 15:40:50.330932 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.330895 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg"] Jul 15 15:40:50.333301 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.333281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.337215 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.337193 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 15:40:50.337542 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.337519 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 15:40:50.337617 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.337552 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 15:40:50.337668 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.337550 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6nnmz\"" Jul 15 15:40:50.338282 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.338267 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 15:40:50.349182 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.349155 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg"] Jul 15 15:40:50.497839 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.497802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcp7f\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-kube-api-access-pcp7f\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.497839 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.497845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.498033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.497911 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.498033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.497956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5501b416-1b31-4d2a-95b7-48a2caee17fc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.498033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.497980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.498033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.498009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.498033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.498024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599234 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5501b416-1b31-4d2a-95b7-48a2caee17fc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599295 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcp7f\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-kube-api-access-pcp7f\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599377 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.599633 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.599411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.600033 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.600004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.601732 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.601699 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5501b416-1b31-4d2a-95b7-48a2caee17fc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.601855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.601834 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.601918 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.601843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.601918 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.601882 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.612646 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.612623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcp7f\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-kube-api-access-pcp7f\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.612724 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.612660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5501b416-1b31-4d2a-95b7-48a2caee17fc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ksmpg\" (UID: \"5501b416-1b31-4d2a-95b7-48a2caee17fc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.644765 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.644734 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:50.780841 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.780812 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg"] Jul 15 15:40:50.783169 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:40:50.783144 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5501b416_1b31_4d2a_95b7_48a2caee17fc.slice/crio-a4eb8a5e79ad2fb78b588e422e523bfccbd646ad8dc3cfc91a6ff67f29090d1e WatchSource:0}: Error finding container a4eb8a5e79ad2fb78b588e422e523bfccbd646ad8dc3cfc91a6ff67f29090d1e: Status 404 returned error can't find the container with id a4eb8a5e79ad2fb78b588e422e523bfccbd646ad8dc3cfc91a6ff67f29090d1e Jul 15 15:40:50.799143 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:50.799108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" event={"ID":"5501b416-1b31-4d2a-95b7-48a2caee17fc","Type":"ContainerStarted","Data":"a4eb8a5e79ad2fb78b588e422e523bfccbd646ad8dc3cfc91a6ff67f29090d1e"} Jul 15 15:40:53.168977 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:53.168928 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:40:53.169273 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:53.169012 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:40:53.814735 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:53.814696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" event={"ID":"5501b416-1b31-4d2a-95b7-48a2caee17fc","Type":"ContainerStarted","Data":"d0019551904fdea64ae2f3718f6eb9d07905b41c11f2bdacfb1a98e2b58e2bdc"} Jul 15 15:40:53.814915 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:53.814818 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:40:53.881189 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:53.881140 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" podStartSLOduration=1.497545973 podStartE2EDuration="3.881123326s" totalImagesPullingTime="2.383577353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:53.878185773 +0000 UTC m=+332.620956720" watchObservedRunningTime="2026-07-15 15:40:53.881123326 +0000 UTC m=+332.623894274" Jul 15 15:40:54.825003 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:40:54.824970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ksmpg" Jul 15 15:41:43.579349 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.579313 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:43.586841 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.586816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:43.589991 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.589964 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 15:41:43.589991 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.589979 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ksc2q\"" Jul 15 15:41:43.591296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.591277 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 15:41:43.594264 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.594237 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:43.693378 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.693343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcz62\" (UniqueName: \"kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62\") pod \"kuadrant-operator-catalog-rrrtd\" (UID: \"b83c7fdb-87b6-491e-9074-81d42d144965\") " pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:43.794432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.794399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcz62\" (UniqueName: \"kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62\") pod \"kuadrant-operator-catalog-rrrtd\" (UID: \"b83c7fdb-87b6-491e-9074-81d42d144965\") " pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:43.804688 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.804662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcz62\" (UniqueName: \"kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62\") pod \"kuadrant-operator-catalog-rrrtd\" (UID: \"b83c7fdb-87b6-491e-9074-81d42d144965\") " pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:43.897953 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.897910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:43.930516 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:43.930478 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:44.032923 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.032894 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:44.036080 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:41:44.036051 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83c7fdb_87b6_491e_9074_81d42d144965.slice/crio-70e76870bdf03cfb8aef901787d754a3a3594fe06292a385d98b997d0a3ae2f0 WatchSource:0}: Error finding container 70e76870bdf03cfb8aef901787d754a3a3594fe06292a385d98b997d0a3ae2f0: Status 404 returned error can't find the container with id 70e76870bdf03cfb8aef901787d754a3a3594fe06292a385d98b997d0a3ae2f0 Jul 15 15:41:44.142583 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.142547 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4z2b"] Jul 15 15:41:44.145708 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.145690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:44.154475 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.154450 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4z2b"] Jul 15 15:41:44.198367 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.198338 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nl7l\" (UniqueName: \"kubernetes.io/projected/feaf2a57-aeea-4ec4-9699-7fb3c52a4075-kube-api-access-7nl7l\") pod \"kuadrant-operator-catalog-w4z2b\" (UID: \"feaf2a57-aeea-4ec4-9699-7fb3c52a4075\") " pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:44.299643 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.299596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nl7l\" (UniqueName: \"kubernetes.io/projected/feaf2a57-aeea-4ec4-9699-7fb3c52a4075-kube-api-access-7nl7l\") pod \"kuadrant-operator-catalog-w4z2b\" (UID: \"feaf2a57-aeea-4ec4-9699-7fb3c52a4075\") " pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:44.308600 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.308568 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nl7l\" (UniqueName: \"kubernetes.io/projected/feaf2a57-aeea-4ec4-9699-7fb3c52a4075-kube-api-access-7nl7l\") pod \"kuadrant-operator-catalog-w4z2b\" (UID: \"feaf2a57-aeea-4ec4-9699-7fb3c52a4075\") " pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:44.455259 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.455169 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:44.580205 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:44.580172 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4z2b"] Jul 15 15:41:44.583443 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:41:44.583418 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeaf2a57_aeea_4ec4_9699_7fb3c52a4075.slice/crio-35d44a4830c55c5daf38f31264d3db16f75199d18a9cd781e669b3e3a2837c81 WatchSource:0}: Error finding container 35d44a4830c55c5daf38f31264d3db16f75199d18a9cd781e669b3e3a2837c81: Status 404 returned error can't find the container with id 35d44a4830c55c5daf38f31264d3db16f75199d18a9cd781e669b3e3a2837c81 Jul 15 15:41:45.018627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:45.018589 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" event={"ID":"b83c7fdb-87b6-491e-9074-81d42d144965","Type":"ContainerStarted","Data":"70e76870bdf03cfb8aef901787d754a3a3594fe06292a385d98b997d0a3ae2f0"} Jul 15 15:41:45.019834 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:45.019796 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" event={"ID":"feaf2a57-aeea-4ec4-9699-7fb3c52a4075","Type":"ContainerStarted","Data":"35d44a4830c55c5daf38f31264d3db16f75199d18a9cd781e669b3e3a2837c81"} Jul 15 15:41:47.029634 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.029599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" event={"ID":"b83c7fdb-87b6-491e-9074-81d42d144965","Type":"ContainerStarted","Data":"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc"} Jul 15 15:41:47.030084 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.029664 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" podUID="b83c7fdb-87b6-491e-9074-81d42d144965" containerName="registry-server" containerID="cri-o://dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc" gracePeriod=2 Jul 15 15:41:47.031127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.031105 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" event={"ID":"feaf2a57-aeea-4ec4-9699-7fb3c52a4075","Type":"ContainerStarted","Data":"a6b4b779341bd41b35099d0bfa33a1c77795299a073fe6730c963d6209b42e38"} Jul 15 15:41:47.052481 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.052438 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" podStartSLOduration=1.740091899 podStartE2EDuration="4.052423597s" totalImagesPullingTime="2.312331698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:41:47.050111474 +0000 UTC m=+385.792882423" watchObservedRunningTime="2026-07-15 15:41:47.052423597 +0000 UTC m=+385.795194545" Jul 15 15:41:47.069725 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.069683 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" podStartSLOduration=1.3080988150000001 podStartE2EDuration="3.069666922s" totalImagesPullingTime="1.761568107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:41:47.068617573 +0000 UTC m=+385.811388521" watchObservedRunningTime="2026-07-15 15:41:47.069666922 +0000 UTC m=+385.812437870" Jul 15 15:41:47.260984 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.260963 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:47.325246 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.325175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcz62\" (UniqueName: \"kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62\") pod \"b83c7fdb-87b6-491e-9074-81d42d144965\" (UID: \"b83c7fdb-87b6-491e-9074-81d42d144965\") " Jul 15 15:41:47.327215 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.327184 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62" (OuterVolumeSpecName: "kube-api-access-lcz62") pod "b83c7fdb-87b6-491e-9074-81d42d144965" (UID: "b83c7fdb-87b6-491e-9074-81d42d144965"). InnerVolumeSpecName "kube-api-access-lcz62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:41:47.425721 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:47.425684 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcz62\" (UniqueName: \"kubernetes.io/projected/b83c7fdb-87b6-491e-9074-81d42d144965-kube-api-access-lcz62\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:41:48.040998 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.040959 2554 generic.go:356] "Generic (PLEG): container finished" podID="b83c7fdb-87b6-491e-9074-81d42d144965" containerID="dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc" exitCode=0 Jul 15 15:41:48.041395 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.041016 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" Jul 15 15:41:48.041395 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.041041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" event={"ID":"b83c7fdb-87b6-491e-9074-81d42d144965","Type":"ContainerDied","Data":"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc"} Jul 15 15:41:48.041395 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.041123 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rrrtd" event={"ID":"b83c7fdb-87b6-491e-9074-81d42d144965","Type":"ContainerDied","Data":"70e76870bdf03cfb8aef901787d754a3a3594fe06292a385d98b997d0a3ae2f0"} Jul 15 15:41:48.041395 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.041150 2554 scope.go:117] "RemoveContainer" containerID="dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc" Jul 15 15:41:48.049366 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.049348 2554 scope.go:117] "RemoveContainer" containerID="dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc" Jul 15 15:41:48.049627 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:41:48.049609 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc\": container with ID starting with dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc not found: ID does not exist" containerID="dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc" Jul 15 15:41:48.049678 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.049635 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc"} err="failed to get container status \"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc\": rpc error: code = NotFound desc = could not find container \"dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc\": container with ID starting with dc53f770e121018d0cac19a76a35348ec5b8d4473161ea3aa27be2aeac6ededc not found: ID does not exist" Jul 15 15:41:48.058660 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.058639 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:48.062715 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:48.062696 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rrrtd"] Jul 15 15:41:49.536628 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:49.536598 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83c7fdb-87b6-491e-9074-81d42d144965" path="/var/lib/kubelet/pods/b83c7fdb-87b6-491e-9074-81d42d144965/volumes" Jul 15 15:41:54.456174 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:54.456136 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:54.456591 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:54.456472 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:54.477944 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:54.477918 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:41:55.090367 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:41:55.090339 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-w4z2b" Jul 15 15:42:16.070897 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.070862 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8j75"] Jul 15 15:42:16.071353 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.071149 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83c7fdb-87b6-491e-9074-81d42d144965" containerName="registry-server" Jul 15 15:42:16.071353 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.071161 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83c7fdb-87b6-491e-9074-81d42d144965" containerName="registry-server" Jul 15 15:42:16.071353 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.071222 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83c7fdb-87b6-491e-9074-81d42d144965" containerName="registry-server" Jul 15 15:42:16.073257 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.073240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:16.077707 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.077684 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-swgwk\"" Jul 15 15:42:16.091994 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.091954 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8j75"] Jul 15 15:42:16.155771 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.155732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqpl\" (UniqueName: \"kubernetes.io/projected/e342690d-96b0-48cb-8629-b8c1696d0ea4-kube-api-access-dkqpl\") pod \"authorino-operator-75cc8d5cb7-q8j75\" (UID: \"e342690d-96b0-48cb-8629-b8c1696d0ea4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:16.256479 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.256435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqpl\" (UniqueName: \"kubernetes.io/projected/e342690d-96b0-48cb-8629-b8c1696d0ea4-kube-api-access-dkqpl\") pod \"authorino-operator-75cc8d5cb7-q8j75\" (UID: \"e342690d-96b0-48cb-8629-b8c1696d0ea4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:16.266345 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.266315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqpl\" (UniqueName: \"kubernetes.io/projected/e342690d-96b0-48cb-8629-b8c1696d0ea4-kube-api-access-dkqpl\") pod \"authorino-operator-75cc8d5cb7-q8j75\" (UID: \"e342690d-96b0-48cb-8629-b8c1696d0ea4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:16.382939 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.382899 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:16.532648 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:16.532624 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q8j75"] Jul 15 15:42:16.534718 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:42:16.534689 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode342690d_96b0_48cb_8629_b8c1696d0ea4.slice/crio-b1ea861e00e7aed07b1713c8e5a271c838b4395c8a9f3f74c85a5999c73239fd WatchSource:0}: Error finding container b1ea861e00e7aed07b1713c8e5a271c838b4395c8a9f3f74c85a5999c73239fd: Status 404 returned error can't find the container with id b1ea861e00e7aed07b1713c8e5a271c838b4395c8a9f3f74c85a5999c73239fd Jul 15 15:42:17.154434 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.154390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" event={"ID":"e342690d-96b0-48cb-8629-b8c1696d0ea4","Type":"ContainerStarted","Data":"b1ea861e00e7aed07b1713c8e5a271c838b4395c8a9f3f74c85a5999c73239fd"} Jul 15 15:42:17.321682 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.321602 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c549f565-k2w66"] Jul 15 15:42:17.324313 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.324288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.327157 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.327128 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 15:42:17.329113 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.329084 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 15:42:17.329601 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.329581 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 15:42:17.330157 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.330139 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 15:42:17.330250 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.330160 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 15:42:17.330415 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.330398 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mwl68\"" Jul 15 15:42:17.335755 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.335728 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 15:42:17.344613 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.344575 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c549f565-k2w66"] Jul 15 15:42:17.364246 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-trusted-ca-bundle\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364401 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-oauth-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364401 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpf6h\" (UniqueName: \"kubernetes.io/projected/1fc47f0b-2768-4656-b21e-39d5631dd98a-kube-api-access-gpf6h\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364401 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-service-ca\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364401 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364651 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.364651 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.364436 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-oauth-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465646 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465646 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-oauth-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-trusted-ca-bundle\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-oauth-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpf6h\" (UniqueName: \"kubernetes.io/projected/1fc47f0b-2768-4656-b21e-39d5631dd98a-kube-api-access-gpf6h\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-service-ca\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.465867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.465779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.466530 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.466451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-oauth-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.466530 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.466452 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.466823 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.466798 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-trusted-ca-bundle\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.467074 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.467032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc47f0b-2768-4656-b21e-39d5631dd98a-service-ca\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.469083 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.469030 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-serving-cert\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.469357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.469336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fc47f0b-2768-4656-b21e-39d5631dd98a-console-oauth-config\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.488404 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.488350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpf6h\" (UniqueName: \"kubernetes.io/projected/1fc47f0b-2768-4656-b21e-39d5631dd98a-kube-api-access-gpf6h\") pod \"console-68c549f565-k2w66\" (UID: \"1fc47f0b-2768-4656-b21e-39d5631dd98a\") " pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.637199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.637164 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:17.798148 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:17.798114 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c549f565-k2w66"] Jul 15 15:42:18.699868 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:42:18.699835 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc47f0b_2768_4656_b21e_39d5631dd98a.slice/crio-dc4e031043d90e97fdc07ca5d98cbcbda78bcfbe949f0edc6850ad356e45abbc WatchSource:0}: Error finding container dc4e031043d90e97fdc07ca5d98cbcbda78bcfbe949f0edc6850ad356e45abbc: Status 404 returned error can't find the container with id dc4e031043d90e97fdc07ca5d98cbcbda78bcfbe949f0edc6850ad356e45abbc Jul 15 15:42:19.165264 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.165231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c549f565-k2w66" event={"ID":"1fc47f0b-2768-4656-b21e-39d5631dd98a","Type":"ContainerStarted","Data":"6af27da8d657c39100f580f0b6c127fea7cf2e85b5fe46bec81c344927ac3cee"} Jul 15 15:42:19.165468 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.165290 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c549f565-k2w66" event={"ID":"1fc47f0b-2768-4656-b21e-39d5631dd98a","Type":"ContainerStarted","Data":"dc4e031043d90e97fdc07ca5d98cbcbda78bcfbe949f0edc6850ad356e45abbc"} Jul 15 15:42:19.166756 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.166723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" event={"ID":"e342690d-96b0-48cb-8629-b8c1696d0ea4","Type":"ContainerStarted","Data":"b195a3d47d1341a692fc3b2909046b45410b5da1a99d172373d65f2ed6403adf"} Jul 15 15:42:19.166884 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.166853 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:19.200076 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.200021 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c549f565-k2w66" podStartSLOduration=2.200006373 podStartE2EDuration="2.200006373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:19.198436422 +0000 UTC m=+417.941207385" watchObservedRunningTime="2026-07-15 15:42:19.200006373 +0000 UTC m=+417.942777320" Jul 15 15:42:19.219426 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:19.219363 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" podStartSLOduration=1.004896916 podStartE2EDuration="3.219326006s" totalImagesPullingTime="2.21442909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:19.218285141 +0000 UTC m=+417.961056090" watchObservedRunningTime="2026-07-15 15:42:19.219326006 +0000 UTC m=+417.962096953" Jul 15 15:42:22.995329 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:22.995292 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl"] Jul 15 15:42:22.998797 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:22.998779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.001954 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.001932 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsq6x\"" Jul 15 15:42:23.011843 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.011802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.011843 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.011834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5254d\" (UniqueName: \"kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.012051 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.012033 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl"] Jul 15 15:42:23.112801 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.112762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.112801 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.112802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5254d\" (UniqueName: \"kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.113207 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.113182 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.121936 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.121909 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5254d\" (UniqueName: \"kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.308381 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.308293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:23.449131 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:23.449014 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl"] Jul 15 15:42:23.451575 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:42:23.451549 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac2019f_41a0_4f03_adf4_1ff3d571b551.slice/crio-aa084e0c933d458fad03c7da6c21d7c9da135d8662f759c79d09148a8a062c1a WatchSource:0}: Error finding container aa084e0c933d458fad03c7da6c21d7c9da135d8662f759c79d09148a8a062c1a: Status 404 returned error can't find the container with id aa084e0c933d458fad03c7da6c21d7c9da135d8662f759c79d09148a8a062c1a Jul 15 15:42:24.189123 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:24.189086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" event={"ID":"5ac2019f-41a0-4f03-adf4-1ff3d571b551","Type":"ContainerStarted","Data":"aa084e0c933d458fad03c7da6c21d7c9da135d8662f759c79d09148a8a062c1a"} Jul 15 15:42:27.637641 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:27.637602 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:27.638069 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:27.637661 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:27.641960 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:27.641934 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:28.210539 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:28.210493 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c549f565-k2w66" Jul 15 15:42:30.173061 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:30.173018 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q8j75" Jul 15 15:42:30.218948 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:30.218390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" event={"ID":"5ac2019f-41a0-4f03-adf4-1ff3d571b551","Type":"ContainerStarted","Data":"2a9b7998b7391f5c3ace8113f513968722d86d61be6ea296175692639a57a391"} Jul 15 15:42:30.220353 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:30.220324 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:30.247427 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:30.247380 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" podStartSLOduration=2.0044034 podStartE2EDuration="8.247366423s" totalImagesPullingTime="6.242963023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:30.246201312 +0000 UTC m=+428.988972297" watchObservedRunningTime="2026-07-15 15:42:30.247366423 +0000 UTC m=+428.990137439" Jul 15 15:42:42.230199 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:42.230170 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:44.081721 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.081636 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl"] Jul 15 15:42:44.082119 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.081841 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" containerName="manager" containerID="cri-o://2a9b7998b7391f5c3ace8113f513968722d86d61be6ea296175692639a57a391" gracePeriod=2 Jul 15 15:42:44.095470 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.095443 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl"] Jul 15 15:42:44.101644 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:44.101612 2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5ac2019f-41a0-4f03-adf4-1ff3d571b551\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:44.112216 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.112182 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:42:44.112559 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.112543 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" containerName="manager" Jul 15 15:42:44.112559 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.112558 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" containerName="manager" Jul 15 15:42:44.112730 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.112615 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" containerName="manager" Jul 15 15:42:44.116014 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.115992 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.122187 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:44.122155 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" is forbidden: User \"system:node:ip-10-0-132-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-85.ec2.internal' and this object" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:44.133191 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.133161 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:42:44.198818 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.198795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.198877 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.198864 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.280010 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.279978 2554 generic.go:356] "Generic (PLEG): container finished" podID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" containerID="2a9b7998b7391f5c3ace8113f513968722d86d61be6ea296175692639a57a391" exitCode=0 Jul 15 15:42:44.299310 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.299288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.299481 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.299455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.299677 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.299660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.311325 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.311306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd7xh\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.324575 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.324556 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:44.326939 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:44.326914 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" is forbidden: User \"system:node:ip-10-0-132-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-85.ec2.internal' and this object" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:44.400195 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.400165 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5254d\" (UniqueName: \"kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d\") pod \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " Jul 15 15:42:44.400333 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.400209 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume\") pod \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\" (UID: \"5ac2019f-41a0-4f03-adf4-1ff3d571b551\") " Jul 15 15:42:44.400712 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.400687 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ac2019f-41a0-4f03-adf4-1ff3d571b551" (UID: "5ac2019f-41a0-4f03-adf4-1ff3d571b551"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:42:44.402177 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.402154 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d" (OuterVolumeSpecName: "kube-api-access-5254d") pod "5ac2019f-41a0-4f03-adf4-1ff3d571b551" (UID: "5ac2019f-41a0-4f03-adf4-1ff3d571b551"). InnerVolumeSpecName "kube-api-access-5254d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:42:44.455666 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.455631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:44.501627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.501585 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5254d\" (UniqueName: \"kubernetes.io/projected/5ac2019f-41a0-4f03-adf4-1ff3d571b551-kube-api-access-5254d\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:42:44.501627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.501622 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ac2019f-41a0-4f03-adf4-1ff3d571b551-extensions-socket-volume\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:42:44.594702 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:44.594675 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:42:44.596686 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:42:44.596662 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5e032d_91b4_476d_b9e7_990e61dec287.slice/crio-4162de9c5798ee0c812dce2a47ace1ee524b01489ab0a9bfa30e329b0bc6d8b8 WatchSource:0}: Error finding container 4162de9c5798ee0c812dce2a47ace1ee524b01489ab0a9bfa30e329b0bc6d8b8: Status 404 returned error can't find the container with id 4162de9c5798ee0c812dce2a47ace1ee524b01489ab0a9bfa30e329b0bc6d8b8 Jul 15 15:42:45.285720 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.285692 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:45.285720 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.285718 2554 scope.go:117] "RemoveContainer" containerID="2a9b7998b7391f5c3ace8113f513968722d86d61be6ea296175692639a57a391" Jul 15 15:42:45.287411 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.287382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" event={"ID":"3e5e032d-91b4-476d-b9e7-990e61dec287","Type":"ContainerStarted","Data":"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18"} Jul 15 15:42:45.287525 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.287438 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" event={"ID":"3e5e032d-91b4-476d-b9e7-990e61dec287","Type":"ContainerStarted","Data":"4162de9c5798ee0c812dce2a47ace1ee524b01489ab0a9bfa30e329b0bc6d8b8"} Jul 15 15:42:45.287576 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.287498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:45.289069 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:45.289046 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" is forbidden: User \"system:node:ip-10-0-132-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-85.ec2.internal' and this object" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:45.291553 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:45.291530 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" is forbidden: User \"system:node:ip-10-0-132-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-85.ec2.internal' and this object" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:45.326077 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:42:45.326043 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ws9kl\" is forbidden: User \"system:node:ip-10-0-132-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-85.ec2.internal' and this object" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ws9kl" Jul 15 15:42:45.326705 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.326658 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" podStartSLOduration=1.326639036 podStartE2EDuration="1.326639036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:45.32212888 +0000 UTC m=+444.064899820" watchObservedRunningTime="2026-07-15 15:42:45.326639036 +0000 UTC m=+444.069409984" Jul 15 15:42:45.537591 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:45.537483 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac2019f-41a0-4f03-adf4-1ff3d571b551" path="/var/lib/kubelet/pods/5ac2019f-41a0-4f03-adf4-1ff3d571b551/volumes" Jul 15 15:42:56.299951 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:56.299919 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:59.663566 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.663528 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:42:59.664028 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.663733 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" podUID="3e5e032d-91b4-476d-b9e7-990e61dec287" containerName="manager" containerID="cri-o://0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18" gracePeriod=10 Jul 15 15:42:59.904951 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.904927 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:42:59.951932 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.951860 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:42:59.952138 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.952127 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5e032d-91b4-476d-b9e7-990e61dec287" containerName="manager" Jul 15 15:42:59.952182 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.952140 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5e032d-91b4-476d-b9e7-990e61dec287" containerName="manager" Jul 15 15:42:59.952213 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.952196 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5e032d-91b4-476d-b9e7-990e61dec287" containerName="manager" Jul 15 15:42:59.954192 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.954176 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:42:59.967591 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:42:59.967565 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:43:00.034294 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.034268 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume\") pod \"3e5e032d-91b4-476d-b9e7-990e61dec287\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " Jul 15 15:43:00.034467 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.034306 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7\") pod \"3e5e032d-91b4-476d-b9e7-990e61dec287\" (UID: \"3e5e032d-91b4-476d-b9e7-990e61dec287\") " Jul 15 15:43:00.034673 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.034646 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e5e032d-91b4-476d-b9e7-990e61dec287" (UID: "3e5e032d-91b4-476d-b9e7-990e61dec287"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:43:00.036302 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.036279 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7" (OuterVolumeSpecName: "kube-api-access-hwts7") pod "3e5e032d-91b4-476d-b9e7-990e61dec287" (UID: "3e5e032d-91b4-476d-b9e7-990e61dec287"). InnerVolumeSpecName "kube-api-access-hwts7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:43:00.135809 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.135775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86tg2\" (UniqueName: \"kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.135944 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.135882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.135944 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.135911 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e5e032d-91b4-476d-b9e7-990e61dec287-extensions-socket-volume\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:43:00.135944 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.135921 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwts7\" (UniqueName: \"kubernetes.io/projected/3e5e032d-91b4-476d-b9e7-990e61dec287-kube-api-access-hwts7\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:43:00.237323 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.237239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.237323 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.237279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86tg2\" (UniqueName: \"kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.237643 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.237623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.248816 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.248783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86tg2\" (UniqueName: \"kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2\") pod \"kuadrant-operator-controller-manager-86878c769f-h84sx\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.263738 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.263712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:00.359177 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.359148 2554 generic.go:356] "Generic (PLEG): container finished" podID="3e5e032d-91b4-476d-b9e7-990e61dec287" containerID="0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18" exitCode=0 Jul 15 15:43:00.359357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.359192 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" Jul 15 15:43:00.359357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.359222 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" event={"ID":"3e5e032d-91b4-476d-b9e7-990e61dec287","Type":"ContainerDied","Data":"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18"} Jul 15 15:43:00.359357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.359262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh" event={"ID":"3e5e032d-91b4-476d-b9e7-990e61dec287","Type":"ContainerDied","Data":"4162de9c5798ee0c812dce2a47ace1ee524b01489ab0a9bfa30e329b0bc6d8b8"} Jul 15 15:43:00.359357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.359282 2554 scope.go:117] "RemoveContainer" containerID="0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18" Jul 15 15:43:00.368306 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.368284 2554 scope.go:117] "RemoveContainer" containerID="0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18" Jul 15 15:43:00.368678 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:43:00.368656 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18\": container with ID starting with 0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18 not found: ID does not exist" containerID="0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18" Jul 15 15:43:00.368784 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.368683 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18"} err="failed to get container status \"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18\": rpc error: code = NotFound desc = could not find container \"0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18\": container with ID starting with 0238bdd2154caa2f9cc78cec170850e1d9a050b92d25006cd5798b8a421d4c18 not found: ID does not exist" Jul 15 15:43:00.389015 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.388990 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:43:00.397812 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.397796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:43:00.400343 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:43:00.400302 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1424e12b_98d0_49d4_9ce4_927e22361e85.slice/crio-a9aba6e99b7cc829d2c240e1612928a84fa5c328be36ced5dc68b1d4bab688a3 WatchSource:0}: Error finding container a9aba6e99b7cc829d2c240e1612928a84fa5c328be36ced5dc68b1d4bab688a3: Status 404 returned error can't find the container with id a9aba6e99b7cc829d2c240e1612928a84fa5c328be36ced5dc68b1d4bab688a3 Jul 15 15:43:00.402232 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:00.402209 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd7xh"] Jul 15 15:43:01.364612 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:01.364571 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" event={"ID":"1424e12b-98d0-49d4-9ce4-927e22361e85","Type":"ContainerStarted","Data":"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5"} Jul 15 15:43:01.365076 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:01.364732 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:01.365076 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:01.364767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" event={"ID":"1424e12b-98d0-49d4-9ce4-927e22361e85","Type":"ContainerStarted","Data":"a9aba6e99b7cc829d2c240e1612928a84fa5c328be36ced5dc68b1d4bab688a3"} Jul 15 15:43:01.390326 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:01.390285 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" podStartSLOduration=2.390271595 podStartE2EDuration="2.390271595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:01.387676196 +0000 UTC m=+460.130447140" watchObservedRunningTime="2026-07-15 15:43:01.390271595 +0000 UTC m=+460.133042617" Jul 15 15:43:01.536529 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:01.536487 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5e032d-91b4-476d-b9e7-990e61dec287" path="/var/lib/kubelet/pods/3e5e032d-91b4-476d-b9e7-990e61dec287/volumes" Jul 15 15:43:12.372744 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:12.372713 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:43:29.564958 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.564926 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:29.568155 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.568130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.570921 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.570897 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 15:43:29.571168 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.570987 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nflhn\"" Jul 15 15:43:29.578051 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.578031 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:29.661561 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.661493 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:29.671027 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.671002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.671168 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.671033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkr5g\" (UniqueName: \"kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.771736 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.771705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.771881 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.771744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkr5g\" (UniqueName: \"kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.772381 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.772362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.781331 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.781299 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkr5g\" (UniqueName: \"kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g\") pod \"limitador-limitador-64c94fd64f-8lxww\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:29.878386 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:29.878357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:30.007990 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:30.007960 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:30.010395 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:43:30.010369 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfbc80e_7a9f_4408_8b6d_9fbc2a5804e6.slice/crio-3159b01d9b7b37c723125493252f91bfd561974de3f90fa3d2ec7e1d4b2816ff WatchSource:0}: Error finding container 3159b01d9b7b37c723125493252f91bfd561974de3f90fa3d2ec7e1d4b2816ff: Status 404 returned error can't find the container with id 3159b01d9b7b37c723125493252f91bfd561974de3f90fa3d2ec7e1d4b2816ff Jul 15 15:43:30.484227 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:30.484186 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" event={"ID":"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6","Type":"ContainerStarted","Data":"3159b01d9b7b37c723125493252f91bfd561974de3f90fa3d2ec7e1d4b2816ff"} Jul 15 15:43:33.499115 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:33.499084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" event={"ID":"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6","Type":"ContainerStarted","Data":"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d"} Jul 15 15:43:33.499480 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:33.499145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:33.517001 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:33.516956 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" podStartSLOduration=1.953338163 podStartE2EDuration="4.516943474s" totalImagesPullingTime="2.563605311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:33.516590568 +0000 UTC m=+492.259361515" watchObservedRunningTime="2026-07-15 15:43:33.516943474 +0000 UTC m=+492.259714432" Jul 15 15:43:43.781657 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:43.781608 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:43.782120 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:43.781844 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" podUID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" containerName="limitador" containerID="cri-o://c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d" gracePeriod=30 Jul 15 15:43:43.782564 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:43.782465 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:44.315628 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.315607 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:44.388181 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.388151 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file\") pod \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " Jul 15 15:43:44.388302 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.388205 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkr5g\" (UniqueName: \"kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g\") pod \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\" (UID: \"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6\") " Jul 15 15:43:44.388583 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.388558 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file" (OuterVolumeSpecName: "config-file") pod "5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" (UID: "5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:43:44.390165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.390145 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g" (OuterVolumeSpecName: "kube-api-access-tkr5g") pod "5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" (UID: "5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6"). InnerVolumeSpecName "kube-api-access-tkr5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:43:44.488827 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.488795 2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-config-file\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:43:44.488827 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.488818 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkr5g\" (UniqueName: \"kubernetes.io/projected/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6-kube-api-access-tkr5g\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:43:44.543480 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.543439 2554 generic.go:356] "Generic (PLEG): container finished" podID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" containerID="c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d" exitCode=0 Jul 15 15:43:44.543621 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.543485 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" Jul 15 15:43:44.543621 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.543538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" event={"ID":"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6","Type":"ContainerDied","Data":"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d"} Jul 15 15:43:44.543621 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.543587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8lxww" event={"ID":"5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6","Type":"ContainerDied","Data":"3159b01d9b7b37c723125493252f91bfd561974de3f90fa3d2ec7e1d4b2816ff"} Jul 15 15:43:44.543621 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.543608 2554 scope.go:117] "RemoveContainer" containerID="c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d" Jul 15 15:43:44.551726 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.551710 2554 scope.go:117] "RemoveContainer" containerID="c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d" Jul 15 15:43:44.551953 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:43:44.551937 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d\": container with ID starting with c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d not found: ID does not exist" containerID="c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d" Jul 15 15:43:44.552001 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.551963 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d"} err="failed to get container status \"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d\": rpc error: code = NotFound desc = could not find container \"c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d\": container with ID starting with c30a7dc681e3444560280c54f0b8836c9ad75aec2e006dbca220cb2395f8d41d not found: ID does not exist" Jul 15 15:43:44.564477 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.564456 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:44.568130 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:44.568113 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8lxww"] Jul 15 15:43:45.536867 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:45.536833 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" path="/var/lib/kubelet/pods/5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6/volumes" Jul 15 15:43:49.716443 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.716412 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8shs"] Jul 15 15:43:49.716900 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.716714 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" containerName="limitador" Jul 15 15:43:49.716900 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.716724 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" containerName="limitador" Jul 15 15:43:49.716900 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.716786 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dfbc80e-7a9f-4408-8b6d-9fbc2a5804e6" containerName="limitador" Jul 15 15:43:49.719016 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.718993 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.721684 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.721663 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-r28lq\"" Jul 15 15:43:49.721974 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.721954 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 15:43:49.722042 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.721971 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 15:43:49.722785 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.722771 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 15:43:49.730653 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.730632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8shs"] Jul 15 15:43:49.830698 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.830675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smgr\" (UniqueName: \"kubernetes.io/projected/297532d7-feff-4483-9c6d-4503eb6a3222-kube-api-access-6smgr\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.830805 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.830703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/297532d7-feff-4483-9c6d-4503eb6a3222-data\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.931771 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.931744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smgr\" (UniqueName: \"kubernetes.io/projected/297532d7-feff-4483-9c6d-4503eb6a3222-kube-api-access-6smgr\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.931880 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.931775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/297532d7-feff-4483-9c6d-4503eb6a3222-data\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.932146 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.932130 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/297532d7-feff-4483-9c6d-4503eb6a3222-data\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:49.940856 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:49.940833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smgr\" (UniqueName: \"kubernetes.io/projected/297532d7-feff-4483-9c6d-4503eb6a3222-kube-api-access-6smgr\") pod \"postgres-69fb4594cf-w8shs\" (UID: \"297532d7-feff-4483-9c6d-4503eb6a3222\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:50.028859 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:50.028803 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:50.154907 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:50.154884 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8shs"] Jul 15 15:43:50.156673 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:43:50.156650 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297532d7_feff_4483_9c6d_4503eb6a3222.slice/crio-6428f5c56631052c898da68d457b4a8b87cb3496017514746daeb1df0986fbed WatchSource:0}: Error finding container 6428f5c56631052c898da68d457b4a8b87cb3496017514746daeb1df0986fbed: Status 404 returned error can't find the container with id 6428f5c56631052c898da68d457b4a8b87cb3496017514746daeb1df0986fbed Jul 15 15:43:50.569317 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:50.569284 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" event={"ID":"297532d7-feff-4483-9c6d-4503eb6a3222","Type":"ContainerStarted","Data":"6428f5c56631052c898da68d457b4a8b87cb3496017514746daeb1df0986fbed"} Jul 15 15:43:55.592549 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:55.592492 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" event={"ID":"297532d7-feff-4483-9c6d-4503eb6a3222","Type":"ContainerStarted","Data":"7805e2001d05f6f886ef7649cdbb6b7bdf63346af094bc68fb792e824d2c898b"} Jul 15 15:43:55.592912 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:55.592584 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:43:55.611027 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:43:55.610987 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" podStartSLOduration=2.138884786 podStartE2EDuration="6.610974145s" totalImagesPullingTime="4.472089359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:55.610138376 +0000 UTC m=+514.352909325" watchObservedRunningTime="2026-07-15 15:43:55.610974145 +0000 UTC m=+514.353745093" Jul 15 15:44:01.625037 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:01.625000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8shs" Jul 15 15:44:09.565791 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.565756 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:09.590821 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.590773 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:09.590982 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.590880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.593990 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.593968 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 15:44:09.593990 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.593980 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 15:44:09.594179 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.594028 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-glw5r\"" Jul 15 15:44:09.681392 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.681363 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlw5\" (UniqueName: \"kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.681580 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.681408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.729426 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.729395 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:44:09.736764 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.736736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:09.745636 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.745613 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:44:09.781889 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.781860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlw5\" (UniqueName: \"kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.782041 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.781910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.782041 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.781941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:09.782041 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.781958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxs7d\" (UniqueName: \"kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:09.782041 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:44:09.782031 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 15:44:09.782252 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:44:09.782093 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert podName:db596db7-cb17-4941-a8eb-e66b69be268c nodeName:}" failed. No retries permitted until 2026-07-15 15:44:10.282074957 +0000 UTC m=+529.024845890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert") pod "maas-controller-7bb598f85c-8bk55" (UID: "db596db7-cb17-4941-a8eb-e66b69be268c") : secret "maas-controller-webhook-cert" not found Jul 15 15:44:09.794458 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.794433 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlw5\" (UniqueName: \"kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:09.882750 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.882717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:09.882750 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.882754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxs7d\" (UniqueName: \"kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:09.882940 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:44:09.882837 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 15:44:09.882940 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:44:09.882897 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert podName:9099722d-b5d3-4c72-a553-3d71f33886dc nodeName:}" failed. No retries permitted until 2026-07-15 15:44:10.382883427 +0000 UTC m=+529.125654353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert") pod "maas-controller-54c4dd9f96-ch8lj" (UID: "9099722d-b5d3-4c72-a553-3d71f33886dc") : secret "maas-controller-webhook-cert" not found Jul 15 15:44:09.891798 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:09.891779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxs7d\" (UniqueName: \"kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:10.285005 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.284917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:10.287272 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.287252 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") pod \"maas-controller-7bb598f85c-8bk55\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:10.385278 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.385250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:10.387351 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.387333 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") pod \"maas-controller-54c4dd9f96-ch8lj\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:10.501400 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.501365 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:10.632746 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.632717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:10.635240 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:44:10.635215 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb596db7_cb17_4941_a8eb_e66b69be268c.slice/crio-283050ff29d5c8915f273fb80b148863b94aa031ef00490dc057e372b13304ac WatchSource:0}: Error finding container 283050ff29d5c8915f273fb80b148863b94aa031ef00490dc057e372b13304ac: Status 404 returned error can't find the container with id 283050ff29d5c8915f273fb80b148863b94aa031ef00490dc057e372b13304ac Jul 15 15:44:10.647159 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.647137 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:10.655492 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.655465 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb598f85c-8bk55" event={"ID":"db596db7-cb17-4941-a8eb-e66b69be268c","Type":"ContainerStarted","Data":"283050ff29d5c8915f273fb80b148863b94aa031ef00490dc057e372b13304ac"} Jul 15 15:44:10.772524 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:10.772484 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:44:10.775793 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:44:10.775763 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9099722d_b5d3_4c72_a553_3d71f33886dc.slice/crio-bad88ae2e853f8ca297273bae69915cd46cf44770915ec5ddef52ff73d22ab94 WatchSource:0}: Error finding container bad88ae2e853f8ca297273bae69915cd46cf44770915ec5ddef52ff73d22ab94: Status 404 returned error can't find the container with id bad88ae2e853f8ca297273bae69915cd46cf44770915ec5ddef52ff73d22ab94 Jul 15 15:44:11.664189 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:11.664114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" event={"ID":"9099722d-b5d3-4c72-a553-3d71f33886dc","Type":"ContainerStarted","Data":"bad88ae2e853f8ca297273bae69915cd46cf44770915ec5ddef52ff73d22ab94"} Jul 15 15:44:13.675143 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.675109 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb598f85c-8bk55" event={"ID":"db596db7-cb17-4941-a8eb-e66b69be268c","Type":"ContainerStarted","Data":"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7"} Jul 15 15:44:13.675592 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.675182 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:13.676556 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.676531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" event={"ID":"9099722d-b5d3-4c72-a553-3d71f33886dc","Type":"ContainerStarted","Data":"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1"} Jul 15 15:44:13.676648 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.676579 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:13.699476 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.699427 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bb598f85c-8bk55" podStartSLOduration=2.11483571 podStartE2EDuration="4.699412039s" totalImagesPullingTime="2.584576329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:13.697999949 +0000 UTC m=+532.440770899" watchObservedRunningTime="2026-07-15 15:44:13.699412039 +0000 UTC m=+532.442183011" Jul 15 15:44:13.718486 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:13.718440 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" podStartSLOduration=2.265351331 podStartE2EDuration="4.718424568s" totalImagesPullingTime="2.453073237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:13.717701732 +0000 UTC m=+532.460472681" watchObservedRunningTime="2026-07-15 15:44:13.718424568 +0000 UTC m=+532.461195516" Jul 15 15:44:24.682385 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:24.682356 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:24.682797 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:24.682565 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:44:24.758803 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:24.758769 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:24.759015 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:24.758984 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bb598f85c-8bk55" podUID="db596db7-cb17-4941-a8eb-e66b69be268c" containerName="manager" containerID="cri-o://9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7" gracePeriod=30 Jul 15 15:44:24.989243 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:24.989221 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:25.086278 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.086252 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtlw5\" (UniqueName: \"kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5\") pod \"db596db7-cb17-4941-a8eb-e66b69be268c\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " Jul 15 15:44:25.086399 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.086334 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") pod \"db596db7-cb17-4941-a8eb-e66b69be268c\" (UID: \"db596db7-cb17-4941-a8eb-e66b69be268c\") " Jul 15 15:44:25.088299 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.088266 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5" (OuterVolumeSpecName: "kube-api-access-wtlw5") pod "db596db7-cb17-4941-a8eb-e66b69be268c" (UID: "db596db7-cb17-4941-a8eb-e66b69be268c"). InnerVolumeSpecName "kube-api-access-wtlw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:44:25.088408 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.088335 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "db596db7-cb17-4941-a8eb-e66b69be268c" (UID: "db596db7-cb17-4941-a8eb-e66b69be268c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:44:25.187049 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.187023 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db596db7-cb17-4941-a8eb-e66b69be268c-webhook-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:44:25.187049 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.187045 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtlw5\" (UniqueName: \"kubernetes.io/projected/db596db7-cb17-4941-a8eb-e66b69be268c-kube-api-access-wtlw5\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:44:25.728432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.728403 2554 generic.go:356] "Generic (PLEG): container finished" podID="db596db7-cb17-4941-a8eb-e66b69be268c" containerID="9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7" exitCode=0 Jul 15 15:44:25.728836 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.728441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb598f85c-8bk55" event={"ID":"db596db7-cb17-4941-a8eb-e66b69be268c","Type":"ContainerDied","Data":"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7"} Jul 15 15:44:25.728836 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.728449 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb598f85c-8bk55" Jul 15 15:44:25.728836 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.728477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb598f85c-8bk55" event={"ID":"db596db7-cb17-4941-a8eb-e66b69be268c","Type":"ContainerDied","Data":"283050ff29d5c8915f273fb80b148863b94aa031ef00490dc057e372b13304ac"} Jul 15 15:44:25.728836 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.728498 2554 scope.go:117] "RemoveContainer" containerID="9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7" Jul 15 15:44:25.736375 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.736360 2554 scope.go:117] "RemoveContainer" containerID="9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7" Jul 15 15:44:25.736639 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:44:25.736622 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7\": container with ID starting with 9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7 not found: ID does not exist" containerID="9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7" Jul 15 15:44:25.736742 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.736645 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7"} err="failed to get container status \"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7\": rpc error: code = NotFound desc = could not find container \"9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7\": container with ID starting with 9d49f7961d9ac66138acf1afc67eaca5d81790bbd2d2d0f269252c87a07bcad7 not found: ID does not exist" Jul 15 15:44:25.745586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.745566 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:25.751899 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:25.751880 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bb598f85c-8bk55"] Jul 15 15:44:27.537603 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:27.537569 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db596db7-cb17-4941-a8eb-e66b69be268c" path="/var/lib/kubelet/pods/db596db7-cb17-4941-a8eb-e66b69be268c/volumes" Jul 15 15:44:47.398137 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.398103 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj"] Jul 15 15:44:47.398743 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.398424 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db596db7-cb17-4941-a8eb-e66b69be268c" containerName="manager" Jul 15 15:44:47.398743 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.398435 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="db596db7-cb17-4941-a8eb-e66b69be268c" containerName="manager" Jul 15 15:44:47.398743 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.398485 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="db596db7-cb17-4941-a8eb-e66b69be268c" containerName="manager" Jul 15 15:44:47.402983 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.402961 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.406430 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.406409 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xx6mb\"" Jul 15 15:44:47.406568 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.406408 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 15:44:47.412251 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.412230 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj"] Jul 15 15:44:47.452894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.452869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-maas-api-tls\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.453021 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.452901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-openshift-service-ca\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.453021 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.452946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwvc9\" (UniqueName: \"kubernetes.io/projected/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-kube-api-access-dwvc9\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.554303 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.554264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-maas-api-tls\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.554459 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.554356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-openshift-service-ca\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.554459 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.554418 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvc9\" (UniqueName: \"kubernetes.io/projected/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-kube-api-access-dwvc9\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.555034 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.555009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-openshift-service-ca\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.556765 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.556739 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-maas-api-tls\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.563765 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.563744 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvc9\" (UniqueName: \"kubernetes.io/projected/f5e686f0-f03c-449d-a6ed-e7e42f4b9c45-kube-api-access-dwvc9\") pod \"maas-api-7f594748d7-qzpdj\" (UID: \"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45\") " pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.714738 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.714674 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:47.849986 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:47.849872 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj"] Jul 15 15:44:48.006727 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.006655 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd"] Jul 15 15:44:48.009584 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.009566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.012471 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.012454 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-px5rd\"" Jul 15 15:44:48.012658 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.012492 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 15:44:48.021798 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.021780 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd"] Jul 15 15:44:48.051844 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.051809 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-cdkqc"] Jul 15 15:44:48.054314 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.054292 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.058119 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.058097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46bf77dc-0e82-43c0-8f82-45db7066778d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.058212 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.058149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlr5\" (UniqueName: \"kubernetes.io/projected/46bf77dc-0e82-43c0-8f82-45db7066778d-kube-api-access-xzlr5\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.073420 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.073395 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-cdkqc"] Jul 15 15:44:48.158719 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.158681 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46bf77dc-0e82-43c0-8f82-45db7066778d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.158895 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.158734 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d58face-9502-414f-8e5e-253172f67e22-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.158895 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.158782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlr5\" (UniqueName: \"kubernetes.io/projected/46bf77dc-0e82-43c0-8f82-45db7066778d-kube-api-access-xzlr5\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.158895 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.158821 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpv6g\" (UniqueName: \"kubernetes.io/projected/1d58face-9502-414f-8e5e-253172f67e22-kube-api-access-fpv6g\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.159421 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.159398 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46bf77dc-0e82-43c0-8f82-45db7066778d-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.167662 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.167636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlr5\" (UniqueName: \"kubernetes.io/projected/46bf77dc-0e82-43c0-8f82-45db7066778d-kube-api-access-xzlr5\") pod \"payload-pre-processing-74584bb9f8-5g8dd\" (UID: \"46bf77dc-0e82-43c0-8f82-45db7066778d\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.259269 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.259198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpv6g\" (UniqueName: \"kubernetes.io/projected/1d58face-9502-414f-8e5e-253172f67e22-kube-api-access-fpv6g\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.259269 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.259262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d58face-9502-414f-8e5e-253172f67e22-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.259878 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.259859 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d58face-9502-414f-8e5e-253172f67e22-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.268932 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.268905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpv6g\" (UniqueName: \"kubernetes.io/projected/1d58face-9502-414f-8e5e-253172f67e22-kube-api-access-fpv6g\") pod \"payload-processing-f9b8d9b9b-cdkqc\" (UID: \"1d58face-9502-414f-8e5e-253172f67e22\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.320925 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.320898 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:48.364601 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.364566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:48.459542 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.459495 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd"] Jul 15 15:44:48.461991 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:44:48.461964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bf77dc_0e82_43c0_8f82_45db7066778d.slice/crio-e2db187635db9cc5d0fcf8ad055ac87c256ef2b061659bbb1068a6b75c4a0f06 WatchSource:0}: Error finding container e2db187635db9cc5d0fcf8ad055ac87c256ef2b061659bbb1068a6b75c4a0f06: Status 404 returned error can't find the container with id e2db187635db9cc5d0fcf8ad055ac87c256ef2b061659bbb1068a6b75c4a0f06 Jul 15 15:44:48.504231 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.504207 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-cdkqc"] Jul 15 15:44:48.506120 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:44:48.506084 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d58face_9502_414f_8e5e_253172f67e22.slice/crio-81c3696d53d3a2fa4a1901aea2040cd3e60a8bb8a76f0f37a33ad6ba2fe56c14 WatchSource:0}: Error finding container 81c3696d53d3a2fa4a1901aea2040cd3e60a8bb8a76f0f37a33ad6ba2fe56c14: Status 404 returned error can't find the container with id 81c3696d53d3a2fa4a1901aea2040cd3e60a8bb8a76f0f37a33ad6ba2fe56c14 Jul 15 15:44:48.833412 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.833328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" event={"ID":"1d58face-9502-414f-8e5e-253172f67e22","Type":"ContainerStarted","Data":"81c3696d53d3a2fa4a1901aea2040cd3e60a8bb8a76f0f37a33ad6ba2fe56c14"} Jul 15 15:44:48.834483 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.834456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" event={"ID":"46bf77dc-0e82-43c0-8f82-45db7066778d","Type":"ContainerStarted","Data":"e2db187635db9cc5d0fcf8ad055ac87c256ef2b061659bbb1068a6b75c4a0f06"} Jul 15 15:44:48.835475 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:48.835452 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" event={"ID":"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45","Type":"ContainerStarted","Data":"4d4fd87f132c293bc689b5228b8eb006185aa365e087a99a8ddbd7ffb617d42c"} Jul 15 15:44:50.847465 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.847422 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" event={"ID":"1d58face-9502-414f-8e5e-253172f67e22","Type":"ContainerStarted","Data":"639feb496f6f7bca062d84ee58c862d03c64d6537ae9ba215c34467206201f0c"} Jul 15 15:44:50.847915 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.847536 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:44:50.848985 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.848958 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" event={"ID":"46bf77dc-0e82-43c0-8f82-45db7066778d","Type":"ContainerStarted","Data":"f68c02a0382f3fb50cb74c86458c665d1c34cc17b76252322131ab294be81a35"} Jul 15 15:44:50.849112 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.849062 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:44:50.850327 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.850307 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" event={"ID":"f5e686f0-f03c-449d-a6ed-e7e42f4b9c45","Type":"ContainerStarted","Data":"2e65c8b26636ebfe59e082eb19e56bc233ba6497434be91bb245bc11a99883d7"} Jul 15 15:44:50.850432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.850421 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:44:50.867956 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.867917 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" podStartSLOduration=1.120143619 podStartE2EDuration="2.867906404s" totalImagesPullingTime="1.747762785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:50.86749347 +0000 UTC m=+569.610264416" watchObservedRunningTime="2026-07-15 15:44:50.867906404 +0000 UTC m=+569.610677351" Jul 15 15:44:50.884920 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.884883 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" podStartSLOduration=2.091043228 podStartE2EDuration="3.884871814s" totalImagesPullingTime="1.793828586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:50.883776255 +0000 UTC m=+569.626547207" watchObservedRunningTime="2026-07-15 15:44:50.884871814 +0000 UTC m=+569.627642762" Jul 15 15:44:50.903804 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:50.903764 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" podStartSLOduration=1.501931746 podStartE2EDuration="3.903751804s" totalImagesPullingTime="2.401820058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:50.902839121 +0000 UTC m=+569.645610068" watchObservedRunningTime="2026-07-15 15:44:50.903751804 +0000 UTC m=+569.646522751" Jul 15 15:44:56.860261 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:44:56.860227 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f594748d7-qzpdj" Jul 15 15:45:01.856143 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:01.856112 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-cdkqc" Jul 15 15:45:01.856537 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:01.856272 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5g8dd" Jul 15 15:45:07.591079 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.591043 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2"] Jul 15 15:45:07.595468 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.595448 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.598381 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.598353 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 15:45:07.598484 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.598420 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 15:45:07.598484 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.598429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bxntm\"" Jul 15 15:45:07.598484 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.598425 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 15:45:07.604713 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.604692 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2"] Jul 15 15:45:07.718679 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718648 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.718679 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52600167-18ab-4db1-892e-130beaab6618-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.718855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.718855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.718855 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.718984 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.718900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdkk\" (UniqueName: \"kubernetes.io/projected/52600167-18ab-4db1-892e-130beaab6618-kube-api-access-dzdkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.819950 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.819918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.819950 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.819954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52600167-18ab-4db1-892e-130beaab6618-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820165 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdkk\" (UniqueName: \"kubernetes.io/projected/52600167-18ab-4db1-892e-130beaab6618-kube-api-access-dzdkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820376 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820351 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820436 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820405 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.820575 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.820557 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.822187 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.822167 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52600167-18ab-4db1-892e-130beaab6618-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.822440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.822422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52600167-18ab-4db1-892e-130beaab6618-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.828161 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.828136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdkk\" (UniqueName: \"kubernetes.io/projected/52600167-18ab-4db1-892e-130beaab6618-kube-api-access-dzdkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2\" (UID: \"52600167-18ab-4db1-892e-130beaab6618\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:07.907538 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:07.907517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:08.042262 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:08.042239 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2"] Jul 15 15:45:08.044253 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:45:08.044224 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52600167_18ab_4db1_892e_130beaab6618.slice/crio-6c10fbd35d7d2a94e8419a034d98b087fc40ae218d2f19716f933c9903e78474 WatchSource:0}: Error finding container 6c10fbd35d7d2a94e8419a034d98b087fc40ae218d2f19716f933c9903e78474: Status 404 returned error can't find the container with id 6c10fbd35d7d2a94e8419a034d98b087fc40ae218d2f19716f933c9903e78474 Jul 15 15:45:08.933587 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:08.933546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" event={"ID":"52600167-18ab-4db1-892e-130beaab6618","Type":"ContainerStarted","Data":"6c10fbd35d7d2a94e8419a034d98b087fc40ae218d2f19716f933c9903e78474"} Jul 15 15:45:09.940120 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:09.940089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" event={"ID":"52600167-18ab-4db1-892e-130beaab6618","Type":"ContainerStarted","Data":"df0dbca7ffbce0c7b40ec1358ec397962acb148be51866e50e3a1f0998a07ba8"} Jul 15 15:45:09.960770 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:09.960725 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" podStartSLOduration=1.4939824179999999 podStartE2EDuration="2.960709378s" totalImagesPullingTime="1.46672696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:45:09.958819583 +0000 UTC m=+588.701590530" watchObservedRunningTime="2026-07-15 15:45:09.960709378 +0000 UTC m=+588.703480325" Jul 15 15:45:17.908266 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:17.908229 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:17.908668 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:17.908287 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:17.920190 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:17.920166 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:17.986201 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:17.986172 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2" Jul 15 15:45:31.987444 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:31.987408 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v"] Jul 15 15:45:31.989997 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:31.989980 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:31.993608 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:31.993585 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 15:45:32.002693 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.002670 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v"] Jul 15 15:45:32.020336 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.020446 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg45v\" (UniqueName: \"kubernetes.io/projected/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-kube-api-access-vg45v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.020446 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020422 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.020532 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.020532 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020487 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.020603 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.020582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121266 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg45v\" (UniqueName: \"kubernetes.io/projected/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-kube-api-access-vg45v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121432 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121772 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121747 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121829 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.121864 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.121823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.123681 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.123653 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.123916 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.123899 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.130908 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.130884 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg45v\" (UniqueName: \"kubernetes.io/projected/2c6e118e-fd98-4a37-9e08-de0a13b4dc97-kube-api-access-vg45v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ncb2v\" (UID: \"2c6e118e-fd98-4a37-9e08-de0a13b4dc97\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.299748 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.299679 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:32.440627 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.440593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v"] Jul 15 15:45:32.440818 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:45:32.440788 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6e118e_fd98_4a37_9e08_de0a13b4dc97.slice/crio-3ffee165d482eee4217cc262a2f4f0c4696cb7a176a097041a4ae829c50bc574 WatchSource:0}: Error finding container 3ffee165d482eee4217cc262a2f4f0c4696cb7a176a097041a4ae829c50bc574: Status 404 returned error can't find the container with id 3ffee165d482eee4217cc262a2f4f0c4696cb7a176a097041a4ae829c50bc574 Jul 15 15:45:32.442711 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:32.442685 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 15:45:33.042031 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:33.041938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" event={"ID":"2c6e118e-fd98-4a37-9e08-de0a13b4dc97","Type":"ContainerStarted","Data":"a49bac0621a2ffad9320f367c0ea5554e89617db5eec694334e9656205d62d59"} Jul 15 15:45:33.042031 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:33.041999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" event={"ID":"2c6e118e-fd98-4a37-9e08-de0a13b4dc97","Type":"ContainerStarted","Data":"3ffee165d482eee4217cc262a2f4f0c4696cb7a176a097041a4ae829c50bc574"} Jul 15 15:45:33.061339 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:33.061288 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" podStartSLOduration=1.8157959460000002 podStartE2EDuration="2.061274938s" totalImagesPullingTime="245.478992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:45:33.060595682 +0000 UTC m=+611.803366629" watchObservedRunningTime="2026-07-15 15:45:33.061274938 +0000 UTC m=+611.804045885" Jul 15 15:45:36.583699 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.583663 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd"] Jul 15 15:45:36.586263 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.586244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.589266 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.589245 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 15:45:36.598186 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.598163 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd"] Jul 15 15:45:36.660964 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.660934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.661125 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.660969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlfxd\" (UniqueName: \"kubernetes.io/projected/c593b9f3-7c0f-4b09-9a43-537afc2473e5-kube-api-access-rlfxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.661125 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.660998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.661125 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.661048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.661125 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.661090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.661273 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.661129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.761959 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.761928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.761959 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.761964 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762206 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.761984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlfxd\" (UniqueName: \"kubernetes.io/projected/c593b9f3-7c0f-4b09-9a43-537afc2473e5-kube-api-access-rlfxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762206 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762206 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762206 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762690 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762911 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.762911 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.762730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.764611 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.764591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c593b9f3-7c0f-4b09-9a43-537afc2473e5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.764766 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.764725 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c593b9f3-7c0f-4b09-9a43-537afc2473e5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.770686 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.770664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlfxd\" (UniqueName: \"kubernetes.io/projected/c593b9f3-7c0f-4b09-9a43-537afc2473e5-kube-api-access-rlfxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd\" (UID: \"c593b9f3-7c0f-4b09-9a43-537afc2473e5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:36.899048 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:36.899018 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:37.037371 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:37.037341 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd"] Jul 15 15:45:37.060689 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:37.060661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" event={"ID":"c593b9f3-7c0f-4b09-9a43-537afc2473e5","Type":"ContainerStarted","Data":"180e833af11a2fc0b083acb7787c725c0c3acde4b7e50546aa23f0f0b8e4d3b1"} Jul 15 15:45:38.066711 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:38.066670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" event={"ID":"c593b9f3-7c0f-4b09-9a43-537afc2473e5","Type":"ContainerStarted","Data":"2bde539470ffc4360c84aa91ae4deec9149fd934ec5b6cc244e18657958ad207"} Jul 15 15:45:42.300053 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:42.300014 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:42.300478 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:42.300119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:42.312127 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:42.312104 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:42.332106 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:42.332055 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" podStartSLOduration=6.117526399 podStartE2EDuration="6.332041984s" totalImagesPullingTime="214.515585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:45:38.095278194 +0000 UTC m=+616.838049140" watchObservedRunningTime="2026-07-15 15:45:42.332041984 +0000 UTC m=+621.074812931" Jul 15 15:45:43.098586 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:43.098554 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ncb2v" Jul 15 15:45:46.899662 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:46.899628 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:46.900058 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:46.899687 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:46.911968 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:46.911940 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:45:47.119321 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:45:47.119293 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd" Jul 15 15:48:34.750524 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:34.750466 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:48:34.751090 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:34.750697 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" podUID="9099722d-b5d3-4c72-a553-3d71f33886dc" containerName="manager" containerID="cri-o://a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1" gracePeriod=30 Jul 15 15:48:35.003321 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.003268 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:48:35.070195 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.070161 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxs7d\" (UniqueName: \"kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d\") pod \"9099722d-b5d3-4c72-a553-3d71f33886dc\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " Jul 15 15:48:35.070366 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.070269 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") pod \"9099722d-b5d3-4c72-a553-3d71f33886dc\" (UID: \"9099722d-b5d3-4c72-a553-3d71f33886dc\") " Jul 15 15:48:35.072161 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.072128 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9099722d-b5d3-4c72-a553-3d71f33886dc" (UID: "9099722d-b5d3-4c72-a553-3d71f33886dc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:48:35.072276 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.072181 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d" (OuterVolumeSpecName: "kube-api-access-gxs7d") pod "9099722d-b5d3-4c72-a553-3d71f33886dc" (UID: "9099722d-b5d3-4c72-a553-3d71f33886dc"). InnerVolumeSpecName "kube-api-access-gxs7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:48:35.171698 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.171675 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9099722d-b5d3-4c72-a553-3d71f33886dc-webhook-cert\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:48:35.171698 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.171698 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxs7d\" (UniqueName: \"kubernetes.io/projected/9099722d-b5d3-4c72-a553-3d71f33886dc-kube-api-access-gxs7d\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:48:35.867475 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.867445 2554 generic.go:356] "Generic (PLEG): container finished" podID="9099722d-b5d3-4c72-a553-3d71f33886dc" containerID="a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1" exitCode=0 Jul 15 15:48:35.867894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.867486 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" Jul 15 15:48:35.867894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.867526 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" event={"ID":"9099722d-b5d3-4c72-a553-3d71f33886dc","Type":"ContainerDied","Data":"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1"} Jul 15 15:48:35.867894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.867575 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-ch8lj" event={"ID":"9099722d-b5d3-4c72-a553-3d71f33886dc","Type":"ContainerDied","Data":"bad88ae2e853f8ca297273bae69915cd46cf44770915ec5ddef52ff73d22ab94"} Jul 15 15:48:35.867894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.867600 2554 scope.go:117] "RemoveContainer" containerID="a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1" Jul 15 15:48:35.875972 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.875953 2554 scope.go:117] "RemoveContainer" containerID="a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1" Jul 15 15:48:35.876217 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:48:35.876193 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1\": container with ID starting with a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1 not found: ID does not exist" containerID="a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1" Jul 15 15:48:35.876300 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.876220 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1"} err="failed to get container status \"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1\": rpc error: code = NotFound desc = could not find container \"a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1\": container with ID starting with a87f56c2ae2375bb2ceed5d64cb73d736c6c9c01bf0c2b34fa7ee5bda8ff2fa1 not found: ID does not exist" Jul 15 15:48:35.886335 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.886312 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:48:35.890709 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:35.890687 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-ch8lj"] Jul 15 15:48:36.962845 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.962811 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-zg24l"] Jul 15 15:48:36.963357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.963313 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9099722d-b5d3-4c72-a553-3d71f33886dc" containerName="manager" Jul 15 15:48:36.963357 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.963338 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9099722d-b5d3-4c72-a553-3d71f33886dc" containerName="manager" Jul 15 15:48:36.963578 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.963439 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9099722d-b5d3-4c72-a553-3d71f33886dc" containerName="manager" Jul 15 15:48:36.966565 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.966545 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:36.969178 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.969159 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-glw5r\"" Jul 15 15:48:36.969298 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.969159 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 15:48:36.969298 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.969203 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 15:48:36.976333 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:36.976301 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-zg24l"] Jul 15 15:48:37.088969 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.088940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbp6\" (UniqueName: \"kubernetes.io/projected/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-kube-api-access-vzbp6\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.089123 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.088982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-webhook-cert\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.190053 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.190024 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-webhook-cert\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.190225 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.190100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbp6\" (UniqueName: \"kubernetes.io/projected/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-kube-api-access-vzbp6\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.192455 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.192430 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-webhook-cert\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.199139 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.199118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbp6\" (UniqueName: \"kubernetes.io/projected/545f6aec-e8b5-4bc8-8e63-d7b83f573e57-kube-api-access-vzbp6\") pod \"maas-controller-54c4dd9f96-zg24l\" (UID: \"545f6aec-e8b5-4bc8-8e63-d7b83f573e57\") " pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.276894 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.276833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:37.406657 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.406633 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c4dd9f96-zg24l"] Jul 15 15:48:37.409244 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:48:37.409222 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545f6aec_e8b5_4bc8_8e63_d7b83f573e57.slice/crio-08e060b61d2ebb06f2f53476ae84372b814dc285d9898035ec37d214a3471b40 WatchSource:0}: Error finding container 08e060b61d2ebb06f2f53476ae84372b814dc285d9898035ec37d214a3471b40: Status 404 returned error can't find the container with id 08e060b61d2ebb06f2f53476ae84372b814dc285d9898035ec37d214a3471b40 Jul 15 15:48:37.538211 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.538126 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9099722d-b5d3-4c72-a553-3d71f33886dc" path="/var/lib/kubelet/pods/9099722d-b5d3-4c72-a553-3d71f33886dc/volumes" Jul 15 15:48:37.878851 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:37.878817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" event={"ID":"545f6aec-e8b5-4bc8-8e63-d7b83f573e57","Type":"ContainerStarted","Data":"08e060b61d2ebb06f2f53476ae84372b814dc285d9898035ec37d214a3471b40"} Jul 15 15:48:38.884923 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:38.884889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" event={"ID":"545f6aec-e8b5-4bc8-8e63-d7b83f573e57","Type":"ContainerStarted","Data":"6bf7d2d77cac8b24212c05221d91b2e1b6998487bdb118cb2a03950c3644ee90"} Jul 15 15:48:38.885296 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:38.884955 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:48:38.903713 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:38.903666 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" podStartSLOduration=2.416389958 podStartE2EDuration="2.903649179s" totalImagesPullingTime="487.259221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:48:38.902201474 +0000 UTC m=+797.644972421" watchObservedRunningTime="2026-07-15 15:48:38.903649179 +0000 UTC m=+797.646420127" Jul 15 15:48:49.892222 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:48:49.892142 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c4dd9f96-zg24l" Jul 15 15:53:25.751186 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:25.751152 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:53:25.752853 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:25.751431 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" podUID="1424e12b-98d0-49d4-9ce4-927e22361e85" containerName="manager" containerID="cri-o://590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5" gracePeriod=10 Jul 15 15:53:28.797492 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:28.797462 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:53:28.948765 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:28.948682 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume\") pod \"1424e12b-98d0-49d4-9ce4-927e22361e85\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " Jul 15 15:53:28.948922 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:28.948788 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86tg2\" (UniqueName: \"kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2\") pod \"1424e12b-98d0-49d4-9ce4-927e22361e85\" (UID: \"1424e12b-98d0-49d4-9ce4-927e22361e85\") " Jul 15 15:53:28.949058 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:28.949027 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1424e12b-98d0-49d4-9ce4-927e22361e85" (UID: "1424e12b-98d0-49d4-9ce4-927e22361e85"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:53:28.950655 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:28.950635 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2" (OuterVolumeSpecName: "kube-api-access-86tg2") pod "1424e12b-98d0-49d4-9ce4-927e22361e85" (UID: "1424e12b-98d0-49d4-9ce4-927e22361e85"). InnerVolumeSpecName "kube-api-access-86tg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:53:29.049727 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.049695 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1424e12b-98d0-49d4-9ce4-927e22361e85-extensions-socket-volume\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:53:29.049727 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.049722 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86tg2\" (UniqueName: \"kubernetes.io/projected/1424e12b-98d0-49d4-9ce4-927e22361e85-kube-api-access-86tg2\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 15:53:29.211327 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.211225 2554 generic.go:356] "Generic (PLEG): container finished" podID="1424e12b-98d0-49d4-9ce4-927e22361e85" containerID="590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5" exitCode=0 Jul 15 15:53:29.211327 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.211282 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" Jul 15 15:53:29.211584 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.211320 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" event={"ID":"1424e12b-98d0-49d4-9ce4-927e22361e85","Type":"ContainerDied","Data":"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5"} Jul 15 15:53:29.211584 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.211406 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx" event={"ID":"1424e12b-98d0-49d4-9ce4-927e22361e85","Type":"ContainerDied","Data":"a9aba6e99b7cc829d2c240e1612928a84fa5c328be36ced5dc68b1d4bab688a3"} Jul 15 15:53:29.211584 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.211436 2554 scope.go:117] "RemoveContainer" containerID="590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5" Jul 15 15:53:29.222206 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.222179 2554 scope.go:117] "RemoveContainer" containerID="590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5" Jul 15 15:53:29.222443 ip-10-0-132-85 kubenswrapper[2554]: E0715 15:53:29.222423 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5\": container with ID starting with 590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5 not found: ID does not exist" containerID="590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5" Jul 15 15:53:29.222523 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.222454 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5"} err="failed to get container status \"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5\": rpc error: code = NotFound desc = could not find container \"590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5\": container with ID starting with 590ec1e734bdf527a952dfb1b5ad9cb9ed2008305226bed39e1e920f0a9160c5 not found: ID does not exist" Jul 15 15:53:29.233202 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.233180 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:53:29.237362 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.237342 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h84sx"] Jul 15 15:53:29.537777 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:53:29.537685 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1424e12b-98d0-49d4-9ce4-927e22361e85" path="/var/lib/kubelet/pods/1424e12b-98d0-49d4-9ce4-927e22361e85/volumes" Jul 15 15:54:26.903062 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.903024 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2"] Jul 15 15:54:26.903452 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.903395 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1424e12b-98d0-49d4-9ce4-927e22361e85" containerName="manager" Jul 15 15:54:26.903452 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.903408 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1424e12b-98d0-49d4-9ce4-927e22361e85" containerName="manager" Jul 15 15:54:26.903555 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.903467 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1424e12b-98d0-49d4-9ce4-927e22361e85" containerName="manager" Jul 15 15:54:26.907862 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.907844 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:26.911682 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.911660 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsq6x\"" Jul 15 15:54:26.919164 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.919142 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2"] Jul 15 15:54:26.953931 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.953892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5h9r\" (UniqueName: \"kubernetes.io/projected/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-kube-api-access-v5h9r\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:26.954080 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:26.953956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.054311 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.054275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5h9r\" (UniqueName: \"kubernetes.io/projected/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-kube-api-access-v5h9r\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.054497 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.054368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.054762 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.054742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.068440 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.068411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5h9r\" (UniqueName: \"kubernetes.io/projected/57e6ac11-507d-4891-9ae1-09f4a6b8d7c0-kube-api-access-v5h9r\") pod \"kuadrant-operator-controller-manager-86878c769f-tv9z2\" (UID: \"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.218750 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.218656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.357417 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.357393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2"] Jul 15 15:54:27.359884 ip-10-0-132-85 kubenswrapper[2554]: W0715 15:54:27.359845 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e6ac11_507d_4891_9ae1_09f4a6b8d7c0.slice/crio-d58bb01a0c7e3a461d9cc2d453f54d02df071e8678db7e34127f8830d360d020 WatchSource:0}: Error finding container d58bb01a0c7e3a461d9cc2d453f54d02df071e8678db7e34127f8830d360d020: Status 404 returned error can't find the container with id d58bb01a0c7e3a461d9cc2d453f54d02df071e8678db7e34127f8830d360d020 Jul 15 15:54:27.475622 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.475513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" event={"ID":"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0","Type":"ContainerStarted","Data":"fb906ae4b0ee50965e7106a478b8e34c27869a0e94e940a046cc73681deb7104"} Jul 15 15:54:27.475622 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.475582 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 15:54:27.475622 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.475600 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" event={"ID":"57e6ac11-507d-4891-9ae1-09f4a6b8d7c0","Type":"ContainerStarted","Data":"d58bb01a0c7e3a461d9cc2d453f54d02df071e8678db7e34127f8830d360d020"} Jul 15 15:54:27.497053 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:27.496996 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" podStartSLOduration=1.496981428 podStartE2EDuration="1.496981428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:54:27.496436732 +0000 UTC m=+1146.239207683" watchObservedRunningTime="2026-07-15 15:54:27.496981428 +0000 UTC m=+1146.239752461" Jul 15 15:54:38.482036 ip-10-0-132-85 kubenswrapper[2554]: I0715 15:54:38.482000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tv9z2" Jul 15 16:00:47.489030 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.488995 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:00:47.492880 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.492860 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.495794 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.495774 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-08a5731c-serving-cert\"" Jul 15 16:00:47.503708 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.503679 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:00:47.580361 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.580320 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzt2m\" (UniqueName: \"kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.580632 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.580608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.580731 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.580696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.682035 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.681999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.682245 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.682104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzt2m\" (UniqueName: \"kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.682245 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.682151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.682245 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:00:47.682186 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-serving-cert: secret "maas-api-e2e-ait-08a5731c-serving-cert" not found Jul 15 16:00:47.682395 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:00:47.682281 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls podName:d2d0d94c-30cd-429c-baaa-8b0552403282 nodeName:}" failed. No retries permitted until 2026-07-15 16:00:48.182257746 +0000 UTC m=+1526.925028674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls") pod "maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" (UID: "d2d0d94c-30cd-429c-baaa-8b0552403282") : secret "maas-api-e2e-ait-08a5731c-serving-cert" not found Jul 15 16:00:47.682851 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.682828 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:47.698127 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:47.698089 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzt2m\" (UniqueName: \"kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:48.186922 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:48.186888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:48.189615 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:48.189590 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") pod \"maas-api-e2e-ait-08a5731c-6b7897c496-72zm5\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:48.404689 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:48.404652 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:48.537586 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:48.537562 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:00:48.539982 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:00:48.539951 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d0d94c_30cd_429c_baaa_8b0552403282.slice/crio-89a1439cccab6778819fc0e5f5c7c2c7439728806615a8e8f0637bcbde2d0b37 WatchSource:0}: Error finding container 89a1439cccab6778819fc0e5f5c7c2c7439728806615a8e8f0637bcbde2d0b37: Status 404 returned error can't find the container with id 89a1439cccab6778819fc0e5f5c7c2c7439728806615a8e8f0637bcbde2d0b37 Jul 15 16:00:48.541236 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:48.541217 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:00:49.223143 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:49.223104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" event={"ID":"d2d0d94c-30cd-429c-baaa-8b0552403282","Type":"ContainerStarted","Data":"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0"} Jul 15 16:00:49.223331 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:49.223160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" event={"ID":"d2d0d94c-30cd-429c-baaa-8b0552403282","Type":"ContainerStarted","Data":"89a1439cccab6778819fc0e5f5c7c2c7439728806615a8e8f0637bcbde2d0b37"} Jul 15 16:00:49.223481 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:49.223454 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:00:49.242953 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:49.242905 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" podStartSLOduration=1.784593093 podStartE2EDuration="2.242892236s" totalImagesPullingTime="458.299143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:00:49.240780703 +0000 UTC m=+1527.983551650" watchObservedRunningTime="2026-07-15 16:00:49.242892236 +0000 UTC m=+1527.985663183" Jul 15 16:00:55.234935 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:00:55.234905 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:02:02.911973 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:02.911940 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:02:02.912539 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:02.912156 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" podUID="d2d0d94c-30cd-429c-baaa-8b0552403282" containerName="maas-api" containerID="cri-o://ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0" gracePeriod=30 Jul 15 16:02:03.154814 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.154791 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:02:03.222405 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.222328 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzt2m\" (UniqueName: \"kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m\") pod \"d2d0d94c-30cd-429c-baaa-8b0552403282\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " Jul 15 16:02:03.222563 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.222486 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") pod \"d2d0d94c-30cd-429c-baaa-8b0552403282\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " Jul 15 16:02:03.222563 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.222530 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca\") pod \"d2d0d94c-30cd-429c-baaa-8b0552403282\" (UID: \"d2d0d94c-30cd-429c-baaa-8b0552403282\") " Jul 15 16:02:03.222990 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.222959 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2d0d94c-30cd-429c-baaa-8b0552403282" (UID: "d2d0d94c-30cd-429c-baaa-8b0552403282"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:02:03.224551 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.224529 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m" (OuterVolumeSpecName: "kube-api-access-vzt2m") pod "d2d0d94c-30cd-429c-baaa-8b0552403282" (UID: "d2d0d94c-30cd-429c-baaa-8b0552403282"). InnerVolumeSpecName "kube-api-access-vzt2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:02:03.224831 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.224816 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2d0d94c-30cd-429c-baaa-8b0552403282" (UID: "d2d0d94c-30cd-429c-baaa-8b0552403282"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:02:03.323486 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.323456 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d0d94c-30cd-429c-baaa-8b0552403282-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:02:03.323486 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.323481 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d0d94c-30cd-429c-baaa-8b0552403282-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:02:03.323638 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.323495 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzt2m\" (UniqueName: \"kubernetes.io/projected/d2d0d94c-30cd-429c-baaa-8b0552403282-kube-api-access-vzt2m\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:02:03.564322 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.564289 2554 generic.go:356] "Generic (PLEG): container finished" podID="d2d0d94c-30cd-429c-baaa-8b0552403282" containerID="ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0" exitCode=0 Jul 15 16:02:03.564445 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.564346 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" Jul 15 16:02:03.564445 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.564354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" event={"ID":"d2d0d94c-30cd-429c-baaa-8b0552403282","Type":"ContainerDied","Data":"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0"} Jul 15 16:02:03.564445 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.564403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5" event={"ID":"d2d0d94c-30cd-429c-baaa-8b0552403282","Type":"ContainerDied","Data":"89a1439cccab6778819fc0e5f5c7c2c7439728806615a8e8f0637bcbde2d0b37"} Jul 15 16:02:03.564445 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.564432 2554 scope.go:117] "RemoveContainer" containerID="ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0" Jul 15 16:02:03.572938 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.572916 2554 scope.go:117] "RemoveContainer" containerID="ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0" Jul 15 16:02:03.573182 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:02:03.573162 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0\": container with ID starting with ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0 not found: ID does not exist" containerID="ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0" Jul 15 16:02:03.573246 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.573193 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0"} err="failed to get container status \"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0\": rpc error: code = NotFound desc = could not find container \"ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0\": container with ID starting with ec108a094275257750c6abace7c0b6f8dae6373776d72b4afafe474a59fd13c0 not found: ID does not exist" Jul 15 16:02:03.593745 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.593722 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:02:03.599380 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:03.599358 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08a5731c-6b7897c496-72zm5"] Jul 15 16:02:05.537475 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:05.537438 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d0d94c-30cd-429c-baaa-8b0552403282" path="/var/lib/kubelet/pods/d2d0d94c-30cd-429c-baaa-8b0552403282/volumes" Jul 15 16:02:19.789633 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.789601 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:02:19.790035 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.789960 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d0d94c-30cd-429c-baaa-8b0552403282" containerName="maas-api" Jul 15 16:02:19.790035 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.789972 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d0d94c-30cd-429c-baaa-8b0552403282" containerName="maas-api" Jul 15 16:02:19.790035 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.790031 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d0d94c-30cd-429c-baaa-8b0552403282" containerName="maas-api" Jul 15 16:02:19.794291 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.794268 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:19.797139 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.797112 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f9b8f1b9-serving-cert\"" Jul 15 16:02:19.805218 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.805191 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:02:19.968747 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.968714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:19.968747 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.968748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8jh\" (UniqueName: \"kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:19.968942 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:19.968831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.069904 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.069829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.069904 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.069864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8jh\" (UniqueName: \"kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.070073 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.069916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.070557 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.070536 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.072141 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.072120 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.078867 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.078844 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8jh\" (UniqueName: \"kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh\") pod \"maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.107452 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.107429 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:20.239491 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.239465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:02:20.241700 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:02:20.241660 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93ba16f_c746_480a_a734_8742e3cef1dd.slice/crio-6cf9f419dfb4cc9f8dbbb7cb737e5d784c6dcccb6d71a124d736bbdf84f44a2e WatchSource:0}: Error finding container 6cf9f419dfb4cc9f8dbbb7cb737e5d784c6dcccb6d71a124d736bbdf84f44a2e: Status 404 returned error can't find the container with id 6cf9f419dfb4cc9f8dbbb7cb737e5d784c6dcccb6d71a124d736bbdf84f44a2e Jul 15 16:02:20.640024 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:20.639989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" event={"ID":"a93ba16f-c746-480a-a734-8742e3cef1dd","Type":"ContainerStarted","Data":"6cf9f419dfb4cc9f8dbbb7cb737e5d784c6dcccb6d71a124d736bbdf84f44a2e"} Jul 15 16:02:23.654324 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:23.654287 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" event={"ID":"a93ba16f-c746-480a-a734-8742e3cef1dd","Type":"ContainerStarted","Data":"862ce806001908ae7fe60c53f4c188b0a1c525aa6deb878d245e54d8ced16d09"} Jul 15 16:02:23.654727 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:23.654479 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:02:23.675425 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:23.675381 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" podStartSLOduration=1.864609042 podStartE2EDuration="4.675367039s" totalImagesPullingTime="2.810757997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:02:23.674640205 +0000 UTC m=+1622.417411153" watchObservedRunningTime="2026-07-15 16:02:23.675367039 +0000 UTC m=+1622.418137986" Jul 15 16:02:29.663909 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:02:29.663883 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:03:24.726343 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:24.726303 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:03:24.726908 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:24.726595 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" podUID="a93ba16f-c746-480a-a734-8742e3cef1dd" containerName="maas-api" containerID="cri-o://862ce806001908ae7fe60c53f4c188b0a1c525aa6deb878d245e54d8ced16d09" gracePeriod=30 Jul 15 16:03:24.925918 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:24.925885 2554 generic.go:356] "Generic (PLEG): container finished" podID="a93ba16f-c746-480a-a734-8742e3cef1dd" containerID="862ce806001908ae7fe60c53f4c188b0a1c525aa6deb878d245e54d8ced16d09" exitCode=0 Jul 15 16:03:24.926055 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:24.925944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" event={"ID":"a93ba16f-c746-480a-a734-8742e3cef1dd","Type":"ContainerDied","Data":"862ce806001908ae7fe60c53f4c188b0a1c525aa6deb878d245e54d8ced16d09"} Jul 15 16:03:24.975415 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:24.975386 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:03:25.106226 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.106205 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls\") pod \"a93ba16f-c746-480a-a734-8742e3cef1dd\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " Jul 15 16:03:25.106352 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.106236 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b8jh\" (UniqueName: \"kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh\") pod \"a93ba16f-c746-480a-a734-8742e3cef1dd\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " Jul 15 16:03:25.106397 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.106353 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca\") pod \"a93ba16f-c746-480a-a734-8742e3cef1dd\" (UID: \"a93ba16f-c746-480a-a734-8742e3cef1dd\") " Jul 15 16:03:25.106685 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.106663 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a93ba16f-c746-480a-a734-8742e3cef1dd" (UID: "a93ba16f-c746-480a-a734-8742e3cef1dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:03:25.108145 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.108121 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a93ba16f-c746-480a-a734-8742e3cef1dd" (UID: "a93ba16f-c746-480a-a734-8742e3cef1dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:03:25.108234 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.108154 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh" (OuterVolumeSpecName: "kube-api-access-7b8jh") pod "a93ba16f-c746-480a-a734-8742e3cef1dd" (UID: "a93ba16f-c746-480a-a734-8742e3cef1dd"). InnerVolumeSpecName "kube-api-access-7b8jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:03:25.207206 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.207172 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a93ba16f-c746-480a-a734-8742e3cef1dd-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:03:25.207206 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.207198 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a93ba16f-c746-480a-a734-8742e3cef1dd-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:03:25.207206 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.207207 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b8jh\" (UniqueName: \"kubernetes.io/projected/a93ba16f-c746-480a-a734-8742e3cef1dd-kube-api-access-7b8jh\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:03:25.931810 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.931785 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" Jul 15 16:03:25.932294 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.931781 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj" event={"ID":"a93ba16f-c746-480a-a734-8742e3cef1dd","Type":"ContainerDied","Data":"6cf9f419dfb4cc9f8dbbb7cb737e5d784c6dcccb6d71a124d736bbdf84f44a2e"} Jul 15 16:03:25.932294 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.931918 2554 scope.go:117] "RemoveContainer" containerID="862ce806001908ae7fe60c53f4c188b0a1c525aa6deb878d245e54d8ced16d09" Jul 15 16:03:25.949160 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.949139 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:03:25.954568 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:25.954547 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f9b8f1b9-9d5d4888d-wpcnj"] Jul 15 16:03:27.537992 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:27.537961 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a93ba16f-c746-480a-a734-8742e3cef1dd" path="/var/lib/kubelet/pods/a93ba16f-c746-480a-a734-8742e3cef1dd/volumes" Jul 15 16:03:32.501854 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.501818 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:03:32.502850 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.502824 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93ba16f-c746-480a-a734-8742e3cef1dd" containerName="maas-api" Jul 15 16:03:32.502850 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.502847 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93ba16f-c746-480a-a734-8742e3cef1dd" containerName="maas-api" Jul 15 16:03:32.503035 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.502947 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a93ba16f-c746-480a-a734-8742e3cef1dd" containerName="maas-api" Jul 15 16:03:32.507720 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.507700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.510361 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.510341 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-18e9c399-serving-cert\"" Jul 15 16:03:32.517239 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.517216 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:03:32.578072 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.578040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.578218 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.578096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf2n4\" (UniqueName: \"kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.578218 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.578146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.678981 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.678952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf2n4\" (UniqueName: \"kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.679138 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.678991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.679138 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.679114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.679674 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.679653 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.681205 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.681184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.687319 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.687297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf2n4\" (UniqueName: \"kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4\") pod \"maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.818694 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.818625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:32.961914 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:32.961887 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:03:32.963905 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:03:32.963875 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b16df89_8b62_42dd_853f_02ccaefad7a7.slice/crio-38afb9852e09fbe4a2bcbab8b71ad1f0a02c6ccccaf5c5a8080155402e972680 WatchSource:0}: Error finding container 38afb9852e09fbe4a2bcbab8b71ad1f0a02c6ccccaf5c5a8080155402e972680: Status 404 returned error can't find the container with id 38afb9852e09fbe4a2bcbab8b71ad1f0a02c6ccccaf5c5a8080155402e972680 Jul 15 16:03:33.970628 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:33.970534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" event={"ID":"8b16df89-8b62-42dd-853f-02ccaefad7a7","Type":"ContainerStarted","Data":"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde"} Jul 15 16:03:33.971043 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:33.970732 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:03:33.971043 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:33.970755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" event={"ID":"8b16df89-8b62-42dd-853f-02ccaefad7a7","Type":"ContainerStarted","Data":"38afb9852e09fbe4a2bcbab8b71ad1f0a02c6ccccaf5c5a8080155402e972680"} Jul 15 16:03:33.992377 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:33.992334 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" podStartSLOduration=1.347986441 podStartE2EDuration="1.992320138s" totalImagesPullingTime="644.333697ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:03:33.990134235 +0000 UTC m=+1692.732905185" watchObservedRunningTime="2026-07-15 16:03:33.992320138 +0000 UTC m=+1692.735091138" Jul 15 16:03:39.981075 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:03:39.981047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:04:37.980304 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:37.980272 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:04:37.980733 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:37.980517 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" podUID="8b16df89-8b62-42dd-853f-02ccaefad7a7" containerName="maas-api" containerID="cri-o://b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde" gracePeriod=30 Jul 15 16:04:38.225417 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.225391 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:04:38.266815 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.266732 2554 generic.go:356] "Generic (PLEG): container finished" podID="8b16df89-8b62-42dd-853f-02ccaefad7a7" containerID="b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde" exitCode=0 Jul 15 16:04:38.266815 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.266779 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" Jul 15 16:04:38.266815 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.266789 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" event={"ID":"8b16df89-8b62-42dd-853f-02ccaefad7a7","Type":"ContainerDied","Data":"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde"} Jul 15 16:04:38.267030 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.266870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp" event={"ID":"8b16df89-8b62-42dd-853f-02ccaefad7a7","Type":"ContainerDied","Data":"38afb9852e09fbe4a2bcbab8b71ad1f0a02c6ccccaf5c5a8080155402e972680"} Jul 15 16:04:38.267030 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.266897 2554 scope.go:117] "RemoveContainer" containerID="b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde" Jul 15 16:04:38.275224 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.275206 2554 scope.go:117] "RemoveContainer" containerID="b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde" Jul 15 16:04:38.275548 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:04:38.275530 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde\": container with ID starting with b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde not found: ID does not exist" containerID="b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde" Jul 15 16:04:38.275614 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.275556 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde"} err="failed to get container status \"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde\": rpc error: code = NotFound desc = could not find container \"b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde\": container with ID starting with b0c400791025eb8c7746dfaf53b88662c16d21564734a0f968c0ffa260c2abde not found: ID does not exist" Jul 15 16:04:38.326745 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.326714 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca\") pod \"8b16df89-8b62-42dd-853f-02ccaefad7a7\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " Jul 15 16:04:38.326911 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.326756 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls\") pod \"8b16df89-8b62-42dd-853f-02ccaefad7a7\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " Jul 15 16:04:38.326911 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.326785 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf2n4\" (UniqueName: \"kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4\") pod \"8b16df89-8b62-42dd-853f-02ccaefad7a7\" (UID: \"8b16df89-8b62-42dd-853f-02ccaefad7a7\") " Jul 15 16:04:38.327095 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.327070 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b16df89-8b62-42dd-853f-02ccaefad7a7" (UID: "8b16df89-8b62-42dd-853f-02ccaefad7a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:04:38.328913 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.328883 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4" (OuterVolumeSpecName: "kube-api-access-zf2n4") pod "8b16df89-8b62-42dd-853f-02ccaefad7a7" (UID: "8b16df89-8b62-42dd-853f-02ccaefad7a7"). InnerVolumeSpecName "kube-api-access-zf2n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:04:38.328913 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.328888 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b16df89-8b62-42dd-853f-02ccaefad7a7" (UID: "8b16df89-8b62-42dd-853f-02ccaefad7a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:04:38.427775 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.427731 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b16df89-8b62-42dd-853f-02ccaefad7a7-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:04:38.427775 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.427773 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b16df89-8b62-42dd-853f-02ccaefad7a7-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:04:38.427967 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.427787 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf2n4\" (UniqueName: \"kubernetes.io/projected/8b16df89-8b62-42dd-853f-02ccaefad7a7-kube-api-access-zf2n4\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:04:38.593267 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.593233 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:04:38.599517 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:38.599480 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-18e9c399-b79f58ddc-st7sp"] Jul 15 16:04:39.538009 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:39.537974 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b16df89-8b62-42dd-853f-02ccaefad7a7" path="/var/lib/kubelet/pods/8b16df89-8b62-42dd-853f-02ccaefad7a7/volumes" Jul 15 16:04:55.423738 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.423709 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:04:55.424165 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.424077 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b16df89-8b62-42dd-853f-02ccaefad7a7" containerName="maas-api" Jul 15 16:04:55.424165 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.424089 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b16df89-8b62-42dd-853f-02ccaefad7a7" containerName="maas-api" Jul 15 16:04:55.424165 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.424161 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b16df89-8b62-42dd-853f-02ccaefad7a7" containerName="maas-api" Jul 15 16:04:55.427409 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.427387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.430101 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.430081 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5299c21f-serving-cert\"" Jul 15 16:04:55.448105 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.448075 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:04:55.573568 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.573536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.573749 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.573581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.573749 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.573698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56qg4\" (UniqueName: \"kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.675299 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.675203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.675299 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.675256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.675573 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.675343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56qg4\" (UniqueName: \"kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.676070 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.676045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.677733 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.677714 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.696309 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.696277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56qg4\" (UniqueName: \"kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4\") pod \"maas-api-e2e-derive-5299c21f-778798746-bbvv9\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.739737 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.739704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:55.882343 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:55.882319 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:04:55.884632 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:04:55.884600 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222bc176_1cab_41a8_86b8_88f267a94d6d.slice/crio-22eafd85171b8c1462088c573e7287529f783aa60113322bf42a679fb06aa378 WatchSource:0}: Error finding container 22eafd85171b8c1462088c573e7287529f783aa60113322bf42a679fb06aa378: Status 404 returned error can't find the container with id 22eafd85171b8c1462088c573e7287529f783aa60113322bf42a679fb06aa378 Jul 15 16:04:56.348448 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:56.348412 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" event={"ID":"222bc176-1cab-41a8-86b8-88f267a94d6d","Type":"ContainerStarted","Data":"22eafd85171b8c1462088c573e7287529f783aa60113322bf42a679fb06aa378"} Jul 15 16:04:57.354245 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:57.354211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" event={"ID":"222bc176-1cab-41a8-86b8-88f267a94d6d","Type":"ContainerStarted","Data":"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e"} Jul 15 16:04:57.354653 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:57.354343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:04:57.372392 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:04:57.372348 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" podStartSLOduration=1.874389106 podStartE2EDuration="2.372333287s" totalImagesPullingTime="497.944181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:04:57.371449167 +0000 UTC m=+1776.114220117" watchObservedRunningTime="2026-07-15 16:04:57.372333287 +0000 UTC m=+1776.115104262" Jul 15 16:05:03.366199 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:05:03.366171 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:06:00.102617 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.102585 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:06:00.103101 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.102802 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" podUID="222bc176-1cab-41a8-86b8-88f267a94d6d" containerName="maas-api" containerID="cri-o://d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e" gracePeriod=30 Jul 15 16:06:00.342042 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.342017 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:06:00.533559 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.533449 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls\") pod \"222bc176-1cab-41a8-86b8-88f267a94d6d\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " Jul 15 16:06:00.533736 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.533562 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca\") pod \"222bc176-1cab-41a8-86b8-88f267a94d6d\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " Jul 15 16:06:00.533736 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.533601 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56qg4\" (UniqueName: \"kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4\") pod \"222bc176-1cab-41a8-86b8-88f267a94d6d\" (UID: \"222bc176-1cab-41a8-86b8-88f267a94d6d\") " Jul 15 16:06:00.533962 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.533935 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "222bc176-1cab-41a8-86b8-88f267a94d6d" (UID: "222bc176-1cab-41a8-86b8-88f267a94d6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:06:00.535586 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.535564 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4" (OuterVolumeSpecName: "kube-api-access-56qg4") pod "222bc176-1cab-41a8-86b8-88f267a94d6d" (UID: "222bc176-1cab-41a8-86b8-88f267a94d6d"). InnerVolumeSpecName "kube-api-access-56qg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:06:00.535726 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.535704 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "222bc176-1cab-41a8-86b8-88f267a94d6d" (UID: "222bc176-1cab-41a8-86b8-88f267a94d6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:06:00.634923 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.634886 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/222bc176-1cab-41a8-86b8-88f267a94d6d-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:06:00.634923 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.634918 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56qg4\" (UniqueName: \"kubernetes.io/projected/222bc176-1cab-41a8-86b8-88f267a94d6d-kube-api-access-56qg4\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:06:00.634923 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.634928 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/222bc176-1cab-41a8-86b8-88f267a94d6d-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:06:00.649577 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.649544 2554 generic.go:356] "Generic (PLEG): container finished" podID="222bc176-1cab-41a8-86b8-88f267a94d6d" containerID="d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e" exitCode=0 Jul 15 16:06:00.649708 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.649594 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" Jul 15 16:06:00.649708 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.649624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" event={"ID":"222bc176-1cab-41a8-86b8-88f267a94d6d","Type":"ContainerDied","Data":"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e"} Jul 15 16:06:00.649708 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.649675 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9" event={"ID":"222bc176-1cab-41a8-86b8-88f267a94d6d","Type":"ContainerDied","Data":"22eafd85171b8c1462088c573e7287529f783aa60113322bf42a679fb06aa378"} Jul 15 16:06:00.649708 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.649696 2554 scope.go:117] "RemoveContainer" containerID="d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e" Jul 15 16:06:00.658084 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.658068 2554 scope.go:117] "RemoveContainer" containerID="d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e" Jul 15 16:06:00.658345 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:06:00.658327 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e\": container with ID starting with d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e not found: ID does not exist" containerID="d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e" Jul 15 16:06:00.658399 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.658358 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e"} err="failed to get container status \"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e\": rpc error: code = NotFound desc = could not find container \"d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e\": container with ID starting with d5994952b61c19635cab3740f80cc05396508711f93301c9f0979a6342b40f0e not found: ID does not exist" Jul 15 16:06:00.671279 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.671255 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:06:00.675242 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:00.675224 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5299c21f-778798746-bbvv9"] Jul 15 16:06:01.537301 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:06:01.537266 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="222bc176-1cab-41a8-86b8-88f267a94d6d" path="/var/lib/kubelet/pods/222bc176-1cab-41a8-86b8-88f267a94d6d/volumes" Jul 15 16:07:57.795315 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.795268 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:07:57.796266 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.796239 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222bc176-1cab-41a8-86b8-88f267a94d6d" containerName="maas-api" Jul 15 16:07:57.796362 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.796272 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="222bc176-1cab-41a8-86b8-88f267a94d6d" containerName="maas-api" Jul 15 16:07:57.796482 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.796469 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="222bc176-1cab-41a8-86b8-88f267a94d6d" containerName="maas-api" Jul 15 16:07:57.801484 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.801459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.804194 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.804174 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b2c9c91f-serving-cert\"" Jul 15 16:07:57.808660 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.808636 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:07:57.889887 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.889848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.890072 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.889926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnds\" (UniqueName: \"kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.890072 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.889977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.990546 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.990493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.990694 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.990612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnds\" (UniqueName: \"kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.990694 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.990676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.991229 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.991210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:57.993100 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:57.993078 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:58.000114 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:58.000094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnds\" (UniqueName: \"kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds\") pod \"maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:58.113971 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:58.113932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:07:58.251124 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:58.251095 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:07:58.254740 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:07:58.254702 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a9fd27_548b_4a1e_a4ac_a9de122175c1.slice/crio-9c7ee1dd1f0584aac02a20f42378c6816fe50c8e5873872352dcff40bed2cf9d WatchSource:0}: Error finding container 9c7ee1dd1f0584aac02a20f42378c6816fe50c8e5873872352dcff40bed2cf9d: Status 404 returned error can't find the container with id 9c7ee1dd1f0584aac02a20f42378c6816fe50c8e5873872352dcff40bed2cf9d Jul 15 16:07:58.256418 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:58.256399 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:07:59.180051 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:07:59.180012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" event={"ID":"55a9fd27-548b-4a1e-a4ac-a9de122175c1","Type":"ContainerStarted","Data":"9c7ee1dd1f0584aac02a20f42378c6816fe50c8e5873872352dcff40bed2cf9d"} Jul 15 16:08:00.185575 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:00.185540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" event={"ID":"55a9fd27-548b-4a1e-a4ac-a9de122175c1","Type":"ContainerStarted","Data":"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c"} Jul 15 16:08:00.185960 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:00.185646 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:08:00.205512 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:00.205465 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" podStartSLOduration=2.09968249 podStartE2EDuration="3.20544994s" totalImagesPullingTime="1.10576745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:08:00.204672364 +0000 UTC m=+1958.947443312" watchObservedRunningTime="2026-07-15 16:08:00.20544994 +0000 UTC m=+1958.948220886" Jul 15 16:08:06.195364 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:06.195335 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:08:20.018973 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.018922 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:08:20.019903 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.019870 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" podUID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" containerName="maas-api" containerID="cri-o://4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c" gracePeriod=30 Jul 15 16:08:20.266634 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.266608 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:08:20.276211 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.276153 2554 generic.go:356] "Generic (PLEG): container finished" podID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" containerID="4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c" exitCode=0 Jul 15 16:08:20.276211 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.276190 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" Jul 15 16:08:20.276352 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.276203 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" event={"ID":"55a9fd27-548b-4a1e-a4ac-a9de122175c1","Type":"ContainerDied","Data":"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c"} Jul 15 16:08:20.276352 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.276268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4" event={"ID":"55a9fd27-548b-4a1e-a4ac-a9de122175c1","Type":"ContainerDied","Data":"9c7ee1dd1f0584aac02a20f42378c6816fe50c8e5873872352dcff40bed2cf9d"} Jul 15 16:08:20.276352 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.276301 2554 scope.go:117] "RemoveContainer" containerID="4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c" Jul 15 16:08:20.286457 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.286437 2554 scope.go:117] "RemoveContainer" containerID="4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c" Jul 15 16:08:20.286886 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:08:20.286856 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c\": container with ID starting with 4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c not found: ID does not exist" containerID="4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c" Jul 15 16:08:20.286985 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.286891 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c"} err="failed to get container status \"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c\": rpc error: code = NotFound desc = could not find container \"4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c\": container with ID starting with 4a8c7bc384d212f245baf36d5973b5050497fe68c8b9036165317ce87f45ed6c not found: ID does not exist" Jul 15 16:08:20.358817 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.358791 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca\") pod \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " Jul 15 16:08:20.358962 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.358834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpnds\" (UniqueName: \"kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds\") pod \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " Jul 15 16:08:20.358962 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.358877 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls\") pod \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\" (UID: \"55a9fd27-548b-4a1e-a4ac-a9de122175c1\") " Jul 15 16:08:20.359122 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.359100 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55a9fd27-548b-4a1e-a4ac-a9de122175c1" (UID: "55a9fd27-548b-4a1e-a4ac-a9de122175c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:08:20.360914 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.360884 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55a9fd27-548b-4a1e-a4ac-a9de122175c1" (UID: "55a9fd27-548b-4a1e-a4ac-a9de122175c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:08:20.361022 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.360959 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds" (OuterVolumeSpecName: "kube-api-access-kpnds") pod "55a9fd27-548b-4a1e-a4ac-a9de122175c1" (UID: "55a9fd27-548b-4a1e-a4ac-a9de122175c1"). InnerVolumeSpecName "kube-api-access-kpnds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:08:20.459685 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.459659 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55a9fd27-548b-4a1e-a4ac-a9de122175c1-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:08:20.459685 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.459684 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpnds\" (UniqueName: \"kubernetes.io/projected/55a9fd27-548b-4a1e-a4ac-a9de122175c1-kube-api-access-kpnds\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:08:20.459838 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.459697 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55a9fd27-548b-4a1e-a4ac-a9de122175c1-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:08:20.600131 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.600101 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:08:20.605813 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:20.605788 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2c9c91f-665667d564-5x9z4"] Jul 15 16:08:21.543167 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:21.543130 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" path="/var/lib/kubelet/pods/55a9fd27-548b-4a1e-a4ac-a9de122175c1/volumes" Jul 15 16:08:58.994597 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:58.994561 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:08:58.995155 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:58.995095 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" containerName="maas-api" Jul 15 16:08:58.995155 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:58.995113 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" containerName="maas-api" Jul 15 16:08:58.995260 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:58.995208 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a9fd27-548b-4a1e-a4ac-a9de122175c1" containerName="maas-api" Jul 15 16:08:58.998428 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:58.998409 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.002940 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.002917 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b9b40333-serving-cert\"" Jul 15 16:08:59.015594 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.015573 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:08:59.095658 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.095615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.095658 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.095660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcfn2\" (UniqueName: \"kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.095871 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.095695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.196478 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.196447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.196478 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.196481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcfn2\" (UniqueName: \"kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.196717 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.196522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.196717 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:08:59.196613 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-serving-cert: secret "maas-api-e2e-mt-b9b40333-serving-cert" not found Jul 15 16:08:59.196717 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:08:59.196700 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls podName:f06b6924-c530-419d-8ac0-25d62f3874c2 nodeName:}" failed. No retries permitted until 2026-07-15 16:08:59.696678096 +0000 UTC m=+2018.439449029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls") pod "maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" (UID: "f06b6924-c530-419d-8ac0-25d62f3874c2") : secret "maas-api-e2e-mt-b9b40333-serving-cert" not found Jul 15 16:08:59.197163 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.197135 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.206062 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.206040 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcfn2\" (UniqueName: \"kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.701436 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.701393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.703977 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.703951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") pod \"maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:08:59.909677 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:08:59.909641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:09:00.042183 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:00.042153 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:09:00.044138 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:09:00.044103 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06b6924_c530_419d_8ac0_25d62f3874c2.slice/crio-b280c4583bf75c688f71f45b0c7af5123cb92a0a5eff91507d42c8049e74544b WatchSource:0}: Error finding container b280c4583bf75c688f71f45b0c7af5123cb92a0a5eff91507d42c8049e74544b: Status 404 returned error can't find the container with id b280c4583bf75c688f71f45b0c7af5123cb92a0a5eff91507d42c8049e74544b Jul 15 16:09:00.468033 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:00.467999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" event={"ID":"f06b6924-c530-419d-8ac0-25d62f3874c2","Type":"ContainerStarted","Data":"b280c4583bf75c688f71f45b0c7af5123cb92a0a5eff91507d42c8049e74544b"} Jul 15 16:09:02.479210 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:02.479173 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" event={"ID":"f06b6924-c530-419d-8ac0-25d62f3874c2","Type":"ContainerStarted","Data":"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd"} Jul 15 16:09:02.479671 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:02.479250 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:09:02.498657 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:02.498616 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" podStartSLOduration=2.6712804759999997 podStartE2EDuration="4.498601535s" totalImagesPullingTime="1.827321059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:09:02.497958586 +0000 UTC m=+2021.240729535" watchObservedRunningTime="2026-07-15 16:09:02.498601535 +0000 UTC m=+2021.241372487" Jul 15 16:09:08.489180 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:09:08.489151 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:10:07.672936 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.672893 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:10:07.673463 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.673119 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" podUID="f06b6924-c530-419d-8ac0-25d62f3874c2" containerName="maas-api" containerID="cri-o://8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd" gracePeriod=30 Jul 15 16:10:07.920936 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.920911 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:10:07.981423 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.981362 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") pod \"f06b6924-c530-419d-8ac0-25d62f3874c2\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " Jul 15 16:10:07.981547 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.981452 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca\") pod \"f06b6924-c530-419d-8ac0-25d62f3874c2\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " Jul 15 16:10:07.981547 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.981515 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcfn2\" (UniqueName: \"kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2\") pod \"f06b6924-c530-419d-8ac0-25d62f3874c2\" (UID: \"f06b6924-c530-419d-8ac0-25d62f3874c2\") " Jul 15 16:10:07.981846 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.981821 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f06b6924-c530-419d-8ac0-25d62f3874c2" (UID: "f06b6924-c530-419d-8ac0-25d62f3874c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:10:07.983369 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.983342 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2" (OuterVolumeSpecName: "kube-api-access-xcfn2") pod "f06b6924-c530-419d-8ac0-25d62f3874c2" (UID: "f06b6924-c530-419d-8ac0-25d62f3874c2"). InnerVolumeSpecName "kube-api-access-xcfn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:10:07.983459 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:07.983380 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f06b6924-c530-419d-8ac0-25d62f3874c2" (UID: "f06b6924-c530-419d-8ac0-25d62f3874c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:10:08.082704 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.082681 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcfn2\" (UniqueName: \"kubernetes.io/projected/f06b6924-c530-419d-8ac0-25d62f3874c2-kube-api-access-xcfn2\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:10:08.082809 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.082706 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06b6924-c530-419d-8ac0-25d62f3874c2-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:10:08.082809 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.082718 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06b6924-c530-419d-8ac0-25d62f3874c2-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:10:08.775684 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.775654 2554 generic.go:356] "Generic (PLEG): container finished" podID="f06b6924-c530-419d-8ac0-25d62f3874c2" containerID="8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd" exitCode=0 Jul 15 16:10:08.776152 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.775700 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" Jul 15 16:10:08.776152 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.775720 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" event={"ID":"f06b6924-c530-419d-8ac0-25d62f3874c2","Type":"ContainerDied","Data":"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd"} Jul 15 16:10:08.776152 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.775758 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r" event={"ID":"f06b6924-c530-419d-8ac0-25d62f3874c2","Type":"ContainerDied","Data":"b280c4583bf75c688f71f45b0c7af5123cb92a0a5eff91507d42c8049e74544b"} Jul 15 16:10:08.776152 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.775778 2554 scope.go:117] "RemoveContainer" containerID="8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd" Jul 15 16:10:08.784372 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.784355 2554 scope.go:117] "RemoveContainer" containerID="8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd" Jul 15 16:10:08.784641 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:10:08.784623 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd\": container with ID starting with 8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd not found: ID does not exist" containerID="8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd" Jul 15 16:10:08.784735 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.784652 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd"} err="failed to get container status \"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd\": rpc error: code = NotFound desc = could not find container \"8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd\": container with ID starting with 8a91c522339b96b2293125a993947f22ac6d661050bd71d5c689702e1aa1afbd not found: ID does not exist" Jul 15 16:10:08.798148 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.798123 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:10:08.805638 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:08.805613 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b40333-585cdd7f-dfr5r"] Jul 15 16:10:09.537410 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:10:09.537372 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f06b6924-c530-419d-8ac0-25d62f3874c2" path="/var/lib/kubelet/pods/f06b6924-c530-419d-8ac0-25d62f3874c2/volumes" Jul 15 16:12:03.915639 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.915602 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:12:03.916142 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.915946 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06b6924-c530-419d-8ac0-25d62f3874c2" containerName="maas-api" Jul 15 16:12:03.916142 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.915958 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06b6924-c530-419d-8ac0-25d62f3874c2" containerName="maas-api" Jul 15 16:12:03.916142 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.916027 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06b6924-c530-419d-8ac0-25d62f3874c2" containerName="maas-api" Jul 15 16:12:03.919112 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.919089 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:03.922523 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.922480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-24e47f-serving-cert\"" Jul 15 16:12:03.940889 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.940843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:12:03.969308 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.969273 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:03.969308 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.969311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swwdn\" (UniqueName: \"kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:03.969594 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:03.969475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.070836 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.070789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.071054 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.070848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.071054 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.070866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swwdn\" (UniqueName: \"kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.071054 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:12:04.070975 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-serving-cert: secret "maas-api-e2e-inf-a-24e47f-serving-cert" not found Jul 15 16:12:04.071218 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:12:04.071070 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls podName:cd384660-0241-4927-9569-3bd513b71dee nodeName:}" failed. No retries permitted until 2026-07-15 16:12:04.57104686 +0000 UTC m=+2203.313817787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls") pod "maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" (UID: "cd384660-0241-4927-9569-3bd513b71dee") : secret "maas-api-e2e-inf-a-24e47f-serving-cert" not found Jul 15 16:12:04.071700 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.071677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.089336 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.089301 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swwdn\" (UniqueName: \"kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.576547 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.576477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.578826 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.578803 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") pod \"maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.835407 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.835316 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:04.980751 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:04.980726 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:12:04.983174 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:12:04.983145 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd384660_0241_4927_9569_3bd513b71dee.slice/crio-4e1408dbfba119aabe08428a30d2ef6592f4e34547f1f760466e73953103b556 WatchSource:0}: Error finding container 4e1408dbfba119aabe08428a30d2ef6592f4e34547f1f760466e73953103b556: Status 404 returned error can't find the container with id 4e1408dbfba119aabe08428a30d2ef6592f4e34547f1f760466e73953103b556 Jul 15 16:12:05.296541 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:05.296483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" event={"ID":"cd384660-0241-4927-9569-3bd513b71dee","Type":"ContainerStarted","Data":"4e1408dbfba119aabe08428a30d2ef6592f4e34547f1f760466e73953103b556"} Jul 15 16:12:06.302397 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:06.302359 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" event={"ID":"cd384660-0241-4927-9569-3bd513b71dee","Type":"ContainerStarted","Data":"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441"} Jul 15 16:12:06.302801 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:06.302468 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:06.334680 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:06.334301 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" podStartSLOduration=2.634714275 podStartE2EDuration="3.334281274s" totalImagesPullingTime="699.566999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:06.33418716 +0000 UTC m=+2205.076958107" watchObservedRunningTime="2026-07-15 16:12:06.334281274 +0000 UTC m=+2205.077052224" Jul 15 16:12:12.005618 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.005583 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:12:12.009638 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.009614 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.013372 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.013351 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a84db0-serving-cert\"" Jul 15 16:12:12.022641 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.022616 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:12:12.146597 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.146564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.146784 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.146629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpctc\" (UniqueName: \"kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.146784 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.146675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.248061 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.248018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.248265 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.248109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.248265 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.248165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpctc\" (UniqueName: \"kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.248818 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.248794 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.250644 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.250602 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.259056 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.259003 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpctc\" (UniqueName: \"kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc\") pod \"maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.312937 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.312910 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:12:12.323121 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.323091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:12.474642 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:12.474616 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:12:12.477187 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:12:12.477162 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920dcd4c_280c_4107_ac1d_db2a716259f3.slice/crio-6ed064120057fac6190e8a61091083d3bbb33b2d462bb4aefaa7ee46797b6763 WatchSource:0}: Error finding container 6ed064120057fac6190e8a61091083d3bbb33b2d462bb4aefaa7ee46797b6763: Status 404 returned error can't find the container with id 6ed064120057fac6190e8a61091083d3bbb33b2d462bb4aefaa7ee46797b6763 Jul 15 16:12:13.336052 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:13.336014 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" event={"ID":"920dcd4c-280c-4107-ac1d-db2a716259f3","Type":"ContainerStarted","Data":"23ce7c979223b47231821d89ab0d7e9d78cbd16507ab541ae2884fcc2d77a55d"} Jul 15 16:12:13.336453 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:13.336064 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" event={"ID":"920dcd4c-280c-4107-ac1d-db2a716259f3","Type":"ContainerStarted","Data":"6ed064120057fac6190e8a61091083d3bbb33b2d462bb4aefaa7ee46797b6763"} Jul 15 16:12:13.336453 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:13.336094 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:12:13.357753 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:13.357700 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" podStartSLOduration=2.029090445 podStartE2EDuration="2.35767959s" totalImagesPullingTime="328.589145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:13.356614398 +0000 UTC m=+2212.099385345" watchObservedRunningTime="2026-07-15 16:12:13.35767959 +0000 UTC m=+2212.100450539" Jul 15 16:12:19.348813 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:12:19.348785 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:13:31.451543 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.451493 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:13:31.452136 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.451816 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" podUID="cd384660-0241-4927-9569-3bd513b71dee" containerName="maas-api" containerID="cri-o://d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441" gracePeriod=30 Jul 15 16:13:31.700884 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.700858 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:13:31.712148 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.712088 2554 generic.go:356] "Generic (PLEG): container finished" podID="cd384660-0241-4927-9569-3bd513b71dee" containerID="d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441" exitCode=0 Jul 15 16:13:31.712148 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.712116 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" Jul 15 16:13:31.712148 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.712132 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" event={"ID":"cd384660-0241-4927-9569-3bd513b71dee","Type":"ContainerDied","Data":"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441"} Jul 15 16:13:31.712312 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.712192 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4" event={"ID":"cd384660-0241-4927-9569-3bd513b71dee","Type":"ContainerDied","Data":"4e1408dbfba119aabe08428a30d2ef6592f4e34547f1f760466e73953103b556"} Jul 15 16:13:31.712312 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.712223 2554 scope.go:117] "RemoveContainer" containerID="d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441" Jul 15 16:13:31.720197 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.720177 2554 scope.go:117] "RemoveContainer" containerID="d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441" Jul 15 16:13:31.720613 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:13:31.720582 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441\": container with ID starting with d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441 not found: ID does not exist" containerID="d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441" Jul 15 16:13:31.720741 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.720623 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441"} err="failed to get container status \"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441\": rpc error: code = NotFound desc = could not find container \"d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441\": container with ID starting with d895b5e369d5819ac054ddf4287582da6643149140eca806759dc6d0bbdb3441 not found: ID does not exist" Jul 15 16:13:31.743846 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.743825 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") pod \"cd384660-0241-4927-9569-3bd513b71dee\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " Jul 15 16:13:31.743968 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.743862 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swwdn\" (UniqueName: \"kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn\") pod \"cd384660-0241-4927-9569-3bd513b71dee\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " Jul 15 16:13:31.743968 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.743880 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca\") pod \"cd384660-0241-4927-9569-3bd513b71dee\" (UID: \"cd384660-0241-4927-9569-3bd513b71dee\") " Jul 15 16:13:31.744277 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.744253 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd384660-0241-4927-9569-3bd513b71dee" (UID: "cd384660-0241-4927-9569-3bd513b71dee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:13:31.746340 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.746317 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd384660-0241-4927-9569-3bd513b71dee" (UID: "cd384660-0241-4927-9569-3bd513b71dee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:13:31.746430 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.746322 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn" (OuterVolumeSpecName: "kube-api-access-swwdn") pod "cd384660-0241-4927-9569-3bd513b71dee" (UID: "cd384660-0241-4927-9569-3bd513b71dee"). InnerVolumeSpecName "kube-api-access-swwdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:13:31.845449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.845416 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd384660-0241-4927-9569-3bd513b71dee-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:31.845449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.845443 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swwdn\" (UniqueName: \"kubernetes.io/projected/cd384660-0241-4927-9569-3bd513b71dee-kube-api-access-swwdn\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:31.845449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:31.845455 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd384660-0241-4927-9569-3bd513b71dee-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:32.034363 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:32.034330 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:13:32.036646 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:32.036625 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-24e47f-78845c77f-kpjx4"] Jul 15 16:13:33.538164 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:33.538131 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd384660-0241-4927-9569-3bd513b71dee" path="/var/lib/kubelet/pods/cd384660-0241-4927-9569-3bd513b71dee/volumes" Jul 15 16:13:57.720956 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:57.720916 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:13:57.721469 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:57.721137 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" podUID="920dcd4c-280c-4107-ac1d-db2a716259f3" containerName="maas-api" containerID="cri-o://23ce7c979223b47231821d89ab0d7e9d78cbd16507ab541ae2884fcc2d77a55d" gracePeriod=30 Jul 15 16:13:57.838677 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:57.838652 2554 generic.go:356] "Generic (PLEG): container finished" podID="920dcd4c-280c-4107-ac1d-db2a716259f3" containerID="23ce7c979223b47231821d89ab0d7e9d78cbd16507ab541ae2884fcc2d77a55d" exitCode=0 Jul 15 16:13:57.838777 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:57.838691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" event={"ID":"920dcd4c-280c-4107-ac1d-db2a716259f3","Type":"ContainerDied","Data":"23ce7c979223b47231821d89ab0d7e9d78cbd16507ab541ae2884fcc2d77a55d"} Jul 15 16:13:57.964894 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:57.964874 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:13:58.070620 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.070541 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls\") pod \"920dcd4c-280c-4107-ac1d-db2a716259f3\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " Jul 15 16:13:58.070620 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.070625 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca\") pod \"920dcd4c-280c-4107-ac1d-db2a716259f3\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " Jul 15 16:13:58.070778 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.070659 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpctc\" (UniqueName: \"kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc\") pod \"920dcd4c-280c-4107-ac1d-db2a716259f3\" (UID: \"920dcd4c-280c-4107-ac1d-db2a716259f3\") " Jul 15 16:13:58.071010 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.070979 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "920dcd4c-280c-4107-ac1d-db2a716259f3" (UID: "920dcd4c-280c-4107-ac1d-db2a716259f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:13:58.072470 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.072442 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "920dcd4c-280c-4107-ac1d-db2a716259f3" (UID: "920dcd4c-280c-4107-ac1d-db2a716259f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:13:58.072604 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.072580 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc" (OuterVolumeSpecName: "kube-api-access-mpctc") pod "920dcd4c-280c-4107-ac1d-db2a716259f3" (UID: "920dcd4c-280c-4107-ac1d-db2a716259f3"). InnerVolumeSpecName "kube-api-access-mpctc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:13:58.171687 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.171657 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920dcd4c-280c-4107-ac1d-db2a716259f3-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:58.171687 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.171681 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920dcd4c-280c-4107-ac1d-db2a716259f3-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:58.171846 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.171697 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpctc\" (UniqueName: \"kubernetes.io/projected/920dcd4c-280c-4107-ac1d-db2a716259f3-kube-api-access-mpctc\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:13:58.844789 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.844760 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" Jul 15 16:13:58.845236 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.844761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl" event={"ID":"920dcd4c-280c-4107-ac1d-db2a716259f3","Type":"ContainerDied","Data":"6ed064120057fac6190e8a61091083d3bbb33b2d462bb4aefaa7ee46797b6763"} Jul 15 16:13:58.845236 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.844914 2554 scope.go:117] "RemoveContainer" containerID="23ce7c979223b47231821d89ab0d7e9d78cbd16507ab541ae2884fcc2d77a55d" Jul 15 16:13:58.866023 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.865996 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:13:58.868335 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:58.868308 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a84db0-6487bf7c65-rffgl"] Jul 15 16:13:59.537295 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:13:59.537263 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="920dcd4c-280c-4107-ac1d-db2a716259f3" path="/var/lib/kubelet/pods/920dcd4c-280c-4107-ac1d-db2a716259f3/volumes" Jul 15 16:14:16.476327 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476236 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:16.476892 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476783 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd384660-0241-4927-9569-3bd513b71dee" containerName="maas-api" Jul 15 16:14:16.476892 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476805 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd384660-0241-4927-9569-3bd513b71dee" containerName="maas-api" Jul 15 16:14:16.476892 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476865 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="920dcd4c-280c-4107-ac1d-db2a716259f3" containerName="maas-api" Jul 15 16:14:16.476892 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476875 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="920dcd4c-280c-4107-ac1d-db2a716259f3" containerName="maas-api" Jul 15 16:14:16.477123 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476978 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd384660-0241-4927-9569-3bd513b71dee" containerName="maas-api" Jul 15 16:14:16.477123 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.476991 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="920dcd4c-280c-4107-ac1d-db2a716259f3" containerName="maas-api" Jul 15 16:14:16.481386 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.481367 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.484825 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.484805 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b896e0-serving-cert\"" Jul 15 16:14:16.494469 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.494445 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:16.521835 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.521812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnfzh\" (UniqueName: \"kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.521969 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.521853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.521969 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.521919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.623003 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.622972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnfzh\" (UniqueName: \"kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.623173 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.623023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.623173 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.623085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.623292 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:14:16.623184 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-serving-cert: secret "maas-api-e2e-api-a-b896e0-serving-cert" not found Jul 15 16:14:16.623292 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:14:16.623249 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls podName:2414401d-663e-4092-8f99-a744065afddd nodeName:}" failed. No retries permitted until 2026-07-15 16:14:17.123231095 +0000 UTC m=+2335.866002023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls") pod "maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" (UID: "2414401d-663e-4092-8f99-a744065afddd") : secret "maas-api-e2e-api-a-b896e0-serving-cert" not found Jul 15 16:14:16.623747 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.623726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:16.634469 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:16.634441 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnfzh\" (UniqueName: \"kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:17.128475 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:17.128435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:17.128681 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:14:17.128609 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-serving-cert: secret "maas-api-e2e-api-a-b896e0-serving-cert" not found Jul 15 16:14:17.128729 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:14:17.128684 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls podName:2414401d-663e-4092-8f99-a744065afddd nodeName:}" failed. No retries permitted until 2026-07-15 16:14:18.12866599 +0000 UTC m=+2336.871436930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls") pod "maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" (UID: "2414401d-663e-4092-8f99-a744065afddd") : secret "maas-api-e2e-api-a-b896e0-serving-cert" not found Jul 15 16:14:18.137569 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.137529 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:18.139907 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.139873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:18.293038 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.292999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:18.424975 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.424889 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:18.427991 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:14:18.427964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2414401d_663e_4092_8f99_a744065afddd.slice/crio-d21cfa4d0416af760ec516c701ac4f155ac80a3e09e5fad312a2b296b49e7149 WatchSource:0}: Error finding container d21cfa4d0416af760ec516c701ac4f155ac80a3e09e5fad312a2b296b49e7149: Status 404 returned error can't find the container with id d21cfa4d0416af760ec516c701ac4f155ac80a3e09e5fad312a2b296b49e7149 Jul 15 16:14:18.429296 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.429280 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:14:18.941422 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:18.941392 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" event={"ID":"2414401d-663e-4092-8f99-a744065afddd","Type":"ContainerStarted","Data":"d21cfa4d0416af760ec516c701ac4f155ac80a3e09e5fad312a2b296b49e7149"} Jul 15 16:14:19.947773 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:19.947735 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" event={"ID":"2414401d-663e-4092-8f99-a744065afddd","Type":"ContainerStarted","Data":"974fbcd8f17791feb08675f7bb2e897010507aa77422fbafa0f96bea1dfaf2ef"} Jul 15 16:14:19.948148 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:19.947845 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:19.967027 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:19.966985 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" podStartSLOduration=3.495826668 podStartE2EDuration="3.966972882s" totalImagesPullingTime="471.146214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:14:19.965345949 +0000 UTC m=+2338.708116898" watchObservedRunningTime="2026-07-15 16:14:19.966972882 +0000 UTC m=+2338.709743830" Jul 15 16:14:24.491131 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.491095 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:14:24.496614 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.496588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.499744 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.499716 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-652d3f-serving-cert\"" Jul 15 16:14:24.505940 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.505915 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:14:24.597124 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.597082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88qtg\" (UniqueName: \"kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.597300 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.597151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.597300 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.597190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.697881 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.697843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88qtg\" (UniqueName: \"kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.697881 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.697884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.698083 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.697926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.698573 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.698551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.700266 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.700249 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.706622 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.706591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88qtg\" (UniqueName: \"kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg\") pod \"maas-api-e2e-api-b-652d3f-7b889c479c-6blc6\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.808967 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.808902 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:24.947474 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.947309 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:14:24.950115 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:14:24.950071 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f3b72f_9e43_49e5_a19b_725176630f03.slice/crio-0b2d3889c6d6c1b0cd551c613821b906f0ecf49fc1e153d10d6f9bc89ad3e946 WatchSource:0}: Error finding container 0b2d3889c6d6c1b0cd551c613821b906f0ecf49fc1e153d10d6f9bc89ad3e946: Status 404 returned error can't find the container with id 0b2d3889c6d6c1b0cd551c613821b906f0ecf49fc1e153d10d6f9bc89ad3e946 Jul 15 16:14:24.972575 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:24.972537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" event={"ID":"b4f3b72f-9e43-49e5-a19b-725176630f03","Type":"ContainerStarted","Data":"0b2d3889c6d6c1b0cd551c613821b906f0ecf49fc1e153d10d6f9bc89ad3e946"} Jul 15 16:14:25.957992 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:25.957965 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:25.978016 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:25.977985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" event={"ID":"b4f3b72f-9e43-49e5-a19b-725176630f03","Type":"ContainerStarted","Data":"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d"} Jul 15 16:14:25.978167 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:25.978067 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:25.999601 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:25.999555 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" podStartSLOduration=1.684344775 podStartE2EDuration="1.999536608s" totalImagesPullingTime="315.191833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:14:25.997813011 +0000 UTC m=+2344.740583960" watchObservedRunningTime="2026-07-15 16:14:25.999536608 +0000 UTC m=+2344.742307556" Jul 15 16:14:31.989149 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:31.989113 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:14:47.925279 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:47.925246 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:47.925753 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:47.925453 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" podUID="2414401d-663e-4092-8f99-a744065afddd" containerName="maas-api" containerID="cri-o://974fbcd8f17791feb08675f7bb2e897010507aa77422fbafa0f96bea1dfaf2ef" gracePeriod=30 Jul 15 16:14:48.084949 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.084915 2554 generic.go:356] "Generic (PLEG): container finished" podID="2414401d-663e-4092-8f99-a744065afddd" containerID="974fbcd8f17791feb08675f7bb2e897010507aa77422fbafa0f96bea1dfaf2ef" exitCode=0 Jul 15 16:14:48.085106 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.084974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" event={"ID":"2414401d-663e-4092-8f99-a744065afddd","Type":"ContainerDied","Data":"974fbcd8f17791feb08675f7bb2e897010507aa77422fbafa0f96bea1dfaf2ef"} Jul 15 16:14:48.167674 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.167647 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:48.303972 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.303902 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") pod \"2414401d-663e-4092-8f99-a744065afddd\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " Jul 15 16:14:48.304118 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.303979 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnfzh\" (UniqueName: \"kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh\") pod \"2414401d-663e-4092-8f99-a744065afddd\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " Jul 15 16:14:48.304118 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.304009 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca\") pod \"2414401d-663e-4092-8f99-a744065afddd\" (UID: \"2414401d-663e-4092-8f99-a744065afddd\") " Jul 15 16:14:48.304387 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.304362 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2414401d-663e-4092-8f99-a744065afddd" (UID: "2414401d-663e-4092-8f99-a744065afddd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:14:48.305903 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.305882 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh" (OuterVolumeSpecName: "kube-api-access-nnfzh") pod "2414401d-663e-4092-8f99-a744065afddd" (UID: "2414401d-663e-4092-8f99-a744065afddd"). InnerVolumeSpecName "kube-api-access-nnfzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:14:48.305978 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.305919 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2414401d-663e-4092-8f99-a744065afddd" (UID: "2414401d-663e-4092-8f99-a744065afddd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:14:48.405234 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.405209 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2414401d-663e-4092-8f99-a744065afddd-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:14:48.405234 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.405233 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnfzh\" (UniqueName: \"kubernetes.io/projected/2414401d-663e-4092-8f99-a744065afddd-kube-api-access-nnfzh\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:14:48.405392 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:48.405244 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2414401d-663e-4092-8f99-a744065afddd-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:14:49.090619 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.090581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" event={"ID":"2414401d-663e-4092-8f99-a744065afddd","Type":"ContainerDied","Data":"d21cfa4d0416af760ec516c701ac4f155ac80a3e09e5fad312a2b296b49e7149"} Jul 15 16:14:49.090993 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.090669 2554 scope.go:117] "RemoveContainer" containerID="974fbcd8f17791feb08675f7bb2e897010507aa77422fbafa0f96bea1dfaf2ef" Jul 15 16:14:49.090993 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.090597 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg" Jul 15 16:14:49.112796 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.112769 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:49.119653 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.119634 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b896e0-59d79ddfbd-dqqmg"] Jul 15 16:14:49.537860 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:14:49.537827 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2414401d-663e-4092-8f99-a744065afddd" path="/var/lib/kubelet/pods/2414401d-663e-4092-8f99-a744065afddd/volumes" Jul 15 16:15:13.709322 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:13.709287 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:15:13.709857 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:13.709495 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" podUID="b4f3b72f-9e43-49e5-a19b-725176630f03" containerName="maas-api" containerID="cri-o://5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d" gracePeriod=30 Jul 15 16:15:13.959316 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:13.959287 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:15:14.012315 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.012248 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88qtg\" (UniqueName: \"kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg\") pod \"b4f3b72f-9e43-49e5-a19b-725176630f03\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " Jul 15 16:15:14.012315 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.012286 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls\") pod \"b4f3b72f-9e43-49e5-a19b-725176630f03\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " Jul 15 16:15:14.012538 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.012322 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca\") pod \"b4f3b72f-9e43-49e5-a19b-725176630f03\" (UID: \"b4f3b72f-9e43-49e5-a19b-725176630f03\") " Jul 15 16:15:14.012727 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.012703 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4f3b72f-9e43-49e5-a19b-725176630f03" (UID: "b4f3b72f-9e43-49e5-a19b-725176630f03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:15:14.014217 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.014190 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg" (OuterVolumeSpecName: "kube-api-access-88qtg") pod "b4f3b72f-9e43-49e5-a19b-725176630f03" (UID: "b4f3b72f-9e43-49e5-a19b-725176630f03"). InnerVolumeSpecName "kube-api-access-88qtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:15:14.014323 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.014285 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4f3b72f-9e43-49e5-a19b-725176630f03" (UID: "b4f3b72f-9e43-49e5-a19b-725176630f03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:15:14.113189 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.113166 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88qtg\" (UniqueName: \"kubernetes.io/projected/b4f3b72f-9e43-49e5-a19b-725176630f03-kube-api-access-88qtg\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:15:14.113189 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.113187 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f3b72f-9e43-49e5-a19b-725176630f03-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:15:14.113322 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.113197 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f3b72f-9e43-49e5-a19b-725176630f03-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:15:14.209192 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.209162 2554 generic.go:356] "Generic (PLEG): container finished" podID="b4f3b72f-9e43-49e5-a19b-725176630f03" containerID="5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d" exitCode=0 Jul 15 16:15:14.209288 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.209207 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" Jul 15 16:15:14.209288 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.209221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" event={"ID":"b4f3b72f-9e43-49e5-a19b-725176630f03","Type":"ContainerDied","Data":"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d"} Jul 15 16:15:14.209288 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.209262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6" event={"ID":"b4f3b72f-9e43-49e5-a19b-725176630f03","Type":"ContainerDied","Data":"0b2d3889c6d6c1b0cd551c613821b906f0ecf49fc1e153d10d6f9bc89ad3e946"} Jul 15 16:15:14.209288 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.209282 2554 scope.go:117] "RemoveContainer" containerID="5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d" Jul 15 16:15:14.217700 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.217682 2554 scope.go:117] "RemoveContainer" containerID="5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d" Jul 15 16:15:14.217952 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:15:14.217933 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d\": container with ID starting with 5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d not found: ID does not exist" containerID="5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d" Jul 15 16:15:14.218012 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.217965 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d"} err="failed to get container status \"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d\": rpc error: code = NotFound desc = could not find container \"5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d\": container with ID starting with 5d058c860428d3f356c5eef7ee4847732b24208ddb3f1d38dc0ff02efd139c7d not found: ID does not exist" Jul 15 16:15:14.231513 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.231478 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:15:14.234985 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:14.234966 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-652d3f-7b889c479c-6blc6"] Jul 15 16:15:15.537730 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:15.537698 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f3b72f-9e43-49e5-a19b-725176630f03" path="/var/lib/kubelet/pods/b4f3b72f-9e43-49e5-a19b-725176630f03/volumes" Jul 15 16:15:32.916733 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.916700 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:15:32.917137 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917038 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2414401d-663e-4092-8f99-a744065afddd" containerName="maas-api" Jul 15 16:15:32.917137 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917049 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2414401d-663e-4092-8f99-a744065afddd" containerName="maas-api" Jul 15 16:15:32.917137 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917071 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f3b72f-9e43-49e5-a19b-725176630f03" containerName="maas-api" Jul 15 16:15:32.917137 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917076 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f3b72f-9e43-49e5-a19b-725176630f03" containerName="maas-api" Jul 15 16:15:32.917137 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917135 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2414401d-663e-4092-8f99-a744065afddd" containerName="maas-api" Jul 15 16:15:32.917312 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.917144 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f3b72f-9e43-49e5-a19b-725176630f03" containerName="maas-api" Jul 15 16:15:32.919933 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.919911 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:32.923391 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.923371 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-95128b-serving-cert\"" Jul 15 16:15:32.932784 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.932761 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:15:32.973933 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.973898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:32.973933 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.973936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdcm\" (UniqueName: \"kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:32.974121 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:32.974010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.075401 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.075368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.075401 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.075407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdcm\" (UniqueName: \"kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.075621 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.075446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.076108 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.076089 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.077617 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.077599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.086429 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.086402 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdcm\" (UniqueName: \"kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm\") pod \"maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.230733 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.230651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:33.570167 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:33.570143 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:15:33.572133 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:15:33.572103 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10158dcf_5d8d_4be9_9a0d_b6015fca6015.slice/crio-14b3e086484b13e38229c409043552cb97f5aa859657000d014439d79b7a138e WatchSource:0}: Error finding container 14b3e086484b13e38229c409043552cb97f5aa859657000d014439d79b7a138e: Status 404 returned error can't find the container with id 14b3e086484b13e38229c409043552cb97f5aa859657000d014439d79b7a138e Jul 15 16:15:34.303343 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:34.303308 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" event={"ID":"10158dcf-5d8d-4be9-9a0d-b6015fca6015","Type":"ContainerStarted","Data":"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60"} Jul 15 16:15:34.303699 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:34.303372 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" event={"ID":"10158dcf-5d8d-4be9-9a0d-b6015fca6015","Type":"ContainerStarted","Data":"14b3e086484b13e38229c409043552cb97f5aa859657000d014439d79b7a138e"} Jul 15 16:15:34.303699 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:34.303489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:34.340934 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:34.340867 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" podStartSLOduration=1.7145085789999999 podStartE2EDuration="2.34084755s" totalImagesPullingTime="626.338971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:15:34.337574837 +0000 UTC m=+2413.080345787" watchObservedRunningTime="2026-07-15 16:15:34.34084755 +0000 UTC m=+2413.083618502" Jul 15 16:15:40.313937 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:40.313908 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:15:41.057362 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.057327 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:15:41.061023 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.061006 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.064045 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.064028 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8eb165-serving-cert\"" Jul 15 16:15:41.086960 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.086934 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:15:41.148923 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.148887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw944\" (UniqueName: \"kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.149115 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.149009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.149115 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.149056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.250261 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.250224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.250436 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.250288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.250436 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.250332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw944\" (UniqueName: \"kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.250955 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.250932 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.252625 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.252603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.262454 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.262433 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw944\" (UniqueName: \"kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944\") pod \"maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.370900 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.370873 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:41.505280 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:41.505249 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:15:41.507956 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:15:41.507931 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177f5c85_ace7_4224_90ac_b624cac15074.slice/crio-f65b799e4f59f34c1403189cfdc2ad7242b073734f5348136d6b2afc94cd8162 WatchSource:0}: Error finding container f65b799e4f59f34c1403189cfdc2ad7242b073734f5348136d6b2afc94cd8162: Status 404 returned error can't find the container with id f65b799e4f59f34c1403189cfdc2ad7242b073734f5348136d6b2afc94cd8162 Jul 15 16:15:42.340267 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:42.340220 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" event={"ID":"177f5c85-ace7-4224-90ac-b624cac15074","Type":"ContainerStarted","Data":"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7"} Jul 15 16:15:42.340267 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:42.340274 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" event={"ID":"177f5c85-ace7-4224-90ac-b624cac15074","Type":"ContainerStarted","Data":"f65b799e4f59f34c1403189cfdc2ad7242b073734f5348136d6b2afc94cd8162"} Jul 15 16:15:42.340615 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:42.340342 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:15:42.363058 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:42.363013 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" podStartSLOduration=1.034180813 podStartE2EDuration="1.363000629s" totalImagesPullingTime="328.819816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:15:42.359917649 +0000 UTC m=+2421.102688599" watchObservedRunningTime="2026-07-15 16:15:42.363000629 +0000 UTC m=+2421.105771576" Jul 15 16:15:48.351173 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:15:48.351102 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:21:33.506169 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.505245 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:21:33.506169 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.505471 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" podUID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" containerName="maas-api" containerID="cri-o://2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60" gracePeriod=30 Jul 15 16:21:33.751119 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.751095 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:21:33.775766 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.775679 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca\") pod \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " Jul 15 16:21:33.775766 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.775732 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmdcm\" (UniqueName: \"kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm\") pod \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " Jul 15 16:21:33.775766 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.775765 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls\") pod \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\" (UID: \"10158dcf-5d8d-4be9-9a0d-b6015fca6015\") " Jul 15 16:21:33.776099 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.776058 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10158dcf-5d8d-4be9-9a0d-b6015fca6015" (UID: "10158dcf-5d8d-4be9-9a0d-b6015fca6015"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:21:33.778338 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.778306 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10158dcf-5d8d-4be9-9a0d-b6015fca6015" (UID: "10158dcf-5d8d-4be9-9a0d-b6015fca6015"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:21:33.778670 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.778646 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm" (OuterVolumeSpecName: "kube-api-access-rmdcm") pod "10158dcf-5d8d-4be9-9a0d-b6015fca6015" (UID: "10158dcf-5d8d-4be9-9a0d-b6015fca6015"). InnerVolumeSpecName "kube-api-access-rmdcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:21:33.876536 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.876489 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10158dcf-5d8d-4be9-9a0d-b6015fca6015-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:21:33.876536 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.876533 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmdcm\" (UniqueName: \"kubernetes.io/projected/10158dcf-5d8d-4be9-9a0d-b6015fca6015-kube-api-access-rmdcm\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:21:33.876710 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.876544 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10158dcf-5d8d-4be9-9a0d-b6015fca6015-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:21:33.968184 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.968151 2554 generic.go:356] "Generic (PLEG): container finished" podID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" containerID="2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60" exitCode=0 Jul 15 16:21:33.968338 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.968193 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" Jul 15 16:21:33.968338 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.968203 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" event={"ID":"10158dcf-5d8d-4be9-9a0d-b6015fca6015","Type":"ContainerDied","Data":"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60"} Jul 15 16:21:33.968338 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.968251 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc" event={"ID":"10158dcf-5d8d-4be9-9a0d-b6015fca6015","Type":"ContainerDied","Data":"14b3e086484b13e38229c409043552cb97f5aa859657000d014439d79b7a138e"} Jul 15 16:21:33.968338 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.968275 2554 scope.go:117] "RemoveContainer" containerID="2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60" Jul 15 16:21:33.980596 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.980579 2554 scope.go:117] "RemoveContainer" containerID="2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60" Jul 15 16:21:33.980866 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:21:33.980845 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60\": container with ID starting with 2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60 not found: ID does not exist" containerID="2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60" Jul 15 16:21:33.980920 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.980873 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60"} err="failed to get container status \"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60\": rpc error: code = NotFound desc = could not find container \"2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60\": container with ID starting with 2ec69bde281ff4b28f0a273a9c4fda6fd05a2d91c81f90ce4782325aee7aca60 not found: ID does not exist" Jul 15 16:21:33.991955 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.991931 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:21:33.995691 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:33.995670 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-95128b-c5947cd94-ksjbc"] Jul 15 16:21:35.538036 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:35.538007 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" path="/var/lib/kubelet/pods/10158dcf-5d8d-4be9-9a0d-b6015fca6015/volumes" Jul 15 16:21:59.729023 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:59.728928 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:21:59.729615 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:59.729167 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" podUID="177f5c85-ace7-4224-90ac-b624cac15074" containerName="maas-api" containerID="cri-o://e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7" gracePeriod=30 Jul 15 16:21:59.988345 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:21:59.988270 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:22:00.090924 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.090885 2554 generic.go:356] "Generic (PLEG): container finished" podID="177f5c85-ace7-4224-90ac-b624cac15074" containerID="e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7" exitCode=0 Jul 15 16:22:00.090924 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.090929 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" Jul 15 16:22:00.091127 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.090970 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" event={"ID":"177f5c85-ace7-4224-90ac-b624cac15074","Type":"ContainerDied","Data":"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7"} Jul 15 16:22:00.091127 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.091027 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7" event={"ID":"177f5c85-ace7-4224-90ac-b624cac15074","Type":"ContainerDied","Data":"f65b799e4f59f34c1403189cfdc2ad7242b073734f5348136d6b2afc94cd8162"} Jul 15 16:22:00.091127 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.091055 2554 scope.go:117] "RemoveContainer" containerID="e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7" Jul 15 16:22:00.099287 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.099267 2554 scope.go:117] "RemoveContainer" containerID="e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7" Jul 15 16:22:00.099595 ip-10-0-132-85 kubenswrapper[2554]: E0715 16:22:00.099575 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7\": container with ID starting with e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7 not found: ID does not exist" containerID="e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7" Jul 15 16:22:00.099671 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.099611 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7"} err="failed to get container status \"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7\": rpc error: code = NotFound desc = could not find container \"e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7\": container with ID starting with e15b97b51c5e1f1d93923d283aa59df7ac46ea9786fbaca2eabcb93a0a4eb6c7 not found: ID does not exist" Jul 15 16:22:00.106960 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.106928 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls\") pod \"177f5c85-ace7-4224-90ac-b624cac15074\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " Jul 15 16:22:00.107048 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.106985 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw944\" (UniqueName: \"kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944\") pod \"177f5c85-ace7-4224-90ac-b624cac15074\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " Jul 15 16:22:00.107048 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.107004 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca\") pod \"177f5c85-ace7-4224-90ac-b624cac15074\" (UID: \"177f5c85-ace7-4224-90ac-b624cac15074\") " Jul 15 16:22:00.107375 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.107353 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "177f5c85-ace7-4224-90ac-b624cac15074" (UID: "177f5c85-ace7-4224-90ac-b624cac15074"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:22:00.109005 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.108979 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "177f5c85-ace7-4224-90ac-b624cac15074" (UID: "177f5c85-ace7-4224-90ac-b624cac15074"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:22:00.109113 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.109059 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944" (OuterVolumeSpecName: "kube-api-access-tw944") pod "177f5c85-ace7-4224-90ac-b624cac15074" (UID: "177f5c85-ace7-4224-90ac-b624cac15074"). InnerVolumeSpecName "kube-api-access-tw944". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:22:00.207633 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.207596 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/177f5c85-ace7-4224-90ac-b624cac15074-maas-api-tls\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:22:00.207633 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.207628 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw944\" (UniqueName: \"kubernetes.io/projected/177f5c85-ace7-4224-90ac-b624cac15074-kube-api-access-tw944\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:22:00.207633 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.207640 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/177f5c85-ace7-4224-90ac-b624cac15074-openshift-service-ca\") on node \"ip-10-0-132-85.ec2.internal\" DevicePath \"\"" Jul 15 16:22:00.413248 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.413208 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:22:00.417383 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:00.417356 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8eb165-ccd8d9-cgqw7"] Jul 15 16:22:01.537367 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:01.537331 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="177f5c85-ace7-4224-90ac-b624cac15074" path="/var/lib/kubelet/pods/177f5c85-ace7-4224-90ac-b624cac15074/volumes" Jul 15 16:22:21.344223 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:21.344194 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54c4dd9f96-zg24l_545f6aec-e8b5-4bc8-8e63-d7b83f573e57/manager/0.log" Jul 15 16:22:21.941397 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:21.941367 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw_ede0e428-7924-4af7-abcf-47622e406231/copy-manifests/0.log" Jul 15 16:22:21.959522 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:21.959480 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw_ede0e428-7924-4af7-abcf-47622e406231/manager/0.log" Jul 15 16:22:22.320933 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:22.320855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f594748d7-qzpdj_f5e686f0-f03c-449d-a6ed-e7e42f4b9c45/maas-api/0.log" Jul 15 16:22:24.105480 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:24.105451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-w8shs_297532d7-feff-4483-9c6d-4503eb6a3222/postgres/0.log" Jul 15 16:22:25.561679 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:25.561641 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q8j75_e342690d-96b0-48cb-8629-b8c1696d0ea4/manager/0.log" Jul 15 16:22:25.911824 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:25.911795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w4z2b_feaf2a57-aeea-4ec4-9699-7fb3c52a4075/registry-server/0.log" Jul 15 16:22:26.037822 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:26.037792 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tv9z2_57e6ac11-507d-4891-9ae1-09f4a6b8d7c0/manager/0.log" Jul 15 16:22:26.775095 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:26.775056 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ksmpg_5501b416-1b31-4d2a-95b7-48a2caee17fc/discovery/0.log" Jul 15 16:22:26.885922 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:26.885892 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-cpxcs_837df392-990b-4b05-9ce4-b3cd8b0346ce/kube-auth-proxy/0.log" Jul 15 16:22:27.245492 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:27.245464 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5g8dd_46bf77dc-0e82-43c0-8f82-45db7066778d/payload-pre-processing/0.log" Jul 15 16:22:27.361801 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:27.361770 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-cdkqc_1d58face-9502-414f-8e5e-253172f67e22/payload-processing/0.log" Jul 15 16:22:27.817676 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:27.817638 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wplp2_52600167-18ab-4db1-892e-130beaab6618/main/0.log" Jul 15 16:22:28.064005 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:28.063979 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ncb2v_2c6e118e-fd98-4a37-9e08-de0a13b4dc97/main/0.log" Jul 15 16:22:28.180311 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:28.180286 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm9zcd_c593b9f3-7c0f-4b09-9a43-537afc2473e5/main/0.log" Jul 15 16:22:37.049002 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:37.048972 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-64gml_ab14dec2-b6d2-4628-8bad-e6198903e125/global-pull-secret-syncer/0.log" Jul 15 16:22:37.238633 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:37.238606 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mc98l_4d79d339-0be3-4a4e-92eb-9ea4ee7c9cb3/konnectivity-agent/0.log" Jul 15 16:22:37.309823 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:37.309743 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-85.ec2.internal_b26d51ebf8c0b9aef32c216d74a1ab12/haproxy/0.log" Jul 15 16:22:42.832572 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:42.832536 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q8j75_e342690d-96b0-48cb-8629-b8c1696d0ea4/manager/0.log" Jul 15 16:22:42.949577 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:42.949549 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w4z2b_feaf2a57-aeea-4ec4-9699-7fb3c52a4075/registry-server/0.log" Jul 15 16:22:43.229170 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:43.229115 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tv9z2_57e6ac11-507d-4891-9ae1-09f4a6b8d7c0/manager/0.log" Jul 15 16:22:45.648598 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:45.648566 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btqkz_b96cf416-09f3-4b87-90ca-306ddc3bc6cd/node-exporter/0.log" Jul 15 16:22:45.674665 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:45.674642 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btqkz_b96cf416-09f3-4b87-90ca-306ddc3bc6cd/kube-rbac-proxy/0.log" Jul 15 16:22:45.699152 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:45.699133 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btqkz_b96cf416-09f3-4b87-90ca-306ddc3bc6cd/init-textfile/0.log" Jul 15 16:22:46.074202 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:46.074120 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gz27t_a99d9766-7cb2-45ba-914e-2b4fcf232ff1/prometheus-operator/0.log" Jul 15 16:22:46.096404 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:46.096375 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gz27t_a99d9766-7cb2-45ba-914e-2b4fcf232ff1/kube-rbac-proxy/0.log" Jul 15 16:22:46.125246 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:46.125211 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-x2jfh_5bc94c31-4e16-4f80-bd2f-6df0c66fa59e/prometheus-operator-admission-webhook/0.log" Jul 15 16:22:47.254693 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.254654 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb"] Jul 15 16:22:47.255038 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255006 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177f5c85-ace7-4224-90ac-b624cac15074" containerName="maas-api" Jul 15 16:22:47.255038 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255017 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="177f5c85-ace7-4224-90ac-b624cac15074" containerName="maas-api" Jul 15 16:22:47.255038 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255032 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" containerName="maas-api" Jul 15 16:22:47.255038 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255037 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" containerName="maas-api" Jul 15 16:22:47.255163 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255101 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="177f5c85-ace7-4224-90ac-b624cac15074" containerName="maas-api" Jul 15 16:22:47.255163 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.255109 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="10158dcf-5d8d-4be9-9a0d-b6015fca6015" containerName="maas-api" Jul 15 16:22:47.258040 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.258022 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.261274 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.261249 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7j6b2\"/\"default-dockercfg-zrw5m\"" Jul 15 16:22:47.261274 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.261268 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"kube-root-ca.crt\"" Jul 15 16:22:47.262399 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.262382 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"openshift-service-ca.crt\"" Jul 15 16:22:47.268991 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.268969 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb"] Jul 15 16:22:47.397837 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.397805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-podres\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.397970 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.397845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-lib-modules\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.397970 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.397875 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-sys\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.397970 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.397900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p6bb\" (UniqueName: \"kubernetes.io/projected/6d606baf-5df3-4529-95aa-3555eb6d03de-kube-api-access-4p6bb\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.397970 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.397916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-proc\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499097 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-podres\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499258 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-lib-modules\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499258 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-sys\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499258 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499185 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-sys\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499258 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p6bb\" (UniqueName: \"kubernetes.io/projected/6d606baf-5df3-4529-95aa-3555eb6d03de-kube-api-access-4p6bb\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499258 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-proc\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-proc\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-podres\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.499449 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.499246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d606baf-5df3-4529-95aa-3555eb6d03de-lib-modules\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.508179 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.508116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p6bb\" (UniqueName: \"kubernetes.io/projected/6d606baf-5df3-4529-95aa-3555eb6d03de-kube-api-access-4p6bb\") pod \"perf-node-gather-daemonset-4l5qb\" (UID: \"6d606baf-5df3-4529-95aa-3555eb6d03de\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.567785 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.567758 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:47.697693 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:47.697660 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb"] Jul 15 16:22:47.701051 ip-10-0-132-85 kubenswrapper[2554]: W0715 16:22:47.701023 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6d606baf_5df3_4529_95aa_3555eb6d03de.slice/crio-f772a3df9291401fe2a7d539d9ea0da6b0708ea0b0801c995a0a5a800e6e8a99 WatchSource:0}: Error finding container f772a3df9291401fe2a7d539d9ea0da6b0708ea0b0801c995a0a5a800e6e8a99: Status 404 returned error can't find the container with id f772a3df9291401fe2a7d539d9ea0da6b0708ea0b0801c995a0a5a800e6e8a99 Jul 15 16:22:48.312918 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.312883 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" event={"ID":"6d606baf-5df3-4529-95aa-3555eb6d03de","Type":"ContainerStarted","Data":"b073d907c8ba32f50145b0d67e6e68f6d8b3723c20ad3f4f27fee6b8a400f183"} Jul 15 16:22:48.313307 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.312937 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" event={"ID":"6d606baf-5df3-4529-95aa-3555eb6d03de","Type":"ContainerStarted","Data":"f772a3df9291401fe2a7d539d9ea0da6b0708ea0b0801c995a0a5a800e6e8a99"} Jul 15 16:22:48.313307 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.312997 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:48.331144 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.331101 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" podStartSLOduration=1.3310879629999999 podStartE2EDuration="1.331087963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:22:48.330850133 +0000 UTC m=+2847.073621081" watchObservedRunningTime="2026-07-15 16:22:48.331087963 +0000 UTC m=+2847.073858910" Jul 15 16:22:48.651190 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.651158 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68c549f565-k2w66_1fc47f0b-2768-4656-b21e-39d5631dd98a/console/0.log" Jul 15 16:22:48.693215 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:48.693191 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-w862g_27dc7972-4b01-4b39-989c-9f0c3958a433/download-server/0.log" Jul 15 16:22:50.500334 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:50.500307 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxsdm_ac7a2eae-2006-4908-a5ca-e640cd7e8b23/dns/0.log" Jul 15 16:22:50.524740 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:50.524718 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxsdm_ac7a2eae-2006-4908-a5ca-e640cd7e8b23/kube-rbac-proxy/0.log" Jul 15 16:22:50.551053 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:50.551032 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glb4z_15f71a07-b9d4-4a7b-b7f9-76337e141c09/dns-node-resolver/0.log" Jul 15 16:22:51.185597 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:51.185569 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d9zv5_23074da3-a235-4c06-892f-3a25623649e4/node-ca/0.log" Jul 15 16:22:52.438573 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:52.438544 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ksmpg_5501b416-1b31-4d2a-95b7-48a2caee17fc/discovery/0.log" Jul 15 16:22:52.460233 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:52.460206 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-cpxcs_837df392-990b-4b05-9ce4-b3cd8b0346ce/kube-auth-proxy/0.log" Jul 15 16:22:52.630820 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:52.630788 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5g8dd_46bf77dc-0e82-43c0-8f82-45db7066778d/payload-pre-processing/0.log" Jul 15 16:22:52.673653 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:52.673623 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-cdkqc_1d58face-9502-414f-8e5e-253172f67e22/payload-processing/0.log" Jul 15 16:22:53.417921 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:53.417883 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5ls28_694897f1-9f86-4f5b-959a-5123f80be7bd/serve-healthcheck-canary/0.log" Jul 15 16:22:54.016104 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:54.016075 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm46v_68ead6c0-89e2-4b81-88de-c8957e3e0af0/kube-rbac-proxy/0.log" Jul 15 16:22:54.039259 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:54.039233 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm46v_68ead6c0-89e2-4b81-88de-c8957e3e0af0/exporter/0.log" Jul 15 16:22:54.068675 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:54.068645 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cm46v_68ead6c0-89e2-4b81-88de-c8957e3e0af0/extractor/0.log" Jul 15 16:22:54.327238 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:54.327166 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-4l5qb" Jul 15 16:22:57.068303 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.068268 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54c4dd9f96-zg24l_545f6aec-e8b5-4bc8-8e63-d7b83f573e57/manager/0.log" Jul 15 16:22:57.483841 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.483795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw_ede0e428-7924-4af7-abcf-47622e406231/manager/0.log" Jul 15 16:22:57.505785 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.505755 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-rrmzw_ede0e428-7924-4af7-abcf-47622e406231/copy-manifests/0.log" Jul 15 16:22:57.538835 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.538807 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ksmpg_5501b416-1b31-4d2a-95b7-48a2caee17fc/discovery/0.log" Jul 15 16:22:57.549791 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.549767 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-cpxcs_837df392-990b-4b05-9ce4-b3cd8b0346ce/kube-auth-proxy/0.log" Jul 15 16:22:57.681560 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.681533 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5g8dd_46bf77dc-0e82-43c0-8f82-45db7066778d/payload-pre-processing/0.log" Jul 15 16:22:57.711859 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:57.711830 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-cdkqc_1d58face-9502-414f-8e5e-253172f67e22/payload-processing/0.log" Jul 15 16:22:58.874216 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:58.874183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xwx8p_bbf8460f-4d2e-4e32-9113-c80be261f27d/openshift-lws-operator/0.log" Jul 15 16:22:59.169832 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:59.169796 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ksmpg_5501b416-1b31-4d2a-95b7-48a2caee17fc/discovery/0.log" Jul 15 16:22:59.184846 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:59.184827 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-cpxcs_837df392-990b-4b05-9ce4-b3cd8b0346ce/kube-auth-proxy/0.log" Jul 15 16:22:59.344684 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:59.344656 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5g8dd_46bf77dc-0e82-43c0-8f82-45db7066778d/payload-pre-processing/0.log" Jul 15 16:22:59.382420 ip-10-0-132-85 kubenswrapper[2554]: I0715 16:22:59.382394 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-cdkqc_1d58face-9502-414f-8e5e-253172f67e22/payload-processing/0.log"