Jul 12 15:18:11.359357 ip-10-0-128-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 12 15:18:11.359366 ip-10-0-128-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 12 15:18:11.359374 ip-10-0-128-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 12 15:18:11.359579 ip-10-0-128-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 12 15:18:21.529804 ip-10-0-128-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 12 15:18:21.529825 ip-10-0-128-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 30e8997a44084ea39209a2013062a641 --
Jul 12 15:20:20.851302 ip-10-0-128-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 15:20:21.227930 ip-10-0-128-199 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:20:21.227930 ip-10-0-128-199 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 15:20:21.227930 ip-10-0-128-199 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:20:21.227930 ip-10-0-128-199 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 15:20:21.227930 ip-10-0-128-199 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 15:20:21.228889 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.228801    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 15:20:21.233440 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233424    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.233440 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233440    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233444    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233448    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233452    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233455    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233458    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233461    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233464    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233467    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233469    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233472    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233474    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233477    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233480    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233483    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233487    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233490    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233493    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233496    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.233507 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233499    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233501    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233504    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233506    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233509    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233512    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233514    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233517    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233520    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233523    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233525    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233528    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233530    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233533    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233535    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233538    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233540    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233543    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233547    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233549    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.233969 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233552    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233555    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233557    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233559    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233562    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233564    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233567    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233570    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233574    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233577    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233580    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233582    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233586    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233588    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233592    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233595    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233598    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233600    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233603    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.234469 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233605    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233608    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233610    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233613    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233615    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233618    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233620    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233623    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233625    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233627    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233630    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233632    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233635    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233638    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233640    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233643    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233645    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233647    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233650    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233652    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.234939 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233654    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233656    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233659    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233662    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233665    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233667    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233669    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233675    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233677    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233680    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233683    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233686    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233690    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233692    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233696    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233698    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233701    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233703    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233706    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.233708    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.235470 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234462    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234471    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234475    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234479    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234483    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234486    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234489    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234491    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234494    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234497    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234500    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234503    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234505    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234508    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234511    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234514    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234516    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234519    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234521    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234524    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.235944 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234526    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234528    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234531    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234533    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234536    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234538    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234541    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234543    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234545    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234548    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234550    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234553    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234555    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234560    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234564    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234567    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234570    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234575    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234580    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.236445 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234584    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234587    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234590    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234592    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234595    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234597    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234599    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234602    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234604    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234607    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234609    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234611    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234614    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234617    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234619    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234621    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234624    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234626    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234629    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234631    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.236898 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234633    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234636    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234638    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234640    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234643    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234645    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234649    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234652    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234655    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234657    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234660    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234662    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234664    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234667    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234669    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234671    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234674    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234676    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234679    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234681    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.237393 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234684    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234686    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234690    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234692    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234694    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234697    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234699    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234702    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234704    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234708    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234710    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234712    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234714    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234717    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234719    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234722    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234724    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234726    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234729    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.234732    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.237862 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235115    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235121    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235124    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235127    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235130    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235132    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235135    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235138    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235140    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235144    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235148    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235150    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235153    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235156    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235473    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235481    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235484    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235487    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235490    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.238372 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235492    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235495    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235499    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235501    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235505    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235508    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235510    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235513    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235516    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235518    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235521    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235525    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235527    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235532    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235535    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235537    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235540    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235542    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235545    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.238851 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235547    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235550    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235553    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235555    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235558    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235560    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235563    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235565    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235567    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235570    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235572    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235574    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235577    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235579    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235581    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235584    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235587    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235589    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235592    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235594    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.239336 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235597    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235601    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235605    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235608    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235611    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235615    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235618    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235622    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235626    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235629    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235632    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235635    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235637    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235640    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235642    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235644    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235647    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235649    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235652    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.239813 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235654    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235657    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235659    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235662    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235664    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235667    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235669    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235671    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235674    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235676    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235679    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235681    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235683    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235686    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235688    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235690    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235693    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235696    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235698    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235701    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.240321 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235703    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.235706    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235779    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235786    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235792    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235798    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235804    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235808    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235814    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235819    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235822    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235825    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235829    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235832    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235835    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235838    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235842    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235845    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235848    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235851    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235854    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235857    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235860    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235863    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 15:20:21.240788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235866    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235870    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235873    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235876    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235879    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235882    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235885    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235890    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235893    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235896    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235901    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235904    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235907    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235909    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235912    2581 flags.go:64] FLAG: --enable-server="true"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235915    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235919    2581 flags.go:64] FLAG: --event-burst="100"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235922    2581 flags.go:64] FLAG: --event-qps="50"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235925    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235928    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235930    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235934    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235936    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235940    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235942    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 12 15:20:21.241373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235945    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235949    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235952    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235954    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235957    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235960    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235963    2581 flags.go:64] FLAG: --feature-gates=""
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235966    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235969    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235972    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235975    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235978    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235981    2581 flags.go:64] FLAG: --help="false"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.235983    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236009    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236014    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236017    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236020    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236024    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236027    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236030    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236032    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236035    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 15:20:21.241964 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236038    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236041    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236044    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236047    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236049    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236052    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236055    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236058    2581 flags.go:64] FLAG: --lock-file=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236060    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236063    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236066    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236072    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236075    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236077    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236080    2581 flags.go:64] FLAG: --logging-format="text"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236083    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236086    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236089    2581 flags.go:64] FLAG: --manifest-url=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236091    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236095    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236100    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236104    2581 flags.go:64] FLAG: --max-pods="110"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236107    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236111    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236113    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 15:20:21.242570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236116    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236119    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236122    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236125    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236132    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236135    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236138    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236141    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236144    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236149    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236152    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236155    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236157    2581 flags.go:64] FLAG: --port="10250"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236160    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236163    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3850b547588875b"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236167    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236169    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236172    2581 flags.go:64] FLAG: --register-node="true"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236175    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236178    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236181    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236184    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236187    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236190    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236193    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 15:20:21.243224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236196    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236198    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236201    2581 flags.go:64] FLAG: --runonce="false"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236205    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236208    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236212    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236215    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236218    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236221    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236224    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236227    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236230    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236233    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236235    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236238    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236241    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236244    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236246    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236252    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236254    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236257    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236260    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236263    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236265    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236268    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 15:20:21.243857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236271    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236274    2581 flags.go:64] FLAG: --v="2"
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236277    2581 flags.go:64] FLAG: --version="false"
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236281    2581 flags.go:64] FLAG: --vmodule=""
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236285    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.236288    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236406    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236409    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236412    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236415    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236419    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236422    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236427    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236430    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236433    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236435    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236438    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236440    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236443    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236446    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.244482 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236449    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236451    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236454    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236456    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236459    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236462    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236464    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236466    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236469    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236471    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236474    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236476    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236479    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236481    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236484    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236486    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236489    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236491    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236493    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236496    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.244955 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236498    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236501    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236504    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236506    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236509    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236511    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236514    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236516    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236518    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236521    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236523    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236526    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236529    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236532    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236534    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236536    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236539    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236541    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236543    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236546    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.245467 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236548    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236550    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236553    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236556    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236559    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236562    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236564    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236567    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236569    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236571    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236574    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236576    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236578    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236581    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236583    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236586    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236589    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236591    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236595    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.246286 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236599    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236602    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236605    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236608    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236611    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236613    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236616    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236619    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236622    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236624    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236627    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236631    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236634    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236637    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236639    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236642    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236644    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236647    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236649    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236651    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.246801 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236654    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236656    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236659    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236661    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236663    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.236666    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.237216    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.244400    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.244417    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.245048    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.245056    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245114    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245120    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245123    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245126    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.247414 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245129    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245133    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245136    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245139    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245141    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245145    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245149    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245152    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245154    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245157    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245160    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245163    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245165    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245168    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245170    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245173    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245175    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245178    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245181    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.247811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245183    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245186    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245189    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245191    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245194    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245196    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245200    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245202    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245205    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245207    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245210    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245214    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245217    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245220    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245223    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245225    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245228    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245230    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245232    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.248305 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245235    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245237    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245240    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245242    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245245    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245247    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245250    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245252    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245255    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245257    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245259    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245262    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245265    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245267    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245270    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245272    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245274    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245277    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245279    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.248768 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245282    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245285    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245288    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245291    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245293    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245296    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245298    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245301    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245303    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245305    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245308    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245310    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245312    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245315    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245317    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245319    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245322    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245324    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245326    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245329    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.249248 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245332    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245334    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245337    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245339    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245342    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245344    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245347    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245349    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245351    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245354    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245357    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245359    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245364    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245367    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245371    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.245373    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.246936    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.249720 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.246950    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.246956    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247718    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247728    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247732    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247735    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247738    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247740    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247743    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247746    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247749    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247751    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247753    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247756    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247759    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 15:20:21.250150 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247761    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247765    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247768    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247790    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247794    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247798    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247801    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247804    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247807    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247809    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247812    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247814    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247817    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247820    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247824    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247826    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247829    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247832    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247835    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247837    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 15:20:21.250525 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247840    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247842    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247844    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247847    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247849    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247852    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247854    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247857    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247859    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247862    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247864    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247867    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247869    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247872    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247874    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247876    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247879    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247882    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247884    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247887    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 15:20:21.251053 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247889    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247891    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247894    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247898    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247901    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247904    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247907    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247910    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247912    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247915    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247917    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247920    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247922    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247924    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247927    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247929    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247932    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247935    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247938    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 15:20:21.251560 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247940    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247942    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247945    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247947    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247950    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247952    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247955    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247957    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247961    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247964    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247968    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247972    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247975    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247979    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247981    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247984    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247986    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.247988    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248009    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 15:20:21.252061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248013    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248015    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248017    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248020    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248022    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248025    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248027    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:21.248030    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.248034    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.248165    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.250509    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.251982    2581 server.go:1019] "Starting client certificate rotation"
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.252117    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 15:20:21.252611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.252168    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 15:20:21.254619 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.254603    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 15:20:21.259213 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.259183    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 15:20:21.271038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.271014    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 12 15:20:21.273366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.273351    2581 log.go:25] "Validated CRI v1 image API"
Jul 12 15:20:21.274147 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.274131    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 15:20:21.279309 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.279290    2581 fs.go:135] Filesystem UUIDs: map[04229ff5-2bf3-422b-82cb-3052bfaa7f03:/dev/nvme0n1p3 51a61a9a-bc3b-4627-a87a-3b3efd158868:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 12 15:20:21.279378 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.279311    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 15:20:21.282570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.282549    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 15:20:21.284414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.284289    2581 manager.go:216] Machine: {Timestamp:2026-07-12 15:20:21.282984046 +0000 UTC m=+0.321096491 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103929 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24958c87f34da3c35f908b70783e74 SystemUUID:ec24958c-87f3-4da3-c35f-908b70783e74 BootID:30e8997a-4408-4ea3-9209-a2013062a641 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:23:f8:7c:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:23:f8:7c:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:6e:0e:84:9d:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 15:20:21.284414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.284411    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 15:20:21.284533 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.284489    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 15:20:21.287808 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.287783    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 15:20:21.287944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.287810    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 15:20:21.288499 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.288489    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 15:20:21.288538 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.288503    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 15:20:21.288538 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.288512    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 15:20:21.289215 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.289203    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 15:20:21.290364 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.290353    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 15:20:21.295277 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295261    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 15:20:21.295387 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295378    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 15:20:21.295430 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295407    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 15:20:21.295430 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295417    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 15:20:21.295430 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295430    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 15:20:21.295532 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295444    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 12 15:20:21.295532 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295456    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 15:20:21.295908 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295896    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 15:20:21.295908 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.295917    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 15:20:21.298868 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.298851    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 15:20:21.300684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.300670    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 15:20:21.300742 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.300701    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 15:20:21.301472 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301456    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 15:20:21.301472 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301475    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301481    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301486    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301496    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301504    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301511    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301527    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301533    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301539    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301546    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301551    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 15:20:21.301599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.301583    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hq25"
Jul 12 15:20:21.302488 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.302476    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 15:20:21.302520 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.302489    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 15:20:21.305572 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.305553    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 15:20:21.305641 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.305572    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 15:20:21.305727 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.305703    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 15:20:21.305888 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.305877    2581 server.go:1268] "Started kubelet"
Jul 12 15:20:21.305965 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.305940    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 15:20:21.306071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.306030    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 15:20:21.306122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.306095    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 15:20:21.307275 ip-10-0-128-199 systemd[1]: Started Kubernetes Kubelet.
Jul 12 15:20:21.307832 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.307785    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 15:20:21.308532 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.308520    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 15:20:21.308949 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.308924    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hq25"
Jul 12 15:20:21.310225 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.310206    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 15:20:21.312897 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.312022    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-199.ec2.internal.18c193f81f8bbece  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-199.ec2.internal,UID:ip-10-0-128-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-199.ec2.internal,},FirstTimestamp:2026-07-12 15:20:21.305851598 +0000 UTC m=+0.343964041,LastTimestamp:2026-07-12 15:20:21.305851598 +0000 UTC m=+0.343964041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-199.ec2.internal,}"
Jul 12 15:20:21.314797 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.314771    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 15:20:21.314797 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.314784    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 15:20:21.314936 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.314849    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.315473 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315453    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 15:20:21.315473 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315473    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 15:20:21.315612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315526    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 15:20:21.315612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315535    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 15:20:21.315869 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315805    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 15:20:21.315960 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315941    2581 factory.go:153] Registering CRI-O factory
Jul 12 15:20:21.316071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.315964    2581 factory.go:223] Registration of the crio container factory successfully
Jul 12 15:20:21.316071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316031    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 15:20:21.316071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316042    2581 factory.go:55] Registering systemd factory
Jul 12 15:20:21.316071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316050    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 12 15:20:21.316071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316072    2581 factory.go:103] Registering Raw factory
Jul 12 15:20:21.316283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316084    2581 manager.go:1196] Started watching for new ooms in manager
Jul 12 15:20:21.316570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.316509    2581 manager.go:349] Starting recovery of all containers
Jul 12 15:20:21.325628 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.325454    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:21.328747 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.328730    2581 manager.go:354] Recovery completed
Jul 12 15:20:21.328856 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.328838    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-199.ec2.internal\" not found" node="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.332983 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.332972    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.335474 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.335457    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.335549 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.335492    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.335549 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.335507    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.336865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.336850    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 15:20:21.336865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.336863    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 15:20:21.337017 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.336885    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 15:20:21.337017 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.336933    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.337663 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.337646    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.337726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.337673    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.337726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.337685    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.338072 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.338061    2581 policy_none.go:49] "None policy: Start"
Jul 12 15:20:21.338103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.338076    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 15:20:21.338103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.338086    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 15:20:21.339048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.339038    2581 policy_none.go:47] "Start"
Jul 12 15:20:21.369599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.369580    2581 manager.go:337] "Starting Device Plugin manager"
Jul 12 15:20:21.369684 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.369611    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 15:20:21.369684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.369621    2581 server.go:87] "Starting device plugin registration server"
Jul 12 15:20:21.369861 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.369851    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 15:20:21.369894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.369863    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 15:20:21.370009 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.369975    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 15:20:21.370074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.370063    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 15:20:21.370121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.370075    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 15:20:21.370586 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.370569    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 15:20:21.370650 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.370622    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.470406 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.470378    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.471652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.471298    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.471652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.471331    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.471652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.471340    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.471652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.471368    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.477048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.477033    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.477107 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.477055    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-199.ec2.internal\": node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.490823 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.490769    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.500483 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.500453    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 15:20:21.501810 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.501791    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 15:20:21.501877 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.501824    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 15:20:21.501877 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.501851    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 15:20:21.501949 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.501887    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 15:20:21.504176 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.504161    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:21.591744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.591692    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.602848 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.602826    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"]
Jul 12 15:20:21.602912 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.602897    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.604618 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.604605    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.604662 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.604635    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.604662 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.604648    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.606043 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606030    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.606152 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.606228 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606164    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.606736 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606719    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.606813 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606751    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.606813 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606766    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.606813 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606776    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.606813 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606801    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.607014 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.606816    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.608060 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.608044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.608113 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.608076    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 15:20:21.608683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.608668    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 15:20:21.608731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.608704    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 15:20:21.608731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.608719    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID"
Jul 12 15:20:21.617529 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.617512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.617615 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.617535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.617615 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.617552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a49ac858e8c63dd08ec6b65adc4b376-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"9a49ac858e8c63dd08ec6b65adc4b376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.634749 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.634729    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-199.ec2.internal\" not found" node="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.639281 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.639265    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-199.ec2.internal\" not found" node="ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.692670 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.692647    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.718268 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.718363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a49ac858e8c63dd08ec6b65adc4b376-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"9a49ac858e8c63dd08ec6b65adc4b376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.718363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.718363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.718363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a49ac858e8c63dd08ec6b65adc4b376-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"9a49ac858e8c63dd08ec6b65adc4b376\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.718363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.718325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1724a9814d41def69e066b451aabe65e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"1724a9814d41def69e066b451aabe65e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.793605 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.793521    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.894233 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.894199    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:21.938755 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.938730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.943961 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:21.943945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:21.994538 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:21.994511    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:22.095129 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:22.095062    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found"
Jul 12 15:20:22.168252 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.168220    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:22.215364 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.215342    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:22.226292 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.226274    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 15:20:22.228405 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.228393    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"
Jul 12 15:20:22.234202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.234183    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 15:20:22.252445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.252423    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 15:20:22.252562 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.252545    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 15:20:22.252613 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.252575    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 15:20:22.252613 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.252590    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 15:20:22.295798 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.295762    2581 apiserver.go:52] "Watching apiserver"
Jul 12 15:20:22.315273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.315238    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 15:20:22.315273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.315235    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 15:15:22 +0000 UTC" deadline="2028-01-10 11:22:08.947716424 +0000 UTC"
Jul 12 15:20:22.315273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.315269    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13124h1m46.632450409s"
Jul 12 15:20:22.315622 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.315601    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 15:20:22.317098 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.317065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs","openshift-dns/node-resolver-69hkn","openshift-multus/multus-rmxb9","openshift-multus/network-metrics-daemon-gm2r8","openshift-network-operator/iptables-alerter-9b6ft","kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x4sfj","openshift-image-registry/node-ca-nq5x6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-x7rpq","openshift-network-diagnostics/network-check-target-r6jnw","openshift-ovn-kubernetes/ovnkube-node-wzxh9","kube-system/global-pull-secret-syncer-gtfj4","kube-system/konnectivity-agent-vgh2w"]
Jul 12 15:20:22.319147 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.318983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:22.320378 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.320358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:22.320482 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:22.320431    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:22.321363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.321343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:22.321867 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.321847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.322057 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.322038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-97l65\""
Jul 12 15:20:22.322160 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.322091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.322336 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.322320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:22.322399 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:22.322383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:22.323609 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.323583    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:22.324200 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.324281 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324210    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 15:20:22.324339 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324295    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.324339 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ltxg5\""
Jul 12 15:20:22.324339 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324325    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 15:20:22.324734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.324715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:22.325986 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.325970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:22.326114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.326093    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.327090 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.327250 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327236    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 15:20:22.327408 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xsn9m\""
Jul 12 15:20:22.327726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 15:20:22.327801 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327753    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rnvk9\""
Jul 12 15:20:22.327857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 15:20:22.327986 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.327970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:22.328240 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.328220    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 15:20:22.328514 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.328499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.328593 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.328539    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 15:20:22.328650 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.328623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:22.329045 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.329030    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.329105 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.329076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w8qnk\""
Jul 12 15:20:22.329922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.329905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:22.330731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.330715    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 15:20:22.330818 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.330728    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cfqkk\""
Jul 12 15:20:22.330818 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.330745    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.330818 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.330793    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.331213 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.331199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:22.331311 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:22.331295    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:22.331473 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.331455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 15:20:22.331543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.331494    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 15:20:22.331543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.331530    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mpr54\""
Jul 12 15:20:22.332197 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.332184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9dvrq\""
Jul 12 15:20:22.332405 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.332393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 15:20:22.332667 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.332651    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 15:20:22.333248 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:22.333231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.674034 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.674016    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 15:20:23.674510 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.674492    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 15:20:23.674631 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.674611    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4phfh\""
Jul 12 15:20:23.674720 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.674527    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 15:20:23.675373 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.675353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 15:20:23.675481 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.675362    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 15:20:23.675481 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.675425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 15:20:23.747621 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.747596    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-65tff"
Jul 12 15:20:23.750774 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:23.750750    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1724a9814d41def69e066b451aabe65e.slice/crio-e671139a56461e27e712f1e284c7f596bd69f4d417e523754c3ac9a3f2dbae68 WatchSource:0}: Error finding container e671139a56461e27e712f1e284c7f596bd69f4d417e523754c3ac9a3f2dbae68: Status 404 returned error can't find the container with id e671139a56461e27e712f1e284c7f596bd69f4d417e523754c3ac9a3f2dbae68
Jul 12 15:20:23.751262 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:23.751230    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a49ac858e8c63dd08ec6b65adc4b376.slice/crio-47d8307dd4bafd7791a922efa4e50f8c8a2064f349dda2d1816ea739045feae4 WatchSource:0}: Error finding container 47d8307dd4bafd7791a922efa4e50f8c8a2064f349dda2d1816ea739045feae4: Status 404 returned error can't find the container with id 47d8307dd4bafd7791a922efa4e50f8c8a2064f349dda2d1816ea739045feae4
Jul 12 15:20:23.754821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.754799    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-65tff"
Jul 12 15:20:23.755320 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.755305    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 15:20:23.757996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.757898    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:20:23.759580 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-log-socket\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.759649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-etc-selinux\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.759649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.759726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjk89\" (UniqueName: \"kubernetes.io/projected/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-kube-api-access-gjk89\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.759726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:23.759726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58936986-6fdf-4528-9b34-8a0f5ee62e48-konnectivity-ca\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.759726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.759874 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cnibin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.759874 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-daemon-config\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.759874 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-multus-certs\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.759874 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-os-release\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznk6\" (UniqueName: \"kubernetes.io/projected/b7e21e19-9e0e-42fe-9064-82fbadfa5102-kube-api-access-rznk6\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-run\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58936986-6fdf-4528-9b34-8a0f5ee62e48-agent-certs\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-kubelet\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.759992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e21e19-9e0e-42fe-9064-82fbadfa5102-tmp-dir\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-kubernetes\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760062 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-sys\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-var-lib-kubelet\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-system-cni-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-var-lib-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e21e19-9e0e-42fe-9064-82fbadfa5102-hosts-file\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-serviceca\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-sys-fs\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-systemd-units\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc54734-a327-46b2-91e2-8b31b014473c-iptables-alerter-script\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-netns\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-node-log\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvgr\" (UniqueName: \"kubernetes.io/projected/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-kube-api-access-kzvgr\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760457 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-cnibin\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-systemd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-bin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-multus\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc54734-a327-46b2-91e2-8b31b014473c-host-slash\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-systemd\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-tuned\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-kubelet-config\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysconfig\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-lib-modules\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lclh5\" (UniqueName: \"kubernetes.io/projected/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kube-api-access-lclh5\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-slash\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.760978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-etc-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75qfq\" (UniqueName: \"kubernetes.io/projected/acc54734-a327-46b2-91e2-8b31b014473c-kube-api-access-75qfq\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-host\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-registration-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-device-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.760985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nndqx\" (UniqueName: \"kubernetes.io/projected/a259dbfb-9702-463e-8a59-e9e019cbd73d-kube-api-access-nndqx\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-config\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovn-node-metrics-cert\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-modprobe-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-tmp\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nnmx\" (UniqueName: \"kubernetes.io/projected/42125f8b-c6e7-4caa-b653-40657a8a2c3f-kube-api-access-6nnmx\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-env-overrides\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cni-binary-copy\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-conf-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-host\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.761799 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-bin\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-netd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-system-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-k8s-cni-cncf-io\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-hostroot\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-conf\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-dbus\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-script-lib\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdwqf\" (UniqueName: \"kubernetes.io/projected/7a2452ce-e603-4061-9cdf-baedd16ad299-kube-api-access-rdwqf\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-os-release\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-socket-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-socket-dir-parent\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-netns\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-kubelet\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-etc-kubernetes\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqr9n\" (UniqueName: \"kubernetes.io/projected/f442bd45-c165-4613-bb5e-f7cab3b6c00b-kube-api-access-fqr9n\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.762737 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.761694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-ovn\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.843999 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.843959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"1724a9814d41def69e066b451aabe65e","Type":"ContainerStarted","Data":"e671139a56461e27e712f1e284c7f596bd69f4d417e523754c3ac9a3f2dbae68"}
Jul 12 15:20:23.844926 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.844904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" event={"ID":"9a49ac858e8c63dd08ec6b65adc4b376","Type":"ContainerStarted","Data":"47d8307dd4bafd7791a922efa4e50f8c8a2064f349dda2d1816ea739045feae4"}
Jul 12 15:20:23.862428 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqr9n\" (UniqueName: \"kubernetes.io/projected/f442bd45-c165-4613-bb5e-f7cab3b6c00b-kube-api-access-fqr9n\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-ovn\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-log-socket\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-etc-selinux\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjk89\" (UniqueName: \"kubernetes.io/projected/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-kube-api-access-gjk89\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.862515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-log-socket\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58936986-6fdf-4528-9b34-8a0f5ee62e48-konnectivity-ca\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cnibin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-ovn\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-daemon-config\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.862632    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-etc-selinux\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cnibin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.862715    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:24.362670496 +0000 UTC m=+2.062399256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-multus-certs\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.862865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-os-release\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznk6\" (UniqueName: \"kubernetes.io/projected/b7e21e19-9e0e-42fe-9064-82fbadfa5102-kube-api-access-rznk6\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-run\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58936986-6fdf-4528-9b34-8a0f5ee62e48-agent-certs\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.862946    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-multus-certs\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-kubelet\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.862955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-os-release\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-run\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.863003    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:24.362982411 +0000 UTC m=+2.062711171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-kubelet\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e21e19-9e0e-42fe-9064-82fbadfa5102-tmp-dir\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-kubernetes\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-sys\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-var-lib-kubelet\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-system-cni-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-kubernetes\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-sys\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.863591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-daemon-config\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-var-lib-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-var-lib-kubelet\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e21e19-9e0e-42fe-9064-82fbadfa5102-hosts-file\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-system-cni-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-serviceca\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-var-lib-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e21e19-9e0e-42fe-9064-82fbadfa5102-hosts-file\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-sys-fs\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-sys-fs\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863292    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-systemd-units\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58936986-6fdf-4528-9b34-8a0f5ee62e48-konnectivity-ca\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc54734-a327-46b2-91e2-8b31b014473c-iptables-alerter-script\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-systemd-units\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-netns\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.864460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e21e19-9e0e-42fe-9064-82fbadfa5102-tmp-dir\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-node-log\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-node-log\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-run-netns\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvgr\" (UniqueName: \"kubernetes.io/projected/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-kube-api-access-kzvgr\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-cnibin\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-systemd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-bin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-multus\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc54734-a327-46b2-91e2-8b31b014473c-host-slash\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-systemd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-bin\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-systemd\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-serviceca\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-cnibin\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-tuned\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.865305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-systemd\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-cni-multus\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863696    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc54734-a327-46b2-91e2-8b31b014473c-host-slash\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-kubelet-config\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-kubelet-config\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysconfig\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-lib-modules\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc54734-a327-46b2-91e2-8b31b014473c-iptables-alerter-script\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lclh5\" (UniqueName: \"kubernetes.io/projected/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kube-api-access-lclh5\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysconfig\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-slash\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-etc-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-lib-modules\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75qfq\" (UniqueName: \"kubernetes.io/projected/acc54734-a327-46b2-91e2-8b31b014473c-kube-api-access-75qfq\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-host\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-etc-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-slash\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.863995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-registration-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-host\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-device-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nndqx\" (UniqueName: \"kubernetes.io/projected/a259dbfb-9702-463e-8a59-e9e019cbd73d-kube-api-access-nndqx\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-registration-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-config\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-device-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovn-node-metrics-cert\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-modprobe-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-tmp\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nnmx\" (UniqueName: \"kubernetes.io/projected/42125f8b-c6e7-4caa-b653-40657a8a2c3f-kube-api-access-6nnmx\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.866682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-modprobe-d\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-env-overrides\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cni-binary-copy\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-conf-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-host\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-bin\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-netd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-system-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-host\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-k8s-cni-cncf-io\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-hostroot\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-bin\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-conf\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-dbus\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-script-lib\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-config\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwqf\" (UniqueName: \"kubernetes.io/projected/7a2452ce-e603-4061-9cdf-baedd16ad299-kube-api-access-rdwqf\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-hostroot\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-host-cni-netd\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-system-cni-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-k8s-cni-cncf-io\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.864990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f3cd987-8bf0-4709-bab2-356b6554c845-dbus\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-env-overrides\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-sysctl-conf\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-conf-dir\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f442bd45-c165-4613-bb5e-f7cab3b6c00b-cni-binary-copy\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a259dbfb-9702-463e-8a59-e9e019cbd73d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-os-release\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-socket-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.867775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-socket-dir-parent\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-netns\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a259dbfb-9702-463e-8a59-e9e019cbd73d-os-release\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-kubelet\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-run-openvswitch\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-etc-kubernetes\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-run-netns\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-socket-dir\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-etc-kubernetes\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-host-var-lib-kubelet\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.865883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f442bd45-c165-4613-bb5e-f7cab3b6c00b-multus-socket-dir-parent\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.866012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovnkube-script-lib\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.867077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-etc-tuned\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.867168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42125f8b-c6e7-4caa-b653-40657a8a2c3f-tmp\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.867463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58936986-6fdf-4528-9b34-8a0f5ee62e48-agent-certs\") pod \"konnectivity-agent-vgh2w\" (UID: \"58936986-6fdf-4528-9b34-8a0f5ee62e48\") " pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:23.868222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.867625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-ovn-node-metrics-cert\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.881559 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.881527    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:23.881559 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.881558    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:23.881712 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.881573    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:23.881712 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:23.881627    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:24.381611152 +0000 UTC m=+2.081339932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:23.883219 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nnmx\" (UniqueName: \"kubernetes.io/projected/42125f8b-c6e7-4caa-b653-40657a8a2c3f-kube-api-access-6nnmx\") pod \"tuned-x4sfj\" (UID: \"42125f8b-c6e7-4caa-b653-40657a8a2c3f\") " pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.883219 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjk89\" (UniqueName: \"kubernetes.io/projected/dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5-kube-api-access-gjk89\") pod \"node-ca-nq5x6\" (UID: \"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5\") " pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:23.883361 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75qfq\" (UniqueName: \"kubernetes.io/projected/acc54734-a327-46b2-91e2-8b31b014473c-kube-api-access-75qfq\") pod \"iptables-alerter-9b6ft\" (UID: \"acc54734-a327-46b2-91e2-8b31b014473c\") " pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:23.883442 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lclh5\" (UniqueName: \"kubernetes.io/projected/8ccd7a68-4819-4e12-a8c1-70a9adf04b61-kube-api-access-lclh5\") pod \"aws-ebs-csi-driver-node-krlzs\" (UID: \"8ccd7a68-4819-4e12-a8c1-70a9adf04b61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:23.883670 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqr9n\" (UniqueName: \"kubernetes.io/projected/f442bd45-c165-4613-bb5e-f7cab3b6c00b-kube-api-access-fqr9n\") pod \"multus-rmxb9\" (UID: \"f442bd45-c165-4613-bb5e-f7cab3b6c00b\") " pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:23.883741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.883691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznk6\" (UniqueName: \"kubernetes.io/projected/b7e21e19-9e0e-42fe-9064-82fbadfa5102-kube-api-access-rznk6\") pod \"node-resolver-69hkn\" (UID: \"b7e21e19-9e0e-42fe-9064-82fbadfa5102\") " pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:23.884189 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.884172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvgr\" (UniqueName: \"kubernetes.io/projected/ba2f9b02-4ba2-413c-84f9-66b9d7188afd-kube-api-access-kzvgr\") pod \"ovnkube-node-wzxh9\" (UID: \"ba2f9b02-4ba2-413c-84f9-66b9d7188afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:23.885224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.885208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nndqx\" (UniqueName: \"kubernetes.io/projected/a259dbfb-9702-463e-8a59-e9e019cbd73d-kube-api-access-nndqx\") pod \"multus-additional-cni-plugins-x7rpq\" (UID: \"a259dbfb-9702-463e-8a59-e9e019cbd73d\") " pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:23.885583 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.885566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwqf\" (UniqueName: \"kubernetes.io/projected/7a2452ce-e603-4061-9cdf-baedd16ad299-kube-api-access-rdwqf\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:23.937706 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.937631    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:23.987448 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.987418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x4sfj"
Jul 12 15:20:23.995539 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:23.995515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42125f8b_c6e7_4caa_b653_40657a8a2c3f.slice/crio-1ed3f85666c9ffa55f2fd3b5c30c9930479bac01ee25c0286f84baedf359131e WatchSource:0}: Error finding container 1ed3f85666c9ffa55f2fd3b5c30c9930479bac01ee25c0286f84baedf359131e: Status 404 returned error can't find the container with id 1ed3f85666c9ffa55f2fd3b5c30c9930479bac01ee25c0286f84baedf359131e
Jul 12 15:20:23.999703 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:23.999685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmxb9"
Jul 12 15:20:24.007174 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.007151    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf442bd45_c165_4613_bb5e_f7cab3b6c00b.slice/crio-5f6a41474562771e9452b6113cfbe77a38bec2b70791c3153f3ddcca54387724 WatchSource:0}: Error finding container 5f6a41474562771e9452b6113cfbe77a38bec2b70791c3153f3ddcca54387724: Status 404 returned error can't find the container with id 5f6a41474562771e9452b6113cfbe77a38bec2b70791c3153f3ddcca54387724
Jul 12 15:20:24.007781 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.007764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9b6ft"
Jul 12 15:20:24.010751 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.010733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:24.016268 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.016246    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc54734_a327_46b2_91e2_8b31b014473c.slice/crio-74162f8bc5a35097602b019cd2d03c664b28346a9a76e7db4f25b9d34dac7d01 WatchSource:0}: Error finding container 74162f8bc5a35097602b019cd2d03c664b28346a9a76e7db4f25b9d34dac7d01: Status 404 returned error can't find the container with id 74162f8bc5a35097602b019cd2d03c664b28346a9a76e7db4f25b9d34dac7d01
Jul 12 15:20:24.019186 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.019166    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58936986_6fdf_4528_9b34_8a0f5ee62e48.slice/crio-77662474b3dd6d1d6c2232415dc3f38ed8f8df2428f16d2d05a98d07edb2a337 WatchSource:0}: Error finding container 77662474b3dd6d1d6c2232415dc3f38ed8f8df2428f16d2d05a98d07edb2a337: Status 404 returned error can't find the container with id 77662474b3dd6d1d6c2232415dc3f38ed8f8df2428f16d2d05a98d07edb2a337
Jul 12 15:20:24.033624 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.033600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq5x6"
Jul 12 15:20:24.041478 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.041454    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4a9417_10bf_4e2e_8fc9_a5500cdf44e5.slice/crio-ca07794ca046016c09f892173a4d6cff152d2677fc788cc3c909074cc96a0749 WatchSource:0}: Error finding container ca07794ca046016c09f892173a4d6cff152d2677fc788cc3c909074cc96a0749: Status 404 returned error can't find the container with id ca07794ca046016c09f892173a4d6cff152d2677fc788cc3c909074cc96a0749
Jul 12 15:20:24.048428 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.048412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs"
Jul 12 15:20:24.054787 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.054765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccd7a68_4819_4e12_a8c1_70a9adf04b61.slice/crio-cef7b731a76b4d419ef4a32ff91cacd05926120f00140764a3c01466c7e00c66 WatchSource:0}: Error finding container cef7b731a76b4d419ef4a32ff91cacd05926120f00140764a3c01466c7e00c66: Status 404 returned error can't find the container with id cef7b731a76b4d419ef4a32ff91cacd05926120f00140764a3c01466c7e00c66
Jul 12 15:20:24.058021 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.057998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69hkn"
Jul 12 15:20:24.063860 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.063840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7rpq"
Jul 12 15:20:24.064599 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.064583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e21e19_9e0e_42fe_9064_82fbadfa5102.slice/crio-a942b8cbcfb2d39f4cb288ecdb4126fa5e9c74685580763a49dfde37791f5ebc WatchSource:0}: Error finding container a942b8cbcfb2d39f4cb288ecdb4126fa5e9c74685580763a49dfde37791f5ebc: Status 404 returned error can't find the container with id a942b8cbcfb2d39f4cb288ecdb4126fa5e9c74685580763a49dfde37791f5ebc
Jul 12 15:20:24.068603 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.068586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:24.071278 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.071259    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda259dbfb_9702_463e_8a59_e9e019cbd73d.slice/crio-2f57cf89546f3eca273a916e4ddc936cbd2d7598864437c0acd2d6a1fc25d9ef WatchSource:0}: Error finding container 2f57cf89546f3eca273a916e4ddc936cbd2d7598864437c0acd2d6a1fc25d9ef: Status 404 returned error can't find the container with id 2f57cf89546f3eca273a916e4ddc936cbd2d7598864437c0acd2d6a1fc25d9ef
Jul 12 15:20:24.075850 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:24.075832    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2f9b02_4ba2_413c_84f9_66b9d7188afd.slice/crio-bf78cdeeda2626c40f8ec72e37aa7a3d69a6ad9a4809f8b6ba3447864f7c068b WatchSource:0}: Error finding container bf78cdeeda2626c40f8ec72e37aa7a3d69a6ad9a4809f8b6ba3447864f7c068b: Status 404 returned error can't find the container with id bf78cdeeda2626c40f8ec72e37aa7a3d69a6ad9a4809f8b6ba3447864f7c068b
Jul 12 15:20:24.370833 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.370675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:24.370833 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.370727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:24.370833 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.370793    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:24.370833 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.370792    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:24.371132 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.370852    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:25.370835452 +0000 UTC m=+3.070564224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:24.371132 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.370869    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:25.370861057 +0000 UTC m=+3.070589814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:24.471840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.471802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:24.472017 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.471979    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:24.472017 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.472001    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:24.472017 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.472012    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:24.472483 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.472461    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:25.472436024 +0000 UTC m=+3.172164782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:24.522356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.522319    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:24.664978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.664900    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:24.758535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.758438    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 15:15:23 +0000 UTC" deadline="2028-03-31 12:15:11.49566358 +0000 UTC"
Jul 12 15:20:24.758535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.758500    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15068h54m46.737167766s"
Jul 12 15:20:24.841554 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.841518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:24.841725 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.841647    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:24.842073 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.842052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:24.842290 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:24.842159    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:24.883048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.882969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq5x6" event={"ID":"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5","Type":"ContainerStarted","Data":"ca07794ca046016c09f892173a4d6cff152d2677fc788cc3c909074cc96a0749"}
Jul 12 15:20:24.887418 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.887102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerStarted","Data":"2f57cf89546f3eca273a916e4ddc936cbd2d7598864437c0acd2d6a1fc25d9ef"}
Jul 12 15:20:24.898643 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.898610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs" event={"ID":"8ccd7a68-4819-4e12-a8c1-70a9adf04b61","Type":"ContainerStarted","Data":"cef7b731a76b4d419ef4a32ff91cacd05926120f00140764a3c01466c7e00c66"}
Jul 12 15:20:24.915943 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.915845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vgh2w" event={"ID":"58936986-6fdf-4528-9b34-8a0f5ee62e48","Type":"ContainerStarted","Data":"77662474b3dd6d1d6c2232415dc3f38ed8f8df2428f16d2d05a98d07edb2a337"}
Jul 12 15:20:24.925554 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.925520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9b6ft" event={"ID":"acc54734-a327-46b2-91e2-8b31b014473c","Type":"ContainerStarted","Data":"74162f8bc5a35097602b019cd2d03c664b28346a9a76e7db4f25b9d34dac7d01"}
Jul 12 15:20:24.937894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.937858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmxb9" event={"ID":"f442bd45-c165-4613-bb5e-f7cab3b6c00b","Type":"ContainerStarted","Data":"5f6a41474562771e9452b6113cfbe77a38bec2b70791c3153f3ddcca54387724"}
Jul 12 15:20:24.943737 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.943701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x4sfj" event={"ID":"42125f8b-c6e7-4caa-b653-40657a8a2c3f","Type":"ContainerStarted","Data":"1ed3f85666c9ffa55f2fd3b5c30c9930479bac01ee25c0286f84baedf359131e"}
Jul 12 15:20:24.951633 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.951603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"bf78cdeeda2626c40f8ec72e37aa7a3d69a6ad9a4809f8b6ba3447864f7c068b"}
Jul 12 15:20:24.955848 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:24.955808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69hkn" event={"ID":"b7e21e19-9e0e-42fe-9064-82fbadfa5102","Type":"ContainerStarted","Data":"a942b8cbcfb2d39f4cb288ecdb4126fa5e9c74685580763a49dfde37791f5ebc"}
Jul 12 15:20:25.379705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.379619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:25.379705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.379672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:25.379933 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.379796    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:25.379933 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.379859    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:27.379841015 +0000 UTC m=+5.079569775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:25.380253 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.380236    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:25.380333 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.380290    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:27.380273546 +0000 UTC m=+5.080002310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:25.480593 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.480557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:25.480776 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.480737    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:25.480776 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.480761    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:25.480776 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.480774    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:25.480930 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.480832    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:27.480812733 +0000 UTC m=+5.180541504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:25.759992 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.759953    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 15:15:23 +0000 UTC" deadline="2027-12-06 19:12:22.221145598 +0000 UTC"
Jul 12 15:20:25.759992 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.759989    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12291h51m56.461161748s"
Jul 12 15:20:25.841096 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:25.841065    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:25.841292 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:25.841204    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:26.232597 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:26.232517    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 15:20:26.843112 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:26.842281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:26.843112 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:26.842578    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:26.843112 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:26.842882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:26.843112 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:26.842954    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:27.399603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:27.399651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.399793    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.399850    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:31.399833599 +0000 UTC m=+9.099562361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.400217    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:27.400312 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.400266    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:31.400249403 +0000 UTC m=+9.099978165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:27.500922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:27.500871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:27.501143 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.501125    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:27.501210 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.501150    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:27.501210 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.501164    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:27.501311 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.501219    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:31.501203197 +0000 UTC m=+9.200931954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:27.841802 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:27.841267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:27.841802 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:27.841407    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:28.841263 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:28.841228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:28.841692 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:28.841363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:28.841936 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:28.841909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:28.842069 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:28.842021    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:29.840675 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:29.840644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:29.840852 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:29.840755    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:30.840593 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:30.840557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:30.841040 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:30.840694    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:30.841104 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:30.841076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:30.841202 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:30.841174    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:31.433741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:31.433701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:31.433940 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:31.433749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:31.433940 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.433882    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:31.433940 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.433931    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:39.43391883 +0000 UTC m=+17.133647587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:31.434240 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.434221    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:31.434348 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.434269    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:39.434253672 +0000 UTC m=+17.133982429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:31.534675 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:31.534636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:31.534845 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.534781    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:31.534845 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.534803    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:31.534845 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.534815    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:31.534940 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.534868    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:39.534852363 +0000 UTC m=+17.234581133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:31.845570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:31.845537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:31.846020 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:31.845676    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:32.843913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:32.843881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:32.844113 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:32.843926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:32.844113 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:32.844012    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:32.844447 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:32.844420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:33.840624 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:33.840588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:33.841127 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:33.840715    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:34.844881 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:34.844853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:34.845324 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:34.844894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:34.845324 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:34.844988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:34.845324 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:34.845126    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:35.840392 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:35.840350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:35.840524 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:35.840473    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:36.841210 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:36.841170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:36.841672 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:36.841294    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:36.841672 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:36.841412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:36.841672 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:36.841553    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:37.840545 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:37.840505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:37.840716 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:37.840668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:38.843715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:38.843682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:38.844141 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:38.843811    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:38.844141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:38.843856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:38.844141 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:38.843941    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:39.493960 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:39.493920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:39.494239 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:39.493982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:39.494239 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.494097    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:39.494239 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.494176    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:55.494154142 +0000 UTC m=+33.193882907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:39.494239 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.494097    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:39.494464 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.494251    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:20:55.494237149 +0000 UTC m=+33.193965908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:39.594873 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:39.594841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:39.595057 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.594982    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:39.595057 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.594998    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:39.595057 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.595006    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:39.595057 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.595055    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:20:55.595042245 +0000 UTC m=+33.294771001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:39.840987 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:39.840902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:39.841146 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:39.841041    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:40.844125 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:40.844095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:40.844594 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:40.844108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:40.844594 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:40.844193    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:40.844594 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:40.844323    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:41.840750 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:41.840714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:41.840975 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:41.840851    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:42.842504 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:42.842428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:42.843907 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:42.843777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:42.844501 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:42.844461    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:42.844501 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:42.844009    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:43.841089 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:43.841060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:43.841265 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:43.841180    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:44.851073 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:44.850680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:44.851073 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:44.850814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:44.851073 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:44.851025    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:44.851947 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:44.851108    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:45.008169 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.008100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" event={"ID":"9a49ac858e8c63dd08ec6b65adc4b376","Type":"ContainerStarted","Data":"15033270968aa88f5b0522d82083e14b4a737254b9e54f79b0d48a0227c1bf6c"}
Jul 12 15:20:45.014184 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.014154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"21fcf1fab70920779edb08c531ec79651eb28ec826765fa34171e4aad5118e9c"}
Jul 12 15:20:45.014327 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.014220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"5077a653fbd609373054fcc122fe47d04b7e07d5da77871777a9e6a3a4e88b78"}
Jul 12 15:20:45.014327 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.014249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"8d0c6756af65047819a248e6970ca9048163052eeb191fda278f66a59c8df4bf"}
Jul 12 15:20:45.014327 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.014289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"ec18229bb10a14caabb3dabcf59c5048a346eac33b632a22286a5284ff5eefb2"}
Jul 12 15:20:45.015496 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.015409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmxb9" event={"ID":"f442bd45-c165-4613-bb5e-f7cab3b6c00b","Type":"ContainerStarted","Data":"1c5b64a36a2be3ee6724fff3b1b32dd3d1909b4916ef35eade6361b0fd6503d0"}
Jul 12 15:20:45.016858 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.016810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x4sfj" event={"ID":"42125f8b-c6e7-4caa-b653-40657a8a2c3f","Type":"ContainerStarted","Data":"f8adcae605861e4bffe117925e5eaa645fc27e6ad0949fb939424f759be1452c"}
Jul 12 15:20:45.022268 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.022217    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" podStartSLOduration=22.022177339 podStartE2EDuration="22.022177339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:45.022161951 +0000 UTC m=+22.721890731" watchObservedRunningTime="2026-07-12 15:20:45.022177339 +0000 UTC m=+22.721906123"
Jul 12 15:20:45.038002 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.037940    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmxb9" podStartSLOduration=2.471441508 podStartE2EDuration="23.037921208s" totalImagesPullingTime="20.5664797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:45.037418672 +0000 UTC m=+22.737147473" watchObservedRunningTime="2026-07-12 15:20:45.037921208 +0000 UTC m=+22.737649988"
Jul 12 15:20:45.052981 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.052905    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x4sfj" podStartSLOduration=2.612501144 podStartE2EDuration="23.052883206s" totalImagesPullingTime="20.440382062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:45.052537117 +0000 UTC m=+22.752265907" watchObservedRunningTime="2026-07-12 15:20:45.052883206 +0000 UTC m=+22.752611988"
Jul 12 15:20:45.841678 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:45.841469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:45.841840 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:45.841743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:46.020542 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.020506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69hkn" event={"ID":"b7e21e19-9e0e-42fe-9064-82fbadfa5102","Type":"ContainerStarted","Data":"bf2ac272c0715173520ea55f64b23e507755b3a9bd51417b9d3759077104c596"}
Jul 12 15:20:46.021866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.021844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq5x6" event={"ID":"dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5","Type":"ContainerStarted","Data":"01782233020e7418d431478ef40920eb9083d07132f786ef455501b05b0c34d5"}
Jul 12 15:20:46.025680 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.023569    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="006daeb156191b8f4cd18c1d08becad520a0fafa9dd39bf999ececa6e8a19533" exitCode=0
Jul 12 15:20:46.025680 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.023738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"006daeb156191b8f4cd18c1d08becad520a0fafa9dd39bf999ececa6e8a19533"}
Jul 12 15:20:46.027305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.027285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs" event={"ID":"8ccd7a68-4819-4e12-a8c1-70a9adf04b61","Type":"ContainerStarted","Data":"8992689a4a1c209d9f425987ad31da436b9554d83ea29888330ed4e4c0da7691"}
Jul 12 15:20:46.028703 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.028684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vgh2w" event={"ID":"58936986-6fdf-4528-9b34-8a0f5ee62e48","Type":"ContainerStarted","Data":"94bb86d0133a6ffd342f930183507c2e90fbaecb8553d795367a817befda471f"}
Jul 12 15:20:46.030053 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.030034    2581 generic.go:356] "Generic (PLEG): container finished" podID="1724a9814d41def69e066b451aabe65e" containerID="2edcee3d8d4e92e4111c41f5688ac5dda16e852727aa2bcb740b717c1959c2ea" exitCode=0
Jul 12 15:20:46.030184 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.030109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"1724a9814d41def69e066b451aabe65e","Type":"ContainerDied","Data":"2edcee3d8d4e92e4111c41f5688ac5dda16e852727aa2bcb740b717c1959c2ea"}
Jul 12 15:20:46.033424 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.033402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"384a8c5e32df4566f0ce5dcfd83f16821ca7f2e39e9376cedbd8ebc0d65759b6"}
Jul 12 15:20:46.033497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.033474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"559397e991cfc7c13e9e49dd018aa186614fab6a15dd5bd0dada627fce8530c4"}
Jul 12 15:20:46.040021 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.039985    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-69hkn" podStartSLOduration=3.668173516 podStartE2EDuration="24.039973866s" totalImagesPullingTime="20.37180035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:46.039540407 +0000 UTC m=+23.739269186" watchObservedRunningTime="2026-07-12 15:20:46.039973866 +0000 UTC m=+23.739702645"
Jul 12 15:20:46.052359 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.052322    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nq5x6" podStartSLOduration=3.7051096709999998 podStartE2EDuration="24.05230851s" totalImagesPullingTime="20.347198839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:46.051906607 +0000 UTC m=+23.751635387" watchObservedRunningTime="2026-07-12 15:20:46.05230851 +0000 UTC m=+23.752037288"
Jul 12 15:20:46.108932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.108889    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vgh2w" podStartSLOduration=12.108655215 podStartE2EDuration="24.108872512s" totalImagesPullingTime="12.000217297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:46.108582534 +0000 UTC m=+23.808311313" watchObservedRunningTime="2026-07-12 15:20:46.108872512 +0000 UTC m=+23.808601291"
Jul 12 15:20:46.414253 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.414182    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 15:20:46.720419 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.720232    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T15:20:46.414215446Z","UUID":"73a30924-f832-4d28-86fb-e84effb8eab8","Handler":null,"Name":"","Endpoint":""}
Jul 12 15:20:46.722103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.722084    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 15:20:46.722242 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.722126    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 15:20:46.841320 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.841288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:46.841597 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:46.841442    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:46.841597 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:46.841501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:46.841719 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:46.841628    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:47.038217 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.038053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"1724a9814d41def69e066b451aabe65e","Type":"ContainerStarted","Data":"70ec110228d7d106ab49e2cf46b12091d312d671386b327ada06f6b78ab8e344"}
Jul 12 15:20:47.040369 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.040336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs" event={"ID":"8ccd7a68-4819-4e12-a8c1-70a9adf04b61","Type":"ContainerStarted","Data":"2730001a85e3b9f381cf72f4da6aeb3b67695f7cefd5863bd25f272663830a4f"}
Jul 12 15:20:47.041724 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.041694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9b6ft" event={"ID":"acc54734-a327-46b2-91e2-8b31b014473c","Type":"ContainerStarted","Data":"fdf70a504c8c4dfdd4ebf0969277511bd472c7dad9704aa7566d3d30dc88b521"}
Jul 12 15:20:47.054666 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.054617    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" podStartSLOduration=24.054577001 podStartE2EDuration="24.054577001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:47.05429502 +0000 UTC m=+24.754023814" watchObservedRunningTime="2026-07-12 15:20:47.054577001 +0000 UTC m=+24.754305781"
Jul 12 15:20:47.069340 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.069301    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9b6ft" podStartSLOduration=4.697560138 podStartE2EDuration="25.069281644s" totalImagesPullingTime="20.371721506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:47.068629 +0000 UTC m=+24.768357781" watchObservedRunningTime="2026-07-12 15:20:47.069281644 +0000 UTC m=+24.769010422"
Jul 12 15:20:47.841298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:47.841221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:47.841456 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:47.841328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:48.049117 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:48.049079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"6ff7d4f317812bb475c966d1e29d1391fb0a395f97d2af75b6528327e98786a3"}
Jul 12 15:20:48.841134 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:48.841099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:48.841325 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:48.841207    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:48.841325 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:48.841263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:48.841461 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:48.841404    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:49.841587 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:49.841340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:49.841957 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:49.841642    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:50.092557 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:50.092477    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:50.093084 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:50.093060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:50.844229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:50.844061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:50.844911 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:50.844113    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:50.844911 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:50.844318    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:50.844911 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:50.844365    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:51.058119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.058019    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="8f785b5b298382ab8a1338615ce312d77c92491ebd931f64a7ce00d42f217a66" exitCode=0
Jul 12 15:20:51.058286 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.058118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"8f785b5b298382ab8a1338615ce312d77c92491ebd931f64a7ce00d42f217a66"}
Jul 12 15:20:51.060305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.060267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs" event={"ID":"8ccd7a68-4819-4e12-a8c1-70a9adf04b61","Type":"ContainerStarted","Data":"470f7fe56e5e3a5367ea9177d314f95ac094c49e66d6a610bcd9bc2e125f6243"}
Jul 12 15:20:51.064074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.064051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" event={"ID":"ba2f9b02-4ba2-413c-84f9-66b9d7188afd","Type":"ContainerStarted","Data":"85d8fb01f78aa9ba19d24e4e99307d73a0a707d71f9c7781a1c750a24cb8d321"}
Jul 12 15:20:51.064345 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.064325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:51.064734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.064717    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vgh2w"
Jul 12 15:20:51.114450 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.114402    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9" podStartSLOduration=8.735952763 podStartE2EDuration="29.114371555s" totalImagesPullingTime="20.378418792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:51.112827122 +0000 UTC m=+28.812555902" watchObservedRunningTime="2026-07-12 15:20:51.114371555 +0000 UTC m=+28.814100333"
Jul 12 15:20:51.130644 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.130605    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krlzs" podStartSLOduration=3.601999827 podStartE2EDuration="29.130590095s" totalImagesPullingTime="25.528590268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:20:51.130057677 +0000 UTC m=+28.829786457" watchObservedRunningTime="2026-07-12 15:20:51.130590095 +0000 UTC m=+28.830318922"
Jul 12 15:20:51.841541 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:51.841444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:51.841781 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:51.841590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:52.067254 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.067218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:52.067667 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.067304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:52.067667 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.067355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:52.083874 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.083840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:52.084178 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.084036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:20:52.608680 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.608645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtfj4"]
Jul 12 15:20:52.608867 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.608765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:52.608912 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:52.608864    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:52.611404 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.611362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r6jnw"]
Jul 12 15:20:52.611525 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.611481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:52.611588 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:52.611569    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:52.612010 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.611986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gm2r8"]
Jul 12 15:20:52.612114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:52.612079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:52.612171 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:52.612152    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:53.071082 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:53.071048    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="f8d7dfeba3a77ea938be92ae7c3acaab2735560e37283c542229d4d780964bbd" exitCode=0
Jul 12 15:20:53.071628 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:53.071133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"f8d7dfeba3a77ea938be92ae7c3acaab2735560e37283c542229d4d780964bbd"}
Jul 12 15:20:54.841374 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:54.841214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:54.841740 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:54.841214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:54.841740 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:54.841469    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:54.841740 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:54.841272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:54.841740 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:54.841555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:54.841740 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:54.841641    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:55.077721 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:55.077688    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="1bddb62bd7ac7a2080d4095077c5ac993d383e5248f77326da45bdc185d4c71a" exitCode=0
Jul 12 15:20:55.077867 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:55.077745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"1bddb62bd7ac7a2080d4095077c5ac993d383e5248f77326da45bdc185d4c71a"}
Jul 12 15:20:55.520876 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:55.520839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:55.520876 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:55.520891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:55.521127 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.521004    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:55.521127 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.521035    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:55.521127 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.521074    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:21:27.521057818 +0000 UTC m=+65.220786575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 15:20:55.521127 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.521089    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret podName:7f3cd987-8bf0-4709-bab2-356b6554c845 nodeName:}" failed. No retries permitted until 2026-07-12 15:21:27.521083036 +0000 UTC m=+65.220811793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret") pod "global-pull-secret-syncer-gtfj4" (UID: "7f3cd987-8bf0-4709-bab2-356b6554c845") : object "kube-system"/"original-pull-secret" not registered
Jul 12 15:20:55.621251 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:55.621222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:55.621459 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.621370    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 15:20:55.621459 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.621406    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 15:20:55.621459 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.621418    2581 projected.go:196] Error preparing data for projected volume kube-api-access-fzxdq for pod openshift-network-diagnostics/network-check-target-r6jnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:55.621626 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:55.621476    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq podName:e11d56ad-c690-4f8c-a58a-4deeee59feac nodeName:}" failed. No retries permitted until 2026-07-12 15:21:27.621456998 +0000 UTC m=+65.321185768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxdq" (UniqueName: "kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq") pod "network-check-target-r6jnw" (UID: "e11d56ad-c690-4f8c-a58a-4deeee59feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 15:20:56.840875 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:56.840841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:56.840875 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:56.840870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:56.841436 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:56.840980    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:20:56.841499 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:56.841427    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtfj4" podUID="7f3cd987-8bf0-4709-bab2-356b6554c845"
Jul 12 15:20:56.841499 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:56.841470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:56.841613 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:56.841589    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r6jnw" podUID="e11d56ad-c690-4f8c-a58a-4deeee59feac"
Jul 12 15:20:57.128430 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.128397    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeReady"
Jul 12 15:20:57.128615 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.128551    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 15:20:57.172612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.172577    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h65rm"]
Jul 12 15:20:57.174591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.174570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4xvb"]
Jul 12 15:20:57.174719 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.174672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.176504 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.176483    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.178220 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.178188    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 15:20:57.178220 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.178199    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 15:20:57.178540 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.178524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns4rd\""
Jul 12 15:20:57.180152 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.180134    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 15:20:57.180316 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.180297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 15:20:57.180474 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.180333    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 15:20:57.180542 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.180487    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-79jmw\""
Jul 12 15:20:57.185172 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.185153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h65rm"]
Jul 12 15:20:57.188226 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.188205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4xvb"]
Jul 12 15:20:57.331361 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5bn\" (UniqueName: \"kubernetes.io/projected/57889e21-296d-4e58-98d7-847374c2d221-kube-api-access-lj5bn\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.331547 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57889e21-296d-4e58-98d7-847374c2d221-cert\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.331547 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb6e1548-b802-47e4-af2d-bf6c19691a7e-config-volume\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.331661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb6e1548-b802-47e4-af2d-bf6c19691a7e-tmp-dir\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.331661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.331661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.331621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9jnx\" (UniqueName: \"kubernetes.io/projected/cb6e1548-b802-47e4-af2d-bf6c19691a7e-kube-api-access-t9jnx\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.432698 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.432618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5bn\" (UniqueName: \"kubernetes.io/projected/57889e21-296d-4e58-98d7-847374c2d221-kube-api-access-lj5bn\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.432698 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.432685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57889e21-296d-4e58-98d7-847374c2d221-cert\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.432912 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.432711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb6e1548-b802-47e4-af2d-bf6c19691a7e-config-volume\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.432912 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.432747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb6e1548-b802-47e4-af2d-bf6c19691a7e-tmp-dir\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.432912 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.432768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.433051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.433017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9jnx\" (UniqueName: \"kubernetes.io/projected/cb6e1548-b802-47e4-af2d-bf6c19691a7e-kube-api-access-t9jnx\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.433106 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:57.433044    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:20:57.433156 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:57.433121    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:20:57.933099246 +0000 UTC m=+35.632828027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:20:57.433156 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.433124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb6e1548-b802-47e4-af2d-bf6c19691a7e-tmp-dir\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.433395 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.433358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb6e1548-b802-47e4-af2d-bf6c19691a7e-config-volume\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.437560 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.437541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57889e21-296d-4e58-98d7-847374c2d221-cert\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.443860 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.443836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9jnx\" (UniqueName: \"kubernetes.io/projected/cb6e1548-b802-47e4-af2d-bf6c19691a7e-kube-api-access-t9jnx\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.443969 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.443884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5bn\" (UniqueName: \"kubernetes.io/projected/57889e21-296d-4e58-98d7-847374c2d221-kube-api-access-lj5bn\") pod \"ingress-canary-z4xvb\" (UID: \"57889e21-296d-4e58-98d7-847374c2d221\") " pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.494026 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.493985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4xvb"
Jul 12 15:20:57.937631 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:57.937597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:57.938237 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:57.937772    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:20:57.938237 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:57.937851    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:20:58.937830757 +0000 UTC m=+36.637559517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:20:58.840672 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.840634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:20:58.840672 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.840665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:20:58.840899 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.840633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:20:58.844213 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.844190    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 15:20:58.844347 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.844282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ztf2\""
Jul 12 15:20:58.845658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.845438    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 15:20:58.845658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.845463    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 15:20:58.845658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.845475    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bw5ll\""
Jul 12 15:20:58.845658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.845580    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 15:20:58.945135 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:58.945097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:20:58.945725 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:58.945256    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:20:58.945725 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:20:58.945320    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:21:00.94530045 +0000 UTC m=+38.645029207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:20:59.144672 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:20:59.144491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4xvb"]
Jul 12 15:20:59.147919 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:20:59.147887    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57889e21_296d_4e58_98d7_847374c2d221.slice/crio-f9df22ad8fbecde1fe26bce9da2968bc48a62eb3e79ecda171918583b84d9833 WatchSource:0}: Error finding container f9df22ad8fbecde1fe26bce9da2968bc48a62eb3e79ecda171918583b84d9833: Status 404 returned error can't find the container with id f9df22ad8fbecde1fe26bce9da2968bc48a62eb3e79ecda171918583b84d9833
Jul 12 15:21:00.094085 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:00.094047    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="c2b8afe2552ba26210239eddabc021a6e8a63158437f36f83e33db2df96b71cd" exitCode=0
Jul 12 15:21:00.094541 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:00.094172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"c2b8afe2552ba26210239eddabc021a6e8a63158437f36f83e33db2df96b71cd"}
Jul 12 15:21:00.095898 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:00.095871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4xvb" event={"ID":"57889e21-296d-4e58-98d7-847374c2d221","Type":"ContainerStarted","Data":"f9df22ad8fbecde1fe26bce9da2968bc48a62eb3e79ecda171918583b84d9833"}
Jul 12 15:21:00.967757 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:00.967714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:21:00.967930 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:00.967884    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:21:00.967980 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:00.967952    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:21:04.967935703 +0000 UTC m=+42.667664461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:21:01.102306 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:01.102269    2581 generic.go:356] "Generic (PLEG): container finished" podID="a259dbfb-9702-463e-8a59-e9e019cbd73d" containerID="ce108bb96b05022cca88c183ccd8692310685b121cd2ad19c79032afd5ac97de" exitCode=0
Jul 12 15:21:01.102841 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:01.102336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerDied","Data":"ce108bb96b05022cca88c183ccd8692310685b121cd2ad19c79032afd5ac97de"}
Jul 12 15:21:02.105936 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:02.105672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4xvb" event={"ID":"57889e21-296d-4e58-98d7-847374c2d221","Type":"ContainerStarted","Data":"3c16659b33657f40b702ccb2fb53971fddb14ae79ed82ce996986c86f2ca5b7a"}
Jul 12 15:21:02.109262 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:02.109237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" event={"ID":"a259dbfb-9702-463e-8a59-e9e019cbd73d","Type":"ContainerStarted","Data":"2e431bcc00162e8376809a79fda12f9107caa6254ad6558e9944038c12b7a692"}
Jul 12 15:21:02.123720 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:02.123675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4xvb" podStartSLOduration=2.818967913 podStartE2EDuration="5.123657306s" totalImagesPullingTime="2.304689393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:02.12302984 +0000 UTC m=+39.822758620" watchObservedRunningTime="2026-07-12 15:21:02.123657306 +0000 UTC m=+39.823386086"
Jul 12 15:21:02.149507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:02.149396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x7rpq" podStartSLOduration=9.347568909 podStartE2EDuration="40.149355093s" totalImagesPullingTime="30.801786184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:02.148893001 +0000 UTC m=+39.848621780" watchObservedRunningTime="2026-07-12 15:21:02.149355093 +0000 UTC m=+39.849083873"
Jul 12 15:21:04.997226 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:04.997190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:21:04.997635 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:04.997320    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:21:04.997635 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:04.997372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:21:12.997358329 +0000 UTC m=+50.697087086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:21:13.052122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:13.052088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:21:13.052580 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:13.052226    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:21:13.052580 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:13.052291    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:21:29.052270013 +0000 UTC m=+66.751998770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:21:24.091398 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:24.091354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzxh9"
Jul 12 15:21:27.554547 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.554509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:21:27.554547 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.554548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:21:27.557196 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.557174    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 15:21:27.557248 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.557196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 15:21:27.565386 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:27.565356    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:21:27.565489 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:27.565475    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:22:31.565458641 +0000 UTC m=+129.265187398 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : secret "metrics-daemon-secret" not found
Jul 12 15:21:27.569283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.569261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f3cd987-8bf0-4709-bab2-356b6554c845-original-pull-secret\") pod \"global-pull-secret-syncer-gtfj4\" (UID: \"7f3cd987-8bf0-4709-bab2-356b6554c845\") " pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:21:27.655164 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.655132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:21:27.657942 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.657925    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 15:21:27.659881 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.659865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtfj4"
Jul 12 15:21:27.667905 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.667885    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 15:21:27.678469 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.678449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxdq\" (UniqueName: \"kubernetes.io/projected/e11d56ad-c690-4f8c-a58a-4deeee59feac-kube-api-access-fzxdq\") pod \"network-check-target-r6jnw\" (UID: \"e11d56ad-c690-4f8c-a58a-4deeee59feac\") " pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:21:27.777684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.777653    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtfj4"]
Jul 12 15:21:27.782792 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:21:27.782766    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3cd987_8bf0_4709_bab2_356b6554c845.slice/crio-01232d1144759a4ca4ef71ceb54840afceac13ea160421d3b05fbde2a77d4b4c WatchSource:0}: Error finding container 01232d1144759a4ca4ef71ceb54840afceac13ea160421d3b05fbde2a77d4b4c: Status 404 returned error can't find the container with id 01232d1144759a4ca4ef71ceb54840afceac13ea160421d3b05fbde2a77d4b4c
Jul 12 15:21:27.967533 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.967496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bw5ll\""
Jul 12 15:21:27.975624 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:27.975601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:21:28.091260 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:28.091225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r6jnw"]
Jul 12 15:21:28.094340 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:21:28.094312    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11d56ad_c690_4f8c_a58a_4deeee59feac.slice/crio-5f9cd503a5948386011f36fa62203b88870d3ec52dc1e2134ee258ab99427a00 WatchSource:0}: Error finding container 5f9cd503a5948386011f36fa62203b88870d3ec52dc1e2134ee258ab99427a00: Status 404 returned error can't find the container with id 5f9cd503a5948386011f36fa62203b88870d3ec52dc1e2134ee258ab99427a00
Jul 12 15:21:28.167121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:28.167082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtfj4" event={"ID":"7f3cd987-8bf0-4709-bab2-356b6554c845","Type":"ContainerStarted","Data":"01232d1144759a4ca4ef71ceb54840afceac13ea160421d3b05fbde2a77d4b4c"}
Jul 12 15:21:28.168101 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:28.168076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r6jnw" event={"ID":"e11d56ad-c690-4f8c-a58a-4deeee59feac","Type":"ContainerStarted","Data":"5f9cd503a5948386011f36fa62203b88870d3ec52dc1e2134ee258ab99427a00"}
Jul 12 15:21:29.066776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:29.066739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:21:29.067184 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:29.066907    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:21:29.067184 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:21:29.066991    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:22:01.066966889 +0000 UTC m=+98.766695647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:21:33.182207 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:33.182168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r6jnw" event={"ID":"e11d56ad-c690-4f8c-a58a-4deeee59feac","Type":"ContainerStarted","Data":"ed514c616c00ba99101a1e1bb2abf6d977800dfb7250e5f58d0dd9c1cdddd1e8"}
Jul 12 15:21:33.182721 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:33.182271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:21:33.183627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:33.183603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtfj4" event={"ID":"7f3cd987-8bf0-4709-bab2-356b6554c845","Type":"ContainerStarted","Data":"286da2d873ea13fd0eb6b333b1a9e3ac8b2ee5a2ccb193e35000e187916c505e"}
Jul 12 15:21:33.196730 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:33.196681    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r6jnw" podStartSLOduration=66.312173334 podStartE2EDuration="1m11.196661896s" totalImagesPullingTime="4.884488562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:33.196115995 +0000 UTC m=+70.895844776" watchObservedRunningTime="2026-07-12 15:21:33.196661896 +0000 UTC m=+70.896390676"
Jul 12 15:21:33.210370 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:21:33.210317    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gtfj4" podStartSLOduration=66.001355552 podStartE2EDuration="1m11.210301528s" totalImagesPullingTime="5.208945976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:21:33.209599102 +0000 UTC m=+70.909327884" watchObservedRunningTime="2026-07-12 15:21:33.210301528 +0000 UTC m=+70.910030307"
Jul 12 15:22:01.079900 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:22:01.079775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:22:01.079900 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:22:01.079889    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:22:01.080441 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:22:01.079963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:23:05.079944857 +0000 UTC m=+162.779673615 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:22:04.188658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:22:04.188630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r6jnw"
Jul 12 15:22:31.589533 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:22:31.589482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:22:31.590017 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:22:31.589639    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:22:31.590017 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:22:31.589710    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:33.589691936 +0000 UTC m=+251.289420693 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : secret "metrics-daemon-secret" not found
Jul 12 15:23:00.186649 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:23:00.186593    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h65rm" podUID="cb6e1548-b802-47e4-af2d-bf6c19691a7e"
Jul 12 15:23:00.386761 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:23:00.386731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:23:01.852601 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:23:01.852551    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:23:05.105537 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:23:05.105486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:23:05.105893 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:23:05.105641    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 15:23:05.105893 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:23:05.105737    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls podName:cb6e1548-b802-47e4-af2d-bf6c19691a7e nodeName:}" failed. No retries permitted until 2026-07-12 15:25:07.105718922 +0000 UTC m=+284.805447680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls") pod "dns-default-h65rm" (UID: "cb6e1548-b802-47e4-af2d-bf6c19691a7e") : secret "dns-default-metrics-tls" not found
Jul 12 15:23:12.842474 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:23:12.842435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:24:16.962681 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.962641    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pw7mv"]
Jul 12 15:24:16.964731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.964713    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c5d54b844-nzqwh"]
Jul 12 15:24:16.964864 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.964845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:16.966555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.966531    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"]
Jul 12 15:24:16.966692 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.966670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:16.968130 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.968112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"
Jul 12 15:24:16.968570 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.968553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 12 15:24:16.968753 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.968739    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vltsm\""
Jul 12 15:24:16.968798 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.968764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 15:24:16.969334 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.969321    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 15:24:16.969744 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.969729    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 12 15:24:16.970775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.970757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 12 15:24:16.970775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.970769    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hrlzl\""
Jul 12 15:24:16.970925 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.970837    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 15:24:16.971064 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.971048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qk88w\""
Jul 12 15:24:16.971323 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.971307    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 15:24:16.971850 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.971597    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 12 15:24:16.971850 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.971659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 12 15:24:16.972883 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.972855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 12 15:24:16.976112 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.976086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 12 15:24:16.982109 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.982091    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"]
Jul 12 15:24:16.985249 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.985191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pw7mv"]
Jul 12 15:24:16.988116 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:16.988094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c5d54b844-nzqwh"]
Jul 12 15:24:17.036316 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.036271    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"]
Jul 12 15:24:17.038497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.038480    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"]
Jul 12 15:24:17.038612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.038595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.040119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.040098    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:24:17.040241 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.040222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.042090 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.042069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.043085 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043067    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 12 15:24:17.043423 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043406    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9pnkn\""
Jul 12 15:24:17.043498 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043413    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 12 15:24:17.043555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043500    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 12 15:24:17.043634 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 12 15:24:17.043773 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043755    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:24:17.043873 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.043813    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 12 15:24:17.044040 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.044021    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:24:17.044131 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.044081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9hkr6\""
Jul 12 15:24:17.044488 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.044459    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 12 15:24:17.044702 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.044686    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 15:24:17.045014 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.044993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wn7g5\""
Jul 12 15:24:17.045506 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.045462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 15:24:17.046048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.046031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 15:24:17.052636 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.052499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 15:24:17.056097 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.056079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"]
Jul 12 15:24:17.057142 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.057124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"]
Jul 12 15:24:17.058319 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.058301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:24:17.072306 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7scn\" (UniqueName: \"kubernetes.io/projected/840cc992-4ed5-4816-a199-826fd2a24a5c-kube-api-access-p7scn\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.072452 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.072452 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/930c33da-a5e7-44bc-9b30-4847d52ef4f9-config\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.072558 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0cec0eef-624e-4d4f-b07b-28dcbec1e979-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.072558 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.072558 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.072558 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-stats-auth\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fm6l\" (UniqueName: \"kubernetes.io/projected/24ca2886-2b31-45f1-906f-7aa87950f9cd-kube-api-access-8fm6l\") pod \"network-check-source-869dcfcdcd-gp2rz\" (UID: \"24ca2886-2b31-45f1-906f-7aa87950f9cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8b7b\" (UniqueName: \"kubernetes.io/projected/930c33da-a5e7-44bc-9b30-4847d52ef4f9-kube-api-access-m8b7b\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d2lr\" (UniqueName: \"kubernetes.io/projected/0cec0eef-624e-4d4f-b07b-28dcbec1e979-kube-api-access-4d2lr\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/930c33da-a5e7-44bc-9b30-4847d52ef4f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.072748 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sg2q\" (UniqueName: \"kubernetes.io/projected/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-kube-api-access-7sg2q\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-snapshots\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0cec0eef-624e-4d4f-b07b-28dcbec1e979-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-default-certificate\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-serving-cert\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.072983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwv9k\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.073036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.073016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-tmp\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.173486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/930c33da-a5e7-44bc-9b30-4847d52ef4f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.173486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.173731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.173731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.173731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sg2q\" (UniqueName: \"kubernetes.io/projected/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-kube-api-access-7sg2q\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.173731 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.173654    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 15:24:17.173731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-snapshots\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.173748    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:17.673727524 +0000 UTC m=+235.373456302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : secret "router-metrics-certs-default" not found
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0cec0eef-624e-4d4f-b07b-28dcbec1e979-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-default-certificate\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-serving-cert\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.173985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwv9k\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-tmp\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.174033    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:17.674014867 +0000 UTC m=+235.373743643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7scn\" (UniqueName: \"kubernetes.io/projected/840cc992-4ed5-4816-a199-826fd2a24a5c-kube-api-access-p7scn\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/930c33da-a5e7-44bc-9b30-4847d52ef4f9-config\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0cec0eef-624e-4d4f-b07b-28dcbec1e979-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-stats-auth\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-tmp\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fm6l\" (UniqueName: \"kubernetes.io/projected/24ca2886-2b31-45f1-906f-7aa87950f9cd-kube-api-access-8fm6l\") pod \"network-check-source-869dcfcdcd-gp2rz\" (UID: \"24ca2886-2b31-45f1-906f-7aa87950f9cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-snapshots\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8b7b\" (UniqueName: \"kubernetes.io/projected/930c33da-a5e7-44bc-9b30-4847d52ef4f9-kube-api-access-m8b7b\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d2lr\" (UniqueName: \"kubernetes.io/projected/0cec0eef-624e-4d4f-b07b-28dcbec1e979-kube-api-access-4d2lr\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.174543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.175356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.174623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0cec0eef-624e-4d4f-b07b-28dcbec1e979-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.175356 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.174839    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 15:24:17.175356 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.174855    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7479f85768-rgdcp: secret "image-registry-tls" not found
Jul 12 15:24:17.175356 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.174912    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls podName:b21f0b44-171e-4b14-b63f-fe4f6f48e0b2 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:17.674894589 +0000 UTC m=+235.374623352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls") pod "image-registry-7479f85768-rgdcp" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2") : secret "image-registry-tls" not found
Jul 12 15:24:17.175655 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.175530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/930c33da-a5e7-44bc-9b30-4847d52ef4f9-config\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.175766 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.175738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.176679 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.176651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/930c33da-a5e7-44bc-9b30-4847d52ef4f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.176965 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.176943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-serving-cert\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.177250 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.177226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-default-certificate\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.177337 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.177265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.177337 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.177270    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.178021 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.177999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-stats-auth\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.178216 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.178195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0cec0eef-624e-4d4f-b07b-28dcbec1e979-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.178277 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.178217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.179557 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.179537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.179603 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.179562    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.184199 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.184096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.184673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.184600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sg2q\" (UniqueName: \"kubernetes.io/projected/8fffdf3f-a241-48ee-b5f0-2b0e50a384d8-kube-api-access-7sg2q\") pod \"insights-operator-68d9dd94cf-pw7mv\" (UID: \"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8\") " pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.185806 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.185766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d2lr\" (UniqueName: \"kubernetes.io/projected/0cec0eef-624e-4d4f-b07b-28dcbec1e979-kube-api-access-4d2lr\") pod \"kube-storage-version-migrator-operator-799cb7f958-czl4g\" (UID: \"0cec0eef-624e-4d4f-b07b-28dcbec1e979\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.186169 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.186121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8b7b\" (UniqueName: \"kubernetes.io/projected/930c33da-a5e7-44bc-9b30-4847d52ef4f9-kube-api-access-m8b7b\") pod \"service-ca-operator-7695fc6c8c-nx5hg\" (UID: \"930c33da-a5e7-44bc-9b30-4847d52ef4f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.186459 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.186437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fm6l\" (UniqueName: \"kubernetes.io/projected/24ca2886-2b31-45f1-906f-7aa87950f9cd-kube-api-access-8fm6l\") pod \"network-check-source-869dcfcdcd-gp2rz\" (UID: \"24ca2886-2b31-45f1-906f-7aa87950f9cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"
Jul 12 15:24:17.186739 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.186718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7scn\" (UniqueName: \"kubernetes.io/projected/840cc992-4ed5-4816-a199-826fd2a24a5c-kube-api-access-p7scn\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.186833 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.186817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwv9k\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.275172 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.275091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv"
Jul 12 15:24:17.291133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.291104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"
Jul 12 15:24:17.348719 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.348689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"
Jul 12 15:24:17.361869 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.361835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"
Jul 12 15:24:17.409715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.409619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pw7mv"]
Jul 12 15:24:17.445369 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.445343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz"]
Jul 12 15:24:17.449104 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:17.449073    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ca2886_2b31_45f1_906f_7aa87950f9cd.slice/crio-69132642add3b49a7d82e54d2e9c9970912fddfaef3fafc8bf382866e69a513c WatchSource:0}: Error finding container 69132642add3b49a7d82e54d2e9c9970912fddfaef3fafc8bf382866e69a513c: Status 404 returned error can't find the container with id 69132642add3b49a7d82e54d2e9c9970912fddfaef3fafc8bf382866e69a513c
Jul 12 15:24:17.494864 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.494835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg"]
Jul 12 15:24:17.501354 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:17.501326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930c33da_a5e7_44bc_9b30_4847d52ef4f9.slice/crio-16c2582fdf65f9ec0ee36b95ed4a451b15bece2a9b4aaf0b4d6fc67b93ffeb7a WatchSource:0}: Error finding container 16c2582fdf65f9ec0ee36b95ed4a451b15bece2a9b4aaf0b4d6fc67b93ffeb7a: Status 404 returned error can't find the container with id 16c2582fdf65f9ec0ee36b95ed4a451b15bece2a9b4aaf0b4d6fc67b93ffeb7a
Jul 12 15:24:17.512767 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.512738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g"]
Jul 12 15:24:17.516076 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:17.516050    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cec0eef_624e_4d4f_b07b_28dcbec1e979.slice/crio-a73db66425830996ad26f9d6eda6d7e4bf7a87fdd87cd5ebfbb31b56f0bf30ce WatchSource:0}: Error finding container a73db66425830996ad26f9d6eda6d7e4bf7a87fdd87cd5ebfbb31b56f0bf30ce: Status 404 returned error can't find the container with id a73db66425830996ad26f9d6eda6d7e4bf7a87fdd87cd5ebfbb31b56f0bf30ce
Jul 12 15:24:17.565497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.565408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz" event={"ID":"24ca2886-2b31-45f1-906f-7aa87950f9cd","Type":"ContainerStarted","Data":"003de7ad2b098442539586f2a69a0fed11296d966a3c1a1b4e45caa2760610d0"}
Jul 12 15:24:17.565497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.565469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz" event={"ID":"24ca2886-2b31-45f1-906f-7aa87950f9cd","Type":"ContainerStarted","Data":"69132642add3b49a7d82e54d2e9c9970912fddfaef3fafc8bf382866e69a513c"}
Jul 12 15:24:17.566493 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.566470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g" event={"ID":"0cec0eef-624e-4d4f-b07b-28dcbec1e979","Type":"ContainerStarted","Data":"a73db66425830996ad26f9d6eda6d7e4bf7a87fdd87cd5ebfbb31b56f0bf30ce"}
Jul 12 15:24:17.567544 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.567518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv" event={"ID":"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8","Type":"ContainerStarted","Data":"173c9717d3a69b8d0f4d9d7e4731073eff46bce3fe976b03ad1492aec125ea0f"}
Jul 12 15:24:17.568565 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.568534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg" event={"ID":"930c33da-a5e7-44bc-9b30-4847d52ef4f9","Type":"ContainerStarted","Data":"16c2582fdf65f9ec0ee36b95ed4a451b15bece2a9b4aaf0b4d6fc67b93ffeb7a"}
Jul 12 15:24:17.583614 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.583571    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gp2rz" podStartSLOduration=1.583548468 podStartE2EDuration="1.583548468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:17.582648917 +0000 UTC m=+235.282377697" watchObservedRunningTime="2026-07-12 15:24:17.583548468 +0000 UTC m=+235.283277246"
Jul 12 15:24:17.679217 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.679179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:17.679372 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.679239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.679372 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:17.679283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:17.679372 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679355    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 15:24:17.679582 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679400    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7479f85768-rgdcp: secret "image-registry-tls" not found
Jul 12 15:24:17.679582 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679422    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:18.679405017 +0000 UTC m=+236.379133775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:17.679582 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679454    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 15:24:17.679582 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679470    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls podName:b21f0b44-171e-4b14-b63f-fe4f6f48e0b2 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:18.679452313 +0000 UTC m=+236.379181073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls") pod "image-registry-7479f85768-rgdcp" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2") : secret "image-registry-tls" not found
Jul 12 15:24:17.679582 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:17.679520    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:18.679503504 +0000 UTC m=+236.379232263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : secret "router-metrics-certs-default" not found
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:18.687504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:18.687580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:18.687642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.687752    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.687828    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:20.687807855 +0000 UTC m=+238.387536616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : secret "router-metrics-certs-default" not found
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.688041    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:20.688028643 +0000 UTC m=+238.387757400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.688108    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.688120    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7479f85768-rgdcp: secret "image-registry-tls" not found
Jul 12 15:24:18.688173 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:18.688151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls podName:b21f0b44-171e-4b14-b63f-fe4f6f48e0b2 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:20.688140469 +0000 UTC m=+238.387869240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls") pod "image-registry-7479f85768-rgdcp" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2") : secret "image-registry-tls" not found
Jul 12 15:24:20.707886 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:20.707796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:20.707886 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:20.707849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:20.707902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.707961    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.708025    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.708036    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:24.708011359 +0000 UTC m=+242.407740118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : secret "router-metrics-certs-default" not found
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.708041    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7479f85768-rgdcp: secret "image-registry-tls" not found
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.708088    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls podName:b21f0b44-171e-4b14-b63f-fe4f6f48e0b2 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:24.708071041 +0000 UTC m=+242.407799798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls") pod "image-registry-7479f85768-rgdcp" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2") : secret "image-registry-tls" not found
Jul 12 15:24:20.708353 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:20.708164    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:24.708153861 +0000 UTC m=+242.407882621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:21.583268 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.583231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g" event={"ID":"0cec0eef-624e-4d4f-b07b-28dcbec1e979","Type":"ContainerStarted","Data":"c58dd9a10c46104218264e3695a75fcc980ae10da95a5da251166de655288574"}
Jul 12 15:24:21.584646 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.584620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv" event={"ID":"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8","Type":"ContainerStarted","Data":"31293c5b59f5bbf10a0a5c2b357deff242378702ef687a6b9b0a90978d18d112"}
Jul 12 15:24:21.586006 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.585985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg" event={"ID":"930c33da-a5e7-44bc-9b30-4847d52ef4f9","Type":"ContainerStarted","Data":"737e1aa1ef6e8454f95f8244e32f77d2d38d43700993ee33ea0765bf6ca1872d"}
Jul 12 15:24:21.600536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.600480    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g" podStartSLOduration=1.4825031960000001 podStartE2EDuration="4.600462031s" totalImagesPullingTime="3.117958835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:21.599194083 +0000 UTC m=+239.298922873" watchObservedRunningTime="2026-07-12 15:24:21.600462031 +0000 UTC m=+239.300190812"
Jul 12 15:24:21.617762 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.617715    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv" podStartSLOduration=2.406172877 podStartE2EDuration="5.617698424s" totalImagesPullingTime="3.211525547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:21.616787577 +0000 UTC m=+239.316516357" watchObservedRunningTime="2026-07-12 15:24:21.617698424 +0000 UTC m=+239.317427205"
Jul 12 15:24:21.631003 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.630959    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg" podStartSLOduration=1.496368108 podStartE2EDuration="4.630945276s" totalImagesPullingTime="3.134577168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:21.630848068 +0000 UTC m=+239.330576848" watchObservedRunningTime="2026-07-12 15:24:21.630945276 +0000 UTC m=+239.330674054"
Jul 12 15:24:21.883705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.883668    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ccf54"]
Jul 12 15:24:21.886362 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.886343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:21.889044 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.889024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 15:24:21.889121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.889044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 15:24:21.889121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.889062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4k8zs\""
Jul 12 15:24:21.899787 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:21.899766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ccf54"]
Jul 12 15:24:22.020213 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.020168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-data-volume\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.020213 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.020214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-crio-socket\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.020476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.020308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.020476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.020342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchww\" (UniqueName: \"kubernetes.io/projected/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-api-access-kchww\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.020476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.020419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121544 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.121507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-data-volume\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121723 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.121563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-crio-socket\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121723 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.121641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121723 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.121673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchww\" (UniqueName: \"kubernetes.io/projected/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-api-access-kchww\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121925 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.121740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.121925 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.121879    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:24:22.122016 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.121960    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:22.621929488 +0000 UTC m=+240.321658250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : configmap "kube-rbac-proxy" not found
Jul 12 15:24:22.122615 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.122587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-data-volume\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.122741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.122685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-crio-socket\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.122814 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.122798    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:22.122880 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.122868    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:22.622839502 +0000 UTC m=+240.322568266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:22.136312 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.136250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchww\" (UniqueName: \"kubernetes.io/projected/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-api-access-kchww\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.625025 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.624991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.625284 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:22.625046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:22.625284 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.625129    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:24:22.625284 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.625138    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:22.625284 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.625180    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:23.62516677 +0000 UTC m=+241.324895528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : configmap "kube-rbac-proxy" not found
Jul 12 15:24:22.625284 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:22.625192    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:23.625186767 +0000 UTC m=+241.324915523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:23.634605 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:23.634571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:23.634991 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:23.634682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:23.634991 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:23.634697    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:24:23.634991 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:23.634756    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:25.634741423 +0000 UTC m=+243.334470200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : configmap "kube-rbac-proxy" not found
Jul 12 15:24:23.634991 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:23.634796    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:23.634991 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:23.634841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:25.634830128 +0000 UTC m=+243.334558884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:23.848767 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:23.848742    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69hkn_b7e21e19-9e0e-42fe-9064-82fbadfa5102/dns-node-resolver/0.log"
Jul 12 15:24:24.744298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:24.744260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:24.744329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:24.744365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744474    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:32.744454139 +0000 UTC m=+250.444182895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744483    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744505    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7479f85768-rgdcp: secret "image-registry-tls" not found
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744552    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls podName:b21f0b44-171e-4b14-b63f-fe4f6f48e0b2 nodeName:}" failed. No retries permitted until 2026-07-12 15:24:32.744540683 +0000 UTC m=+250.444269441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls") pod "image-registry-7479f85768-rgdcp" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2") : secret "image-registry-tls" not found
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744477    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 15:24:24.744744 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:24.744591    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:32.74458361 +0000 UTC m=+250.444312368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : secret "router-metrics-certs-default" not found
Jul 12 15:24:25.049085 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:25.049005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq5x6_dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5/node-ca/0.log"
Jul 12 15:24:25.650705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:25.650667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:25.650910 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:25.650724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:25.650910 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:25.650834    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:24:25.650910 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:25.650833    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:25.650910 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:25.650893    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:29.650876166 +0000 UTC m=+247.350604926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : configmap "kube-rbac-proxy" not found
Jul 12 15:24:25.650910 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:25.650907    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:29.650900893 +0000 UTC m=+247.350629649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:25.848790 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:25.848750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4xvb_57889e21-296d-4e58-98d7-847374c2d221/serve-healthcheck-canary/0.log"
Jul 12 15:24:29.684356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:29.684306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:29.684835 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:29.684422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:29.684835 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:29.684471    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:29.684835 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:29.684537    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 15:24:29.684835 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:29.684542    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:37.684525614 +0000 UTC m=+255.384254371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : secret "insights-runtime-extractor-tls" not found
Jul 12 15:24:29.684835 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:29.684594    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm podName:32bd4e7f-f2d9-4e60-b448-f89c7af81b6b nodeName:}" failed. No retries permitted until 2026-07-12 15:24:37.684581028 +0000 UTC m=+255.384309786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ccf54" (UID: "32bd4e7f-f2d9-4e60-b448-f89c7af81b6b") : configmap "kube-rbac-proxy" not found
Jul 12 15:24:32.809393 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.809344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:32.809871 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.809447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:32.809871 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.809500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:32.809871 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:32.809661    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle podName:840cc992-4ed5-4816-a199-826fd2a24a5c nodeName:}" failed. No retries permitted until 2026-07-12 15:24:48.809641339 +0000 UTC m=+266.509370116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle") pod "router-default-5c5d54b844-nzqwh" (UID: "840cc992-4ed5-4816-a199-826fd2a24a5c") : configmap references non-existent config key: service-ca.crt
Jul 12 15:24:32.811847 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.811818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"image-registry-7479f85768-rgdcp\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") " pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:32.811936 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.811918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/840cc992-4ed5-4816-a199-826fd2a24a5c-metrics-certs\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:32.958687 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.958662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wn7g5\""
Jul 12 15:24:32.966643 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:32.966613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:33.095986 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.095958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:24:33.098678 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:33.098653    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21f0b44_171e_4b14_b63f_fe4f6f48e0b2.slice/crio-9ece4d23bd733886e95212f326e4ed4109c1a141b08521d5db967efecc05811e WatchSource:0}: Error finding container 9ece4d23bd733886e95212f326e4ed4109c1a141b08521d5db967efecc05811e: Status 404 returned error can't find the container with id 9ece4d23bd733886e95212f326e4ed4109c1a141b08521d5db967efecc05811e
Jul 12 15:24:33.615829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.615796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:24:33.616001 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:33.615906    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 15:24:33.616001 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:24:33.615978    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs podName:7a2452ce-e603-4061-9cdf-baedd16ad299 nodeName:}" failed. No retries permitted until 2026-07-12 15:26:35.615963764 +0000 UTC m=+373.315692522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs") pod "network-metrics-daemon-gm2r8" (UID: "7a2452ce-e603-4061-9cdf-baedd16ad299") : secret "metrics-daemon-secret" not found
Jul 12 15:24:33.621317 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.621291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" event={"ID":"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2","Type":"ContainerStarted","Data":"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"}
Jul 12 15:24:33.621456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.621362    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" event={"ID":"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2","Type":"ContainerStarted","Data":"9ece4d23bd733886e95212f326e4ed4109c1a141b08521d5db967efecc05811e"}
Jul 12 15:24:33.621456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.621421    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:24:33.639203 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:33.639156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" podStartSLOduration=16.63914309 podStartE2EDuration="16.63914309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:33.638318493 +0000 UTC m=+251.338047273" watchObservedRunningTime="2026-07-12 15:24:33.63914309 +0000 UTC m=+251.338871869"
Jul 12 15:24:37.747173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.747144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:37.747580 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.747185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:37.748439 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.748420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:37.749639 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.749620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32bd4e7f-f2d9-4e60-b448-f89c7af81b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ccf54\" (UID: \"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b\") " pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:37.798232 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.798202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4k8zs\""
Jul 12 15:24:37.806207 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.806189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ccf54"
Jul 12 15:24:37.931312 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:37.931281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ccf54"]
Jul 12 15:24:37.934183 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:37.934159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bd4e7f_f2d9_4e60_b448_f89c7af81b6b.slice/crio-c583f8dcf8872267a10792b618fd43353a9826b49f1a82c04d6e0956151164af WatchSource:0}: Error finding container c583f8dcf8872267a10792b618fd43353a9826b49f1a82c04d6e0956151164af: Status 404 returned error can't find the container with id c583f8dcf8872267a10792b618fd43353a9826b49f1a82c04d6e0956151164af
Jul 12 15:24:38.638407 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:38.638351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ccf54" event={"ID":"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b","Type":"ContainerStarted","Data":"c583f8dcf8872267a10792b618fd43353a9826b49f1a82c04d6e0956151164af"}
Jul 12 15:24:41.649582 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:41.649540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ccf54" event={"ID":"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b","Type":"ContainerStarted","Data":"eb9974be331c60beb5f3f78073aa68cc47dd6960fc22c2413efb986e1b47ef6b"}
Jul 12 15:24:42.655151 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:42.655105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ccf54" event={"ID":"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b","Type":"ContainerStarted","Data":"745f8aedd9eccde2ead0a816da972672ba7b9b43cf76d8376ed8a423b1d85c69"}
Jul 12 15:24:45.079920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.079833    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:24:45.110426 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.110366    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86dddbc9f6-jmntg"]
Jul 12 15:24:45.114180 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.114155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.122181 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.122152    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86dddbc9f6-jmntg"]
Jul 12 15:24:45.209327 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-trusted-ca\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209327 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4eb3196-0e36-4497-8ee0-1555fad51808-ca-trust-extracted\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-tls\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-image-registry-private-configuration\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-certificates\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209735 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-installation-pull-secrets\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209735 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzkw\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-kube-api-access-vgzkw\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.209735 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.209723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-bound-sa-token\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311128 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-image-registry-private-configuration\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311128 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-certificates\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311395 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-installation-pull-secrets\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzkw\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-kube-api-access-vgzkw\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-bound-sa-token\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-trusted-ca\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4eb3196-0e36-4497-8ee0-1555fad51808-ca-trust-extracted\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.311564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-tls\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.312015 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.311987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4eb3196-0e36-4497-8ee0-1555fad51808-ca-trust-extracted\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.312212 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.312140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-certificates\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.312543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.312521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4eb3196-0e36-4497-8ee0-1555fad51808-trusted-ca\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.313860 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.313833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-image-registry-private-configuration\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.313961 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.313834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4eb3196-0e36-4497-8ee0-1555fad51808-installation-pull-secrets\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.313961 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.313919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-registry-tls\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.320185 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.320164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzkw\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-kube-api-access-vgzkw\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.320529 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.320511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb3196-0e36-4497-8ee0-1555fad51808-bound-sa-token\") pod \"image-registry-86dddbc9f6-jmntg\" (UID: \"e4eb3196-0e36-4497-8ee0-1555fad51808\") " pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.422649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.422610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.555505 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.555472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86dddbc9f6-jmntg"]
Jul 12 15:24:45.558663 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:45.558640    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4eb3196_0e36_4497_8ee0_1555fad51808.slice/crio-47e117768e1e5532a7588050078077c32b20b7afed3a78670580b5da592cd153 WatchSource:0}: Error finding container 47e117768e1e5532a7588050078077c32b20b7afed3a78670580b5da592cd153: Status 404 returned error can't find the container with id 47e117768e1e5532a7588050078077c32b20b7afed3a78670580b5da592cd153
Jul 12 15:24:45.666322 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.666278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" event={"ID":"e4eb3196-0e36-4497-8ee0-1555fad51808","Type":"ContainerStarted","Data":"8dfce2a9fb135ac40c4e85dc309959316ac04c1fd83586208ca92f7d2b6b8ef5"}
Jul 12 15:24:45.666518 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.666338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" event={"ID":"e4eb3196-0e36-4497-8ee0-1555fad51808","Type":"ContainerStarted","Data":"47e117768e1e5532a7588050078077c32b20b7afed3a78670580b5da592cd153"}
Jul 12 15:24:45.666518 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.666368    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:24:45.668436 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.668411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ccf54" event={"ID":"32bd4e7f-f2d9-4e60-b448-f89c7af81b6b","Type":"ContainerStarted","Data":"dd6e7ce250f4b928d87b32a7ca3cf73a143004a2f7a0841d76f22b8c105f925a"}
Jul 12 15:24:45.684285 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.684192    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" podStartSLOduration=0.684175985 podStartE2EDuration="684.175985ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:45.683240726 +0000 UTC m=+263.382969508" watchObservedRunningTime="2026-07-12 15:24:45.684175985 +0000 UTC m=+263.383904741"
Jul 12 15:24:45.700176 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:45.700125    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ccf54" podStartSLOduration=18.052152265 podStartE2EDuration="24.700106071s" totalImagesPullingTime="6.647953806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 15:24:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:45.699210127 +0000 UTC m=+263.398938909" watchObservedRunningTime="2026-07-12 15:24:45.700106071 +0000 UTC m=+263.399834863"
Jul 12 15:24:48.838732 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:48.838683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:48.839303 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:48.839284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840cc992-4ed5-4816-a199-826fd2a24a5c-service-ca-bundle\") pod \"router-default-5c5d54b844-nzqwh\" (UID: \"840cc992-4ed5-4816-a199-826fd2a24a5c\") " pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:49.086915 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.086881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hrlzl\""
Jul 12 15:24:49.095095 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.095077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:49.223079 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.222969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c5d54b844-nzqwh"]
Jul 12 15:24:49.225478 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:49.225445    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840cc992_4ed5_4816_a199_826fd2a24a5c.slice/crio-5cf171178a13308777d1a8954e41df335fb7f4f9a89b974a18b9a4b6ce2af6d5 WatchSource:0}: Error finding container 5cf171178a13308777d1a8954e41df335fb7f4f9a89b974a18b9a4b6ce2af6d5: Status 404 returned error can't find the container with id 5cf171178a13308777d1a8954e41df335fb7f4f9a89b974a18b9a4b6ce2af6d5
Jul 12 15:24:49.682011 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.681977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c5d54b844-nzqwh" event={"ID":"840cc992-4ed5-4816-a199-826fd2a24a5c","Type":"ContainerStarted","Data":"d37ba945e386ba05861a8b917681f45c3c573dd4d4fad05321ca42fd61fb91fb"}
Jul 12 15:24:49.682178 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.682057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c5d54b844-nzqwh" event={"ID":"840cc992-4ed5-4816-a199-826fd2a24a5c","Type":"ContainerStarted","Data":"5cf171178a13308777d1a8954e41df335fb7f4f9a89b974a18b9a4b6ce2af6d5"}
Jul 12 15:24:49.701154 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:49.701105    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c5d54b844-nzqwh" podStartSLOduration=33.701090871 podStartE2EDuration="33.701090871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:49.700093391 +0000 UTC m=+267.399822171" watchObservedRunningTime="2026-07-12 15:24:49.701090871 +0000 UTC m=+267.400819650"
Jul 12 15:24:50.095735 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:50.095698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:50.098456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:50.098436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:50.685523 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:50.685497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:50.686693 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:50.686671    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c5d54b844-nzqwh"
Jul 12 15:24:55.085862 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.085824    2581 patch_prober.go:28] interesting pod/image-registry-7479f85768-rgdcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 15:24:55.086286 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.085880    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:24:55.481582 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.481548    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8hrzr"]
Jul 12 15:24:55.487162 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.487145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.489823 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.489797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 12 15:24:55.489941 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.489840    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 12 15:24:55.490900 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.490883    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 15:24:55.490996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.490900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 15:24:55.490996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.490938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 15:24:55.491284 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.491268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7cb78\""
Jul 12 15:24:55.492883 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.492863    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8hrzr"]
Jul 12 15:24:55.592217 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.592180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.592451 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.592240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a3940d-627b-41c4-ba26-6c9367e2bae6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.592451 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.592281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.592451 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.592335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqz9t\" (UniqueName: \"kubernetes.io/projected/85a3940d-627b-41c4-ba26-6c9367e2bae6-kube-api-access-sqz9t\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.693433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.693363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a3940d-627b-41c4-ba26-6c9367e2bae6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.693647 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.693452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.693647 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.693512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqz9t\" (UniqueName: \"kubernetes.io/projected/85a3940d-627b-41c4-ba26-6c9367e2bae6-kube-api-access-sqz9t\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.693647 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.693565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.694149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.694124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a3940d-627b-41c4-ba26-6c9367e2bae6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.696177 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.696140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.696177 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.696162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a3940d-627b-41c4-ba26-6c9367e2bae6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.702147 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.702128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqz9t\" (UniqueName: \"kubernetes.io/projected/85a3940d-627b-41c4-ba26-6c9367e2bae6-kube-api-access-sqz9t\") pod \"prometheus-operator-64785b6675-8hrzr\" (UID: \"85a3940d-627b-41c4-ba26-6c9367e2bae6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.796275 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.796195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr"
Jul 12 15:24:55.924454 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:55.924351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8hrzr"]
Jul 12 15:24:55.927004 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:24:55.926981    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a3940d_627b_41c4_ba26_6c9367e2bae6.slice/crio-445367a178b8bcde1a1faea9aa690ad133c66ac11799ef7f0f8fe555e81637dd WatchSource:0}: Error finding container 445367a178b8bcde1a1faea9aa690ad133c66ac11799ef7f0f8fe555e81637dd: Status 404 returned error can't find the container with id 445367a178b8bcde1a1faea9aa690ad133c66ac11799ef7f0f8fe555e81637dd
Jul 12 15:24:56.704975 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:56.704938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr" event={"ID":"85a3940d-627b-41c4-ba26-6c9367e2bae6","Type":"ContainerStarted","Data":"445367a178b8bcde1a1faea9aa690ad133c66ac11799ef7f0f8fe555e81637dd"}
Jul 12 15:24:57.709994 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:57.709958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr" event={"ID":"85a3940d-627b-41c4-ba26-6c9367e2bae6","Type":"ContainerStarted","Data":"1333deeffe226e19821f93093b24ba2af62d7b06a0054a9d36c6ed880cb6f7b2"}
Jul 12 15:24:57.710399 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:57.710023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr" event={"ID":"85a3940d-627b-41c4-ba26-6c9367e2bae6","Type":"ContainerStarted","Data":"04717a813d8a712b618d6b1b1999ae65adeebf617bcc95c844d83044add8dfdf"}
Jul 12 15:24:57.726029 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:57.725979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-8hrzr" podStartSLOduration=1.318456552 podStartE2EDuration="2.72596467s" totalImagesPullingTime="1.407508118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:24:57.724682666 +0000 UTC m=+275.424411446" watchObservedRunningTime="2026-07-12 15:24:57.72596467 +0000 UTC m=+275.425693449"
Jul 12 15:24:59.850770 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.850741    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dhd84"]
Jul 12 15:24:59.854120 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.854104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.856822 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.856799    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 15:24:59.856951 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.856855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 15:24:59.857017 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.856953    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p4dw4\""
Jul 12 15:24:59.857207 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.857191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 15:24:59.923236 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-wtmp\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-sys\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-root\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-textfile\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923655 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9khv\" (UniqueName: \"kubernetes.io/projected/61b90ba5-b261-4ae1-96e1-e00ff69014d1-kube-api-access-n9khv\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923655 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:24:59.923655 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:24:59.923523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-metrics-client-ca\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024182 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-sys\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024182 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-root\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-textfile\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9khv\" (UniqueName: \"kubernetes.io/projected/61b90ba5-b261-4ae1-96e1-e00ff69014d1-kube-api-access-n9khv\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-sys\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-root\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-metrics-client-ca\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:00.024414    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024476 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:00.024481    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls podName:61b90ba5-b261-4ae1-96e1-e00ff69014d1 nodeName:}" failed. No retries permitted until 2026-07-12 15:25:00.524457345 +0000 UTC m=+278.224186103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls") pod "node-exporter-dhd84" (UID: "61b90ba5-b261-4ae1-96e1-e00ff69014d1") : secret "node-exporter-tls" not found
Jul 12 15:25:00.024974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-wtmp\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-textfile\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-wtmp\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.024974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.024909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b90ba5-b261-4ae1-96e1-e00ff69014d1-metrics-client-ca\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.026812 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.026789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.032933 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.032907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9khv\" (UniqueName: \"kubernetes.io/projected/61b90ba5-b261-4ae1-96e1-e00ff69014d1-kube-api-access-n9khv\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.528997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.528961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.531319 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.531294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61b90ba5-b261-4ae1-96e1-e00ff69014d1-node-exporter-tls\") pod \"node-exporter-dhd84\" (UID: \"61b90ba5-b261-4ae1-96e1-e00ff69014d1\") " pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.763124 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:00.763095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dhd84"
Jul 12 15:25:00.774827 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:25:00.774796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b90ba5_b261_4ae1_96e1_e00ff69014d1.slice/crio-95357479fac7fb94a6706c7b473c2a4f43857ccf834a01ef35eecf661fb7afef WatchSource:0}: Error finding container 95357479fac7fb94a6706c7b473c2a4f43857ccf834a01ef35eecf661fb7afef: Status 404 returned error can't find the container with id 95357479fac7fb94a6706c7b473c2a4f43857ccf834a01ef35eecf661fb7afef
Jul 12 15:25:01.724890 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.724852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhd84" event={"ID":"61b90ba5-b261-4ae1-96e1-e00ff69014d1","Type":"ContainerStarted","Data":"95357479fac7fb94a6706c7b473c2a4f43857ccf834a01ef35eecf661fb7afef"}
Jul 12 15:25:01.808529 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.808496    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66965f85d8-g98f6"]
Jul 12 15:25:01.811579 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.811563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.814215 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 12 15:25:01.814673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6tqcq\""
Jul 12 15:25:01.814823 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814678    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 12 15:25:01.814823 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814717    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 12 15:25:01.814823 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 12 15:25:01.814823 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-967903hptatii\""
Jul 12 15:25:01.815005 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.814992    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 12 15:25:01.822836 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.822815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66965f85d8-g98f6"]
Jul 12 15:25:01.837762 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.837834 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5d08c-3243-4a58-980d-5518c209cde1-metrics-client-ca\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.837834 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26c9b\" (UniqueName: \"kubernetes.io/projected/e4b5d08c-3243-4a58-980d-5518c209cde1-kube-api-access-26c9b\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.837909 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-grpc-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.837909 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.838000 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.838000 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.837966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.838090 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.838010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938697 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938697 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5d08c-3243-4a58-980d-5518c209cde1-metrics-client-ca\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.938896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.938861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26c9b\" (UniqueName: \"kubernetes.io/projected/e4b5d08c-3243-4a58-980d-5518c209cde1-kube-api-access-26c9b\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.939096 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.939058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-grpc-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.939186 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.939157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.939821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.939774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5d08c-3243-4a58-980d-5518c209cde1-metrics-client-ca\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.941980 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.941924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.941980 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.941936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.942155 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.942137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-grpc-tls\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.942665 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.942638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.942812 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.942791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.942859 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.942835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4b5d08c-3243-4a58-980d-5518c209cde1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:01.950462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:01.950364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26c9b\" (UniqueName: \"kubernetes.io/projected/e4b5d08c-3243-4a58-980d-5518c209cde1-kube-api-access-26c9b\") pod \"thanos-querier-66965f85d8-g98f6\" (UID: \"e4b5d08c-3243-4a58-980d-5518c209cde1\") " pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:02.121315 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:02.121280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:02.256230 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:02.256149    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66965f85d8-g98f6"]
Jul 12 15:25:02.259652 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:25:02.259627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b5d08c_3243_4a58_980d_5518c209cde1.slice/crio-1cfd3f6349b188b1ace8db4104991c74c528c1c8bddbd27572b93d4716c3beef WatchSource:0}: Error finding container 1cfd3f6349b188b1ace8db4104991c74c528c1c8bddbd27572b93d4716c3beef: Status 404 returned error can't find the container with id 1cfd3f6349b188b1ace8db4104991c74c528c1c8bddbd27572b93d4716c3beef
Jul 12 15:25:02.729668 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:02.729639    2581 generic.go:356] "Generic (PLEG): container finished" podID="61b90ba5-b261-4ae1-96e1-e00ff69014d1" containerID="aed3214e746a3c84e4b7eb5235ae2673d80d83f5ba186ccaa0eedaaa811ebec7" exitCode=0
Jul 12 15:25:02.730061 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:02.729739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhd84" event={"ID":"61b90ba5-b261-4ae1-96e1-e00ff69014d1","Type":"ContainerDied","Data":"aed3214e746a3c84e4b7eb5235ae2673d80d83f5ba186ccaa0eedaaa811ebec7"}
Jul 12 15:25:02.730959 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:02.730939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"1cfd3f6349b188b1ace8db4104991c74c528c1c8bddbd27572b93d4716c3beef"}
Jul 12 15:25:03.387506 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:03.387459    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h65rm" podUID="cb6e1548-b802-47e4-af2d-bf6c19691a7e"
Jul 12 15:25:03.737035 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:03.736956    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:03.737035 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:03.736960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhd84" event={"ID":"61b90ba5-b261-4ae1-96e1-e00ff69014d1","Type":"ContainerStarted","Data":"0d13af74270664694a054739fabba53eea3a4efb28f6960b2664664ed30c5b6f"}
Jul 12 15:25:03.737035 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:03.737025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhd84" event={"ID":"61b90ba5-b261-4ae1-96e1-e00ff69014d1","Type":"ContainerStarted","Data":"1255afca43e61728f713a21224c37c9e83247e26a90441360412e6cae5ebfed0"}
Jul 12 15:25:03.756217 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:03.755827    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dhd84" podStartSLOduration=3.622984501 podStartE2EDuration="4.755805472s" totalImagesPullingTime="1.058617595s" totalInitContainerRuntime="74.203376ms" isStatefulPod=true podCreationTimestamp="2026-07-12 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:03.755372175 +0000 UTC m=+281.455100955" watchObservedRunningTime="2026-07-12 15:25:03.755805472 +0000 UTC m=+281.455534253"
Jul 12 15:25:04.624297 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.624261    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"]
Jul 12 15:25:04.627464 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.627444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:04.630012 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.629990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bszg\""
Jul 12 15:25:04.630106 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.630024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 12 15:25:04.634893 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.634871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"]
Jul 12 15:25:04.666116 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.666086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:04.666280 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.666178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6c8s\" (UniqueName: \"kubernetes.io/projected/e7d7c291-642c-46e9-b047-bd86ec69df7d-kube-api-access-c6c8s\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:04.742431 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.742399    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"8e119fbb2d499be446fddf9d56c823ade6df789c45059c1669ac13f822431d18"}
Jul 12 15:25:04.742892 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.742474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"b2f5bfe388b171e6054bc44ca50e047f6a939bf6e8b680b7e9476f451060552f"}
Jul 12 15:25:04.742892 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.742511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"524ff1d7c4f302233edf3b91f13de52c6a4e1bf3f9b9d8966cef8496ee9e9196"}
Jul 12 15:25:04.767218 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.767186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6c8s\" (UniqueName: \"kubernetes.io/projected/e7d7c291-642c-46e9-b047-bd86ec69df7d-kube-api-access-c6c8s\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:04.767321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.767277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:04.767460 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:04.767428    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 12 15:25:04.767548 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:04.767498    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert podName:e7d7c291-642c-46e9-b047-bd86ec69df7d nodeName:}" failed. No retries permitted until 2026-07-12 15:25:05.26747535 +0000 UTC m=+282.967204124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-6nzpn" (UID: "e7d7c291-642c-46e9-b047-bd86ec69df7d") : secret "monitoring-plugin-cert" not found
Jul 12 15:25:04.776227 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:04.776208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6c8s\" (UniqueName: \"kubernetes.io/projected/e7d7c291-642c-46e9-b047-bd86ec69df7d-kube-api-access-c6c8s\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:05.085652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.085553    2581 patch_prober.go:28] interesting pod/image-registry-7479f85768-rgdcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 15:25:05.085652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.085623    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:25:05.272812 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.272774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:05.275346 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.275319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d7c291-642c-46e9-b047-bd86ec69df7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nzpn\" (UID: \"e7d7c291-642c-46e9-b047-bd86ec69df7d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:05.427740 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.427698    2581 patch_prober.go:28] interesting pod/image-registry-86dddbc9f6-jmntg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 15:25:05.427883 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.427758    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" podUID="e4eb3196-0e36-4497-8ee0-1555fad51808" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:25:05.537173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.537134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:05.665839 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.665813    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"]
Jul 12 15:25:05.668079 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:25:05.668054    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d7c291_642c_46e9_b047_bd86ec69df7d.slice/crio-5b4d4920c1e45145b727c6ec054f14740688e73a174421684e79438978d3e371 WatchSource:0}: Error finding container 5b4d4920c1e45145b727c6ec054f14740688e73a174421684e79438978d3e371: Status 404 returned error can't find the container with id 5b4d4920c1e45145b727c6ec054f14740688e73a174421684e79438978d3e371
Jul 12 15:25:05.746781 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.746739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn" event={"ID":"e7d7c291-642c-46e9-b047-bd86ec69df7d","Type":"ContainerStarted","Data":"5b4d4920c1e45145b727c6ec054f14740688e73a174421684e79438978d3e371"}
Jul 12 15:25:05.749690 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.749666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"fd2b9b4d855cb2cbb0e36fb2943fb5f97a362f8249290f123ce955a4fdf3b6ec"}
Jul 12 15:25:05.749793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.749729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"867c955a668514b98495437b9f5a0a9dabc2869033db2762bec89b4441990418"}
Jul 12 15:25:05.749793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.749769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" event={"ID":"e4b5d08c-3243-4a58-980d-5518c209cde1","Type":"ContainerStarted","Data":"aa6e95b7338a725755f1c5870e252f6fedcb0de36b3081bd502b80e2b3dcaa69"}
Jul 12 15:25:05.749868 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.749854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:05.775750 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:05.775226    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6" podStartSLOduration=1.9549861750000002 podStartE2EDuration="4.775205191s" totalImagesPullingTime="2.820219016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:25:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:05.773271616 +0000 UTC m=+283.473000398" watchObservedRunningTime="2026-07-12 15:25:05.775205191 +0000 UTC m=+283.474933970"
Jul 12 15:25:06.388396 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.388345    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:25:06.391775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.391750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.394309 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.394284    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 12 15:25:06.394947 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.394724    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 15:25:06.394947 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.394782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 12 15:25:06.396329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.395723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 12 15:25:06.396329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.395779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 12 15:25:06.396329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.395983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 15:25:06.396329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.396292    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dt6sj\""
Jul 12 15:25:06.396611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.396594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 12 15:25:06.402254 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.402150    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 12 15:25:06.404329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.404245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:25:06.489599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489822 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsr8z\" (UniqueName: \"kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489822 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489822 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489985 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.489985 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.489902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591016 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.590973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591201 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591201 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsr8z\" (UniqueName: \"kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591437 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591437 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.591889 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.592058 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.591966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.592118 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.592090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.592408 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.592349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.594008 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.593982    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.594165 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.594143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.600652 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.600610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsr8z\" (UniqueName: \"kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z\") pod \"console-5cbf99d4d-bxkgb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") " pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.676591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.676505    2581 patch_prober.go:28] interesting pod/image-registry-86dddbc9f6-jmntg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 15:25:06.676591 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.676558    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" podUID="e4eb3196-0e36-4497-8ee0-1555fad51808" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:25:06.706738 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.706712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:06.855768 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:06.855734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:25:07.154562 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:25:07.154528    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371f05fa_4886_408f_809e_92b0f5eebedb.slice/crio-f97569d85759a83262d222b6609a26aa748dfb0abf25553c951027c1466182d5 WatchSource:0}: Error finding container f97569d85759a83262d222b6609a26aa748dfb0abf25553c951027c1466182d5: Status 404 returned error can't find the container with id f97569d85759a83262d222b6609a26aa748dfb0abf25553c951027c1466182d5
Jul 12 15:25:07.199546 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.199517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:07.202025 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.202004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb6e1548-b802-47e4-af2d-bf6c19691a7e-metrics-tls\") pod \"dns-default-h65rm\" (UID: \"cb6e1548-b802-47e4-af2d-bf6c19691a7e\") " pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:07.340846 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.340815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns4rd\""
Jul 12 15:25:07.348931 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.348906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:07.474574 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.474550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h65rm"]
Jul 12 15:25:07.476936 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:25:07.476913    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6e1548_b802_47e4_af2d_bf6c19691a7e.slice/crio-18fad064f679dc8f2409b25e518763fb023702994e478e5ae2b4a2e980e51211 WatchSource:0}: Error finding container 18fad064f679dc8f2409b25e518763fb023702994e478e5ae2b4a2e980e51211: Status 404 returned error can't find the container with id 18fad064f679dc8f2409b25e518763fb023702994e478e5ae2b4a2e980e51211
Jul 12 15:25:07.759544 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.759450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99d4d-bxkgb" event={"ID":"371f05fa-4886-408f-809e-92b0f5eebedb","Type":"ContainerStarted","Data":"f97569d85759a83262d222b6609a26aa748dfb0abf25553c951027c1466182d5"}
Jul 12 15:25:07.761292 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.761257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn" event={"ID":"e7d7c291-642c-46e9-b047-bd86ec69df7d","Type":"ContainerStarted","Data":"b9a2899e34360fc7952ce77883e481f852ae490d8422866d1fc24076b5a4407e"}
Jul 12 15:25:07.761528 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.761485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:07.762709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.762679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h65rm" event={"ID":"cb6e1548-b802-47e4-af2d-bf6c19691a7e","Type":"ContainerStarted","Data":"18fad064f679dc8f2409b25e518763fb023702994e478e5ae2b4a2e980e51211"}
Jul 12 15:25:07.767313 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.767290    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn"
Jul 12 15:25:07.776330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:07.776190    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nzpn" podStartSLOduration=2.246496527 podStartE2EDuration="3.776173217s" totalImagesPullingTime="1.52967669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:07.775444738 +0000 UTC m=+285.475173515" watchObservedRunningTime="2026-07-12 15:25:07.776173217 +0000 UTC m=+285.475901995"
Jul 12 15:25:10.099909 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.099854    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry" containerID="cri-o://9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb" gracePeriod=30
Jul 12 15:25:10.390231 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.390195    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:25:10.427794 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.427902 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwv9k\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.427902 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427831    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.427902 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.428005 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.428005 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.428005 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.427992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.428090 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.428020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets\") pod \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\" (UID: \"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2\") "
Jul 12 15:25:10.428542 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.428487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:25:10.428718 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.428691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:25:10.430722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.430695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:25:10.430838 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.430698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:25:10.430838 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.430798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k" (OuterVolumeSpecName: "kube-api-access-fwv9k") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "kube-api-access-fwv9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:25:10.431162 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.431133    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:25:10.431280 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.431195    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:25:10.438738 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.438710    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" (UID: "b21f0b44-171e-4b14-b63f-fe4f6f48e0b2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:25:10.529760 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529719    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-bound-sa-token\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.529760 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529754    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-image-registry-private-configuration\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.529760 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529764    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-certificates\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.530013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529773    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-trusted-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.530013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529781    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-installation-pull-secrets\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.530013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529789    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-registry-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.530013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529797    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwv9k\" (UniqueName: \"kubernetes.io/projected/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-kube-api-access-fwv9k\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.530013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.529804    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2-ca-trust-extracted\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:25:10.775273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.775152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h65rm" event={"ID":"cb6e1548-b802-47e4-af2d-bf6c19691a7e","Type":"ContainerStarted","Data":"7df6b1db8a6353c3a8f7de600d24e596f689a4c147414fdcc3beccf3a8d43e1a"}
Jul 12 15:25:10.775480 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.775285    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:10.775480 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.775311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h65rm" event={"ID":"cb6e1548-b802-47e4-af2d-bf6c19691a7e","Type":"ContainerStarted","Data":"4ebd83cf4ed4828c5317a4ee398d88e5a63ff9199437a9eee3613f7561d78716"}
Jul 12 15:25:10.776466 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.776442    2581 generic.go:356] "Generic (PLEG): container finished" podID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerID="9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb" exitCode=0
Jul 12 15:25:10.776585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.776500    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7479f85768-rgdcp"
Jul 12 15:25:10.776585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.776514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" event={"ID":"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2","Type":"ContainerDied","Data":"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"}
Jul 12 15:25:10.776585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.776555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7479f85768-rgdcp" event={"ID":"b21f0b44-171e-4b14-b63f-fe4f6f48e0b2","Type":"ContainerDied","Data":"9ece4d23bd733886e95212f326e4ed4109c1a141b08521d5db967efecc05811e"}
Jul 12 15:25:10.776585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.776580    2581 scope.go:117] "RemoveContainer" containerID="9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"
Jul 12 15:25:10.778183 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.778154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99d4d-bxkgb" event={"ID":"371f05fa-4886-408f-809e-92b0f5eebedb","Type":"ContainerStarted","Data":"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"}
Jul 12 15:25:10.785034 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.785015    2581 scope.go:117] "RemoveContainer" containerID="9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"
Jul 12 15:25:10.785309 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:10.785290    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb\": container with ID starting with 9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb not found: ID does not exist" containerID="9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"
Jul 12 15:25:10.785365 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.785317    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb"} err="failed to get container status \"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb\": rpc error: code = NotFound desc = could not find container \"9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb\": container with ID starting with 9ed79f38fde1afab59aba60782e78b73455cba4c2ab77b7b1012c95111cb1ceb not found: ID does not exist"
Jul 12 15:25:10.791554 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.791518    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h65rm" podStartSLOduration=251.01858799 podStartE2EDuration="4m13.791506247s" totalImagesPullingTime="2.772918257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:10.790565789 +0000 UTC m=+288.490294569" watchObservedRunningTime="2026-07-12 15:25:10.791506247 +0000 UTC m=+288.491235025"
Jul 12 15:25:10.808453 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.808357    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbf99d4d-bxkgb" podStartSLOduration=1.714594334 podStartE2EDuration="4.808334035s" totalImagesPullingTime="3.093739701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:25:10.805954281 +0000 UTC m=+288.505683061" watchObservedRunningTime="2026-07-12 15:25:10.808334035 +0000 UTC m=+288.508062815"
Jul 12 15:25:10.817202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.817175    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:25:10.822951 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.822922    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7479f85768-rgdcp"]
Jul 12 15:25:10.845530 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:10.845499    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" path="/var/lib/kubelet/pods/b21f0b44-171e-4b14-b63f-fe4f6f48e0b2/volumes"
Jul 12 15:25:11.759172 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:11.759148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66965f85d8-g98f6"
Jul 12 15:25:15.427136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:15.427092    2581 patch_prober.go:28] interesting pod/image-registry-86dddbc9f6-jmntg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 15:25:15.427534 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:15.427143    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg" podUID="e4eb3196-0e36-4497-8ee0-1555fad51808" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:25:15.843595 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:25:15.843511    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gm2r8" podUID="7a2452ce-e603-4061-9cdf-baedd16ad299"
Jul 12 15:25:16.676720 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:16.676691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86dddbc9f6-jmntg"
Jul 12 15:25:16.706936 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:16.706903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:16.707089 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:16.706972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:16.711673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:16.711650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:16.807034 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:16.807008    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:25:20.785637 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:20.785602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h65rm"
Jul 12 15:25:22.681119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:22.681095    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 15:25:26.842918 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:26.842811    2581 generic.go:356] "Generic (PLEG): container finished" podID="0cec0eef-624e-4d4f-b07b-28dcbec1e979" containerID="c58dd9a10c46104218264e3695a75fcc980ae10da95a5da251166de655288574" exitCode=0
Jul 12 15:25:26.844944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:26.844918    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g" event={"ID":"0cec0eef-624e-4d4f-b07b-28dcbec1e979","Type":"ContainerDied","Data":"c58dd9a10c46104218264e3695a75fcc980ae10da95a5da251166de655288574"}
Jul 12 15:25:26.845230 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:26.845216    2581 scope.go:117] "RemoveContainer" containerID="c58dd9a10c46104218264e3695a75fcc980ae10da95a5da251166de655288574"
Jul 12 15:25:27.848456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:27.848417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-czl4g" event={"ID":"0cec0eef-624e-4d4f-b07b-28dcbec1e979","Type":"ContainerStarted","Data":"d89d50a40acbe05cb0a256a4eb3be2591b0f3a08e8f902a4d94f9d8b55e329a4"}
Jul 12 15:25:30.840547 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:30.840504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:25:31.864976 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:31.864942    2581 generic.go:356] "Generic (PLEG): container finished" podID="8fffdf3f-a241-48ee-b5f0-2b0e50a384d8" containerID="31293c5b59f5bbf10a0a5c2b357deff242378702ef687a6b9b0a90978d18d112" exitCode=0
Jul 12 15:25:31.865356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:31.865014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv" event={"ID":"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8","Type":"ContainerDied","Data":"31293c5b59f5bbf10a0a5c2b357deff242378702ef687a6b9b0a90978d18d112"}
Jul 12 15:25:31.865356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:31.865341    2581 scope.go:117] "RemoveContainer" containerID="31293c5b59f5bbf10a0a5c2b357deff242378702ef687a6b9b0a90978d18d112"
Jul 12 15:25:32.483390 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:32.483361    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c5d54b844-nzqwh_840cc992-4ed5-4816-a199-826fd2a24a5c/router/0.log"
Jul 12 15:25:32.500311 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:32.500281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4xvb_57889e21-296d-4e58-98d7-847374c2d221/serve-healthcheck-canary/0.log"
Jul 12 15:25:32.869775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:32.869747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pw7mv" event={"ID":"8fffdf3f-a241-48ee-b5f0-2b0e50a384d8","Type":"ContainerStarted","Data":"39a8222a39ea4528b16619c2509569e8252c2d464abe288f9605e6df508e06dd"}
Jul 12 15:25:36.885467 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:36.885434    2581 generic.go:356] "Generic (PLEG): container finished" podID="930c33da-a5e7-44bc-9b30-4847d52ef4f9" containerID="737e1aa1ef6e8454f95f8244e32f77d2d38d43700993ee33ea0765bf6ca1872d" exitCode=0
Jul 12 15:25:36.885844 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:36.885477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg" event={"ID":"930c33da-a5e7-44bc-9b30-4847d52ef4f9","Type":"ContainerDied","Data":"737e1aa1ef6e8454f95f8244e32f77d2d38d43700993ee33ea0765bf6ca1872d"}
Jul 12 15:25:36.885844 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:36.885754    2581 scope.go:117] "RemoveContainer" containerID="737e1aa1ef6e8454f95f8244e32f77d2d38d43700993ee33ea0765bf6ca1872d"
Jul 12 15:25:37.891321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:25:37.891287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nx5hg" event={"ID":"930c33da-a5e7-44bc-9b30-4847d52ef4f9","Type":"ContainerStarted","Data":"fc99098f2fd16edef73a64c63a6e63e556b0b935004462c1520cb56b6e9de6cd"}
Jul 12 15:26:22.309196 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.309117    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 15:26:22.309692 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.309427    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry"
Jul 12 15:26:22.309692 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.309440    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry"
Jul 12 15:26:22.309692 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.309505    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21f0b44-171e-4b14-b63f-fe4f6f48e0b2" containerName="registry"
Jul 12 15:26:22.312329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.312314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.314898 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.314877    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 12 15:26:22.315137 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 12 15:26:22.315270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 12 15:26:22.315270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315154    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 12 15:26:22.315270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 12 15:26:22.315470 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 12 15:26:22.315470 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315313    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 12 15:26:22.315646 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.315632    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hhkvj\""
Jul 12 15:26:22.317281 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.317264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 12 15:26:22.322833 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.322815    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 12 15:26:22.325402 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.325360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 15:26:22.444270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-kube-api-access-kxd57\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444270 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444535 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.444776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.444727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545279 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-kube-api-access-kxd57\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.545923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.545842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.546580 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.546556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.546746 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.546643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfeffddc-730c-4865-ade4-c50c9e192273-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.548429 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.548371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfeffddc-730c-4865-ade4-c50c9e192273-config-out\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.548922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.548747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.548922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.548848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.548922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.548878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.549106 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.548997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-web-config\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.549106 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.549043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.549622 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.549595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.550345 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.550324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.550653 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.550634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfeffddc-730c-4865-ade4-c50c9e192273-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.556775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.556754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/cfeffddc-730c-4865-ade4-c50c9e192273-kube-api-access-kxd57\") pod \"alertmanager-main-0\" (UID: \"cfeffddc-730c-4865-ade4-c50c9e192273\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.622171 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.622136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 15:26:22.763219 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.763190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 15:26:22.765341 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:26:22.765314    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfeffddc_730c_4865_ade4_c50c9e192273.slice/crio-c297a62ad0d5f6ef0d033bfaf5230fcb92b1ff8013f7966e34949dd8105656ad WatchSource:0}: Error finding container c297a62ad0d5f6ef0d033bfaf5230fcb92b1ff8013f7966e34949dd8105656ad: Status 404 returned error can't find the container with id c297a62ad0d5f6ef0d033bfaf5230fcb92b1ff8013f7966e34949dd8105656ad
Jul 12 15:26:22.767191 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:22.767171    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:26:23.055132 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:23.055048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"c297a62ad0d5f6ef0d033bfaf5230fcb92b1ff8013f7966e34949dd8105656ad"}
Jul 12 15:26:24.051011 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.050978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-794495bcd6-bl4kt"]
Jul 12 15:26:24.053447 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.053430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057416    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057458    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x5wrp\""
Jul 12 15:26:24.057642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.057607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 12 15:26:24.062404 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.062364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 12 15:26:24.063931 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.063817    2581 generic.go:356] "Generic (PLEG): container finished" podID="cfeffddc-730c-4865-ade4-c50c9e192273" containerID="d40267f56f45c23068682ec02899b3265a02c820116b75224fa65c483b13a777" exitCode=0
Jul 12 15:26:24.063931 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.063860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerDied","Data":"d40267f56f45c23068682ec02899b3265a02c820116b75224fa65c483b13a777"}
Jul 12 15:26:24.064778 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.064753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-794495bcd6-bl4kt"]
Jul 12 15:26:24.160790 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl4fq\" (UniqueName: \"kubernetes.io/projected/947a9dc1-3770-4533-adcd-4615379fe7de-kube-api-access-kl4fq\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.160962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-serving-certs-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.160962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-federate-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.160962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.160962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.160962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-metrics-client-ca\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.161134 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.160997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.161134 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.161046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.262107 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.262303 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-metrics-client-ca\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.262433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl4fq\" (UniqueName: \"kubernetes.io/projected/947a9dc1-3770-4533-adcd-4615379fe7de-kube-api-access-kl4fq\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-serving-certs-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-federate-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.262949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-metrics-client-ca\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263427 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.263074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263657 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.263502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-serving-certs-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.263923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.263901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.265123 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.265083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.265555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.265534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-telemeter-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.265609 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.265569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-federate-client-tls\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.265609 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.265595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/947a9dc1-3770-4533-adcd-4615379fe7de-secret-telemeter-client\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.270060 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.270040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl4fq\" (UniqueName: \"kubernetes.io/projected/947a9dc1-3770-4533-adcd-4615379fe7de-kube-api-access-kl4fq\") pod \"telemeter-client-794495bcd6-bl4kt\" (UID: \"947a9dc1-3770-4533-adcd-4615379fe7de\") " pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.365907 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.365874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt"
Jul 12 15:26:24.511222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:24.511193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-794495bcd6-bl4kt"]
Jul 12 15:26:24.513732 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:26:24.513676    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947a9dc1_3770_4533_adcd_4615379fe7de.slice/crio-3f3b1b43004297ce3bd6a32785a04936f7daa3e98564f254151808acde17cedb WatchSource:0}: Error finding container 3f3b1b43004297ce3bd6a32785a04936f7daa3e98564f254151808acde17cedb: Status 404 returned error can't find the container with id 3f3b1b43004297ce3bd6a32785a04936f7daa3e98564f254151808acde17cedb
Jul 12 15:26:25.069225 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:25.069181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt" event={"ID":"947a9dc1-3770-4533-adcd-4615379fe7de","Type":"ContainerStarted","Data":"3f3b1b43004297ce3bd6a32785a04936f7daa3e98564f254151808acde17cedb"}
Jul 12 15:26:26.083272 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"112b72e4c05a477f8b70140d2da0d83ce23ff1aa463f16259c2ed4d455621e20"}
Jul 12 15:26:26.083696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"22c574cd22793fbf734173800c59bb14c9b639f02235e6cfbc2885a8a62ff04c"}
Jul 12 15:26:26.083696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"bcfc1a6c5d2a12747e2f4333fd7c8ded23291b255484f52a9b1c3666a2b196e5"}
Jul 12 15:26:26.083696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"1b61d108447ec8196f95b193f29899864decf282986d26d7bbc8922c448a6c48"}
Jul 12 15:26:26.083696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"efb5f4df7d70a44dd1ca11778cfa51602442becca3acc048f3465e6bfc489812"}
Jul 12 15:26:26.083696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.083475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfeffddc-730c-4865-ade4-c50c9e192273","Type":"ContainerStarted","Data":"dfa0057f8133f80e445108ae25fc4cf1a963417725b5a2dfae08cdb4a357e4dc"}
Jul 12 15:26:26.112979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:26.112751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.6220788480000001 podStartE2EDuration="4.112731629s" totalImagesPullingTime="2.470806561s" totalInitContainerRuntime="19.84622ms" isStatefulPod=false podCreationTimestamp="2026-07-12 15:26:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:26:26.111077168 +0000 UTC m=+363.810805949" watchObservedRunningTime="2026-07-12 15:26:26.112731629 +0000 UTC m=+363.812460408"
Jul 12 15:26:27.089403 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.089340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt" event={"ID":"947a9dc1-3770-4533-adcd-4615379fe7de","Type":"ContainerStarted","Data":"a10bdc72096ac9cb6a5312699bcf1c6e42dd1974eeaab18f23ae6b56ab40cec7"}
Jul 12 15:26:27.089786 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.089433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt" event={"ID":"947a9dc1-3770-4533-adcd-4615379fe7de","Type":"ContainerStarted","Data":"9265932eea694378324191e0c6702491f1c7b01f4e2036b649cb8a003fca30eb"}
Jul 12 15:26:27.089786 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.089465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt" event={"ID":"947a9dc1-3770-4533-adcd-4615379fe7de","Type":"ContainerStarted","Data":"91a669f1a37df388aa20da9a0dafdd0b85d1418e9d5b84252b12c9059e8cac8e"}
Jul 12 15:26:27.113945 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.113894    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-794495bcd6-bl4kt" podStartSLOduration=1.25962236 podStartE2EDuration="3.113876277s" totalImagesPullingTime="1.854253917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:26:27.112561584 +0000 UTC m=+364.812290365" watchObservedRunningTime="2026-07-12 15:26:27.113876277 +0000 UTC m=+364.813605057"
Jul 12 15:26:27.771111 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.771085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:26:27.774397 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.774366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.789263 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.789236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:26:27.797750 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.797858 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.797858 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.797922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.797922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.798012 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.797991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.798048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.798042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqp2k\" (UniqueName: \"kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899143 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899143 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899434 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899434 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899434 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899434 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqp2k\" (UniqueName: \"kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899434 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.899959 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.900045 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.899986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.900253 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.900237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.900651 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.900629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.901891 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.901868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.901973 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.901955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:27.908149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:27.908130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqp2k\" (UniqueName: \"kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k\") pod \"console-79b567bb75-wqdfz\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") " pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:28.083622 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:28.083532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:28.236360 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:28.236324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:26:28.241262 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:26:28.241226    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4596c5_a06c_4ad0_ab37_1a5be7ec702e.slice/crio-6866afe048dfdecd67802ae38c49e656ec8d80f57531f7fb2586ca7ebb8d868f WatchSource:0}: Error finding container 6866afe048dfdecd67802ae38c49e656ec8d80f57531f7fb2586ca7ebb8d868f: Status 404 returned error can't find the container with id 6866afe048dfdecd67802ae38c49e656ec8d80f57531f7fb2586ca7ebb8d868f
Jul 12 15:26:29.099669 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:29.099629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b567bb75-wqdfz" event={"ID":"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e","Type":"ContainerStarted","Data":"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"}
Jul 12 15:26:29.099843 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:29.099682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b567bb75-wqdfz" event={"ID":"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e","Type":"ContainerStarted","Data":"6866afe048dfdecd67802ae38c49e656ec8d80f57531f7fb2586ca7ebb8d868f"}
Jul 12 15:26:29.115767 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:29.115720    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b567bb75-wqdfz" podStartSLOduration=2.115705442 podStartE2EDuration="2.115705442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:26:29.114580193 +0000 UTC m=+366.814308972" watchObservedRunningTime="2026-07-12 15:26:29.115705442 +0000 UTC m=+366.815434222"
Jul 12 15:26:35.672183 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:35.672142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:26:35.674587 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:35.674566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a2452ce-e603-4061-9cdf-baedd16ad299-metrics-certs\") pod \"network-metrics-daemon-gm2r8\" (UID: \"7a2452ce-e603-4061-9cdf-baedd16ad299\") " pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:26:35.944908 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:35.944824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ztf2\""
Jul 12 15:26:35.952750 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:35.952727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm2r8"
Jul 12 15:26:36.078883 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:36.078854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gm2r8"]
Jul 12 15:26:36.082005 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:26:36.081975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2452ce_e603_4061_9cdf_baedd16ad299.slice/crio-9be25115775208a3401e5da930da026d8e270bf6bae5bf1cb2e511d81b4ab929 WatchSource:0}: Error finding container 9be25115775208a3401e5da930da026d8e270bf6bae5bf1cb2e511d81b4ab929: Status 404 returned error can't find the container with id 9be25115775208a3401e5da930da026d8e270bf6bae5bf1cb2e511d81b4ab929
Jul 12 15:26:36.128937 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:36.128901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm2r8" event={"ID":"7a2452ce-e603-4061-9cdf-baedd16ad299","Type":"ContainerStarted","Data":"9be25115775208a3401e5da930da026d8e270bf6bae5bf1cb2e511d81b4ab929"}
Jul 12 15:26:37.134673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:37.134646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm2r8" event={"ID":"7a2452ce-e603-4061-9cdf-baedd16ad299","Type":"ContainerStarted","Data":"2e79c909e0c8fc2f2fe41d94ef99a571e35590deb4568b1c2700e6178aec562c"}
Jul 12 15:26:38.084153 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.084117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:38.084311 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.084176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:38.088902 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.088881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:38.140926 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.140889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm2r8" event={"ID":"7a2452ce-e603-4061-9cdf-baedd16ad299","Type":"ContainerStarted","Data":"f7a7b0443ae6d41845acfdd6039446316612dadefd7bd89164bc9664993479b2"}
Jul 12 15:26:38.144789 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.144755    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:26:38.157402 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.157341    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gm2r8" podStartSLOduration=375.259138244 podStartE2EDuration="6m16.15732581s" totalImagesPullingTime="898.187566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:26:38.156530981 +0000 UTC m=+375.856259771" watchObservedRunningTime="2026-07-12 15:26:38.15732581 +0000 UTC m=+375.857054588"
Jul 12 15:26:38.201393 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:26:38.201346    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:27:03.224205 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.224142    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbf99d4d-bxkgb" podUID="371f05fa-4886-408f-809e-92b0f5eebedb" containerName="console" containerID="cri-o://11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339" gracePeriod=15
Jul 12 15:27:03.477962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.477895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:27:03.509706 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509714    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509806    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsr8z\" (UniqueName: \"kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.509894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.509848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config\") pod \"371f05fa-4886-408f-809e-92b0f5eebedb\" (UID: \"371f05fa-4886-408f-809e-92b0f5eebedb\") "
Jul 12 15:27:03.510202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.510172    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:27:03.510259 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.510199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca" (OuterVolumeSpecName: "service-ca") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:27:03.510694 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.510658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config" (OuterVolumeSpecName: "console-config") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:27:03.510828 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.510720    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:27:03.512236 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.512207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:27:03.512332 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.512258    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:27:03.512332 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.512259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z" (OuterVolumeSpecName: "kube-api-access-wsr8z") pod "371f05fa-4886-408f-809e-92b0f5eebedb" (UID: "371f05fa-4886-408f-809e-92b0f5eebedb"). InnerVolumeSpecName "kube-api-access-wsr8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:27:03.612901 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612857    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-trusted-ca-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.612901 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612889    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.612901 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612902    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-oauth-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.612901 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612914    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/371f05fa-4886-408f-809e-92b0f5eebedb-console-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.613273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612926    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-oauth-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.613273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612938    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsr8z\" (UniqueName: \"kubernetes.io/projected/371f05fa-4886-408f-809e-92b0f5eebedb-kube-api-access-wsr8z\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:03.613273 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:03.612949    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/371f05fa-4886-408f-809e-92b0f5eebedb-console-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:27:04.243326 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.243292    2581 generic.go:356] "Generic (PLEG): container finished" podID="371f05fa-4886-408f-809e-92b0f5eebedb" containerID="11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339" exitCode=0
Jul 12 15:27:04.243793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.243353    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99d4d-bxkgb"
Jul 12 15:27:04.243793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.243404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99d4d-bxkgb" event={"ID":"371f05fa-4886-408f-809e-92b0f5eebedb","Type":"ContainerDied","Data":"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"}
Jul 12 15:27:04.243793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.243464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99d4d-bxkgb" event={"ID":"371f05fa-4886-408f-809e-92b0f5eebedb","Type":"ContainerDied","Data":"f97569d85759a83262d222b6609a26aa748dfb0abf25553c951027c1466182d5"}
Jul 12 15:27:04.243793 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.243496    2581 scope.go:117] "RemoveContainer" containerID="11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"
Jul 12 15:27:04.252951 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.252933    2581 scope.go:117] "RemoveContainer" containerID="11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"
Jul 12 15:27:04.253189 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:27:04.253171    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339\": container with ID starting with 11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339 not found: ID does not exist" containerID="11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"
Jul 12 15:27:04.253228 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.253197    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339"} err="failed to get container status \"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339\": rpc error: code = NotFound desc = could not find container \"11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339\": container with ID starting with 11422f4da4aa9df2f7eaac7e1bb3d9fb0ed79d1f6640d6caab96037f85e48339 not found: ID does not exist"
Jul 12 15:27:04.262760 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.262741    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:27:04.267057 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.267037    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbf99d4d-bxkgb"]
Jul 12 15:27:04.846283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:04.846248    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="371f05fa-4886-408f-809e-92b0f5eebedb" path="/var/lib/kubelet/pods/371f05fa-4886-408f-809e-92b0f5eebedb/volumes"
Jul 12 15:27:42.390025 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.389991    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:27:42.393684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.390833    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371f05fa-4886-408f-809e-92b0f5eebedb" containerName="console"
Jul 12 15:27:42.393684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.390861    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="371f05fa-4886-408f-809e-92b0f5eebedb" containerName="console"
Jul 12 15:27:42.393684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.391194    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="371f05fa-4886-408f-809e-92b0f5eebedb" containerName="console"
Jul 12 15:27:42.398944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.398912    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.401480 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.401446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:27:42.524607 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524774 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524774 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524774 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm965\" (UniqueName: \"kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524774 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524774 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.524941 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.524787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625249 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm965\" (UniqueName: \"kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625249 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.625516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.625410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.626082 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.626048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.626082 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.626055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.626313 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.626266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.626543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.626522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.628091 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.628061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.628175 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.628092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.632351 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.632335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm965\" (UniqueName: \"kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965\") pod \"console-97bccb7d5-ksgxr\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") " pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.709684 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.709603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:42.845678 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:27:42.845650    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6c6424_9d9c_4e2c_8d0c_805b87c6f7f8.slice/crio-6b892a96990db15769f48060160b1fe1cc1addc280f3ca5e4408f13a669e3cc8 WatchSource:0}: Error finding container 6b892a96990db15769f48060160b1fe1cc1addc280f3ca5e4408f13a669e3cc8: Status 404 returned error can't find the container with id 6b892a96990db15769f48060160b1fe1cc1addc280f3ca5e4408f13a669e3cc8
Jul 12 15:27:42.846498 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:42.846473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:27:43.395611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:43.395569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bccb7d5-ksgxr" event={"ID":"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8","Type":"ContainerStarted","Data":"2192d69df2ba47ad604b3da4a17243361b9b10ca4c86b45aff6e18d47db5b80e"}
Jul 12 15:27:43.396071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:43.395626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bccb7d5-ksgxr" event={"ID":"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8","Type":"ContainerStarted","Data":"6b892a96990db15769f48060160b1fe1cc1addc280f3ca5e4408f13a669e3cc8"}
Jul 12 15:27:43.412539 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:43.412494    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97bccb7d5-ksgxr" podStartSLOduration=1.4124791669999999 podStartE2EDuration="1.412479167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:27:43.411544972 +0000 UTC m=+441.111273753" watchObservedRunningTime="2026-07-12 15:27:43.412479167 +0000 UTC m=+441.112207945"
Jul 12 15:27:52.710716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:52.710665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:52.711258 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:52.710737    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:52.715618 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:52.715588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:53.443502 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:53.443468    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:27:53.492601 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:27:53.492573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:28:18.521445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.521357    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79b567bb75-wqdfz" podUID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" containerName="console" containerID="cri-o://2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91" gracePeriod=15
Jul 12 15:28:18.764688 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.764666    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:28:18.834564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqp2k\" (UniqueName: \"kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834521    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834564 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834540    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834826 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834826 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834620    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834826 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.834826 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834688    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca\") pod \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\" (UID: \"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e\") "
Jul 12 15:28:18.835024 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:28:18.835024 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.834982    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:28:18.835136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.835035    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config" (OuterVolumeSpecName: "console-config") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:28:18.835206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.835187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:28:18.836866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.836842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k" (OuterVolumeSpecName: "kube-api-access-gqp2k") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "kube-api-access-gqp2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:28:18.837442 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.837415    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:28:18.837531 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.837437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" (UID: "0a4596c5-a06c-4ad0-ab37-1a5be7ec702e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:28:18.935632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935593    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935625    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935635    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-console-oauth-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935643    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935652    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqp2k\" (UniqueName: \"kubernetes.io/projected/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-kube-api-access-gqp2k\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935659    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-trusted-ca-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:18.935866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:18.935667    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e-oauth-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:28:19.542630 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.542593    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" containerID="2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91" exitCode=0
Jul 12 15:28:19.543038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.542639    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b567bb75-wqdfz"
Jul 12 15:28:19.543038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.542663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b567bb75-wqdfz" event={"ID":"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e","Type":"ContainerDied","Data":"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"}
Jul 12 15:28:19.543038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.542710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b567bb75-wqdfz" event={"ID":"0a4596c5-a06c-4ad0-ab37-1a5be7ec702e","Type":"ContainerDied","Data":"6866afe048dfdecd67802ae38c49e656ec8d80f57531f7fb2586ca7ebb8d868f"}
Jul 12 15:28:19.543038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.542736    2581 scope.go:117] "RemoveContainer" containerID="2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"
Jul 12 15:28:19.550963 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.550946    2581 scope.go:117] "RemoveContainer" containerID="2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"
Jul 12 15:28:19.551240 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:28:19.551221    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91\": container with ID starting with 2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91 not found: ID does not exist" containerID="2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"
Jul 12 15:28:19.551285 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.551250    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91"} err="failed to get container status \"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91\": rpc error: code = NotFound desc = could not find container \"2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91\": container with ID starting with 2df673a277eaf973e398859742296faeb7436369eb6020f39b052ca8f6d23e91 not found: ID does not exist"
Jul 12 15:28:19.559107 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.559085    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:28:19.566540 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:19.566518    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79b567bb75-wqdfz"]
Jul 12 15:28:20.845820 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:20.845787    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" path="/var/lib/kubelet/pods/0a4596c5-a06c-4ad0-ab37-1a5be7ec702e/volumes"
Jul 12 15:28:43.360950 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.360917    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"]
Jul 12 15:28:43.361445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.361226    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" containerName="console"
Jul 12 15:28:43.361445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.361237    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" containerName="console"
Jul 12 15:28:43.361445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.361288    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a4596c5-a06c-4ad0-ab37-1a5be7ec702e" containerName="console"
Jul 12 15:28:43.365736 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.365718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.368932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.368903    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:28:43.369055 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.368964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 12 15:28:43.369185 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.369160    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7x6sd\""
Jul 12 15:28:43.376943 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.376337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"]
Jul 12 15:28:43.449815 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.449765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47wb\" (UniqueName: \"kubernetes.io/projected/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-kube-api-access-m47wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.449997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.449867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.550541 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.550487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47wb\" (UniqueName: \"kubernetes.io/projected/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-kube-api-access-m47wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.550715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.550565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.550881 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.550866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.569165 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.569133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47wb\" (UniqueName: \"kubernetes.io/projected/a2d7d27a-cbbb-4ba8-8260-5a0695628ff4-kube-api-access-m47wb\") pod \"cert-manager-operator-controller-manager-55c444bf86-d5hj5\" (UID: \"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.678339 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.678253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"
Jul 12 15:28:43.815099 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:43.814980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5"]
Jul 12 15:28:43.817664 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:28:43.817637    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d7d27a_cbbb_4ba8_8260_5a0695628ff4.slice/crio-a63de958cd22ca78ae80d08a9545eedc93b29b29e11b378d3c8c9ee9851b889c WatchSource:0}: Error finding container a63de958cd22ca78ae80d08a9545eedc93b29b29e11b378d3c8c9ee9851b889c: Status 404 returned error can't find the container with id a63de958cd22ca78ae80d08a9545eedc93b29b29e11b378d3c8c9ee9851b889c
Jul 12 15:28:44.641028 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:44.640988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5" event={"ID":"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4","Type":"ContainerStarted","Data":"a63de958cd22ca78ae80d08a9545eedc93b29b29e11b378d3c8c9ee9851b889c"}
Jul 12 15:28:47.657456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:47.657418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5" event={"ID":"a2d7d27a-cbbb-4ba8-8260-5a0695628ff4","Type":"ContainerStarted","Data":"fb06e6515047445b069ccbc9ec1a044580c58e92efb18d01e4e62db99ef52ac8"}
Jul 12 15:28:47.678848 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:47.678656    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d5hj5" podStartSLOduration=1.540918727 podStartE2EDuration="4.678638442s" totalImagesPullingTime="3.137719715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:28:47.678257114 +0000 UTC m=+505.377985894" watchObservedRunningTime="2026-07-12 15:28:47.678638442 +0000 UTC m=+505.378367221"
Jul 12 15:28:48.240781 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.240745    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"]
Jul 12 15:28:48.244265 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.244247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.246927 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.246906    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 15:28:48.247015 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.246938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xz5m9\""
Jul 12 15:28:48.248139 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.248122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 15:28:48.257015 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.256993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"]
Jul 12 15:28:48.395947 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.395911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.396149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.395988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjv2\" (UniqueName: \"kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.396149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.396079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.497298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.497201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.497298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.497266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.497550 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.497344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjv2\" (UniqueName: \"kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.497712 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.497687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.497777 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.497713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.507719 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.507689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjv2\" (UniqueName: \"kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.553519 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.553482    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:28:48.688978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:48.688951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"]
Jul 12 15:28:48.691052 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:28:48.691026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ff6879_415f_46f0_8a0e_0fe145e7cfa5.slice/crio-6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937 WatchSource:0}: Error finding container 6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937: Status 404 returned error can't find the container with id 6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937
Jul 12 15:28:49.666755 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:49.666721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j" event={"ID":"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5","Type":"ContainerStarted","Data":"6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937"}
Jul 12 15:28:50.464686 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.464647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"]
Jul 12 15:28:50.468136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.468111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.471260 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.471228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 15:28:50.471414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.471400    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 15:28:50.472551 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.472495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vnf9r\""
Jul 12 15:28:50.480491 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.480470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"]
Jul 12 15:28:50.515183 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.515140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.515183 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.515184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5nv9\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-kube-api-access-w5nv9\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.616178 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.616136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.616366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.616190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5nv9\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-kube-api-access-w5nv9\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.625800 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.625766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.625948 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.625873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5nv9\" (UniqueName: \"kubernetes.io/projected/a2f2de7e-379c-4427-9080-c12364c498a9-kube-api-access-w5nv9\") pod \"cert-manager-cainjector-559cdd8c87-4fb5j\" (UID: \"a2f2de7e-379c-4427-9080-c12364c498a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.789114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.789031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"
Jul 12 15:28:50.932594 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:50.932566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j"]
Jul 12 15:28:50.935744 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:28:50.935706    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2f2de7e_379c_4427_9080_c12364c498a9.slice/crio-37f7b3a8c2512030e615cdb41ff9448ff747a6ef027faee78affc35df057b582 WatchSource:0}: Error finding container 37f7b3a8c2512030e615cdb41ff9448ff747a6ef027faee78affc35df057b582: Status 404 returned error can't find the container with id 37f7b3a8c2512030e615cdb41ff9448ff747a6ef027faee78affc35df057b582
Jul 12 15:28:51.680193 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:51.680149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j" event={"ID":"a2f2de7e-379c-4427-9080-c12364c498a9","Type":"ContainerStarted","Data":"37f7b3a8c2512030e615cdb41ff9448ff747a6ef027faee78affc35df057b582"}
Jul 12 15:28:54.695711 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:54.695678    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerID="8ffd29aaebb205bd108d841fac2ea943f871dc8f425ab10bbad52b48f8a6c266" exitCode=0
Jul 12 15:28:54.696136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:54.695765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j" event={"ID":"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5","Type":"ContainerDied","Data":"8ffd29aaebb205bd108d841fac2ea943f871dc8f425ab10bbad52b48f8a6c266"}
Jul 12 15:28:56.706492 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:56.706460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j" event={"ID":"a2f2de7e-379c-4427-9080-c12364c498a9","Type":"ContainerStarted","Data":"2623f14b651f4dd969bf845ce9894e677e9a43c0a83eabbf64ace7b6541585cf"}
Jul 12 15:28:56.721685 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:56.721630    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4fb5j" podStartSLOduration=1.541271909 podStartE2EDuration="6.721611965s" totalImagesPullingTime="5.180340056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:28:56.720268383 +0000 UTC m=+514.419997163" watchObservedRunningTime="2026-07-12 15:28:56.721611965 +0000 UTC m=+514.421340744"
Jul 12 15:28:58.716797 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:58.716765    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerID="6031fede53b347a2fed42cb2144ab13d2a9149211cbe93a29b142ccbfc0fd0ae" exitCode=0
Jul 12 15:28:58.717119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:28:58.716852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j" event={"ID":"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5","Type":"ContainerDied","Data":"6031fede53b347a2fed42cb2144ab13d2a9149211cbe93a29b142ccbfc0fd0ae"}
Jul 12 15:29:05.762468 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:05.762432    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerID="36b1fe97140b02a3aa4804eca8c22236056420e41766269a601e5c6e62891b07" exitCode=0
Jul 12 15:29:05.762833 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:05.762507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j" event={"ID":"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5","Type":"ContainerDied","Data":"36b1fe97140b02a3aa4804eca8c22236056420e41766269a601e5c6e62891b07"}
Jul 12 15:29:06.946886 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:06.946850    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:29:07.051815 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.051737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwjv2\" (UniqueName: \"kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2\") pod \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") "
Jul 12 15:29:07.051815 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.051781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util\") pod \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") "
Jul 12 15:29:07.052019 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.051826    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle\") pod \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\" (UID: \"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5\") "
Jul 12 15:29:07.052275 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.052246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle" (OuterVolumeSpecName: "bundle") pod "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" (UID: "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:29:07.054063 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.054043    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2" (OuterVolumeSpecName: "kube-api-access-jwjv2") pod "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" (UID: "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5"). InnerVolumeSpecName "kube-api-access-jwjv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:29:07.056170 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.056148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util" (OuterVolumeSpecName: "util") pod "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" (UID: "a2ff6879-415f-46f0-8a0e-0fe145e7cfa5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:29:07.152896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.152859    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwjv2\" (UniqueName: \"kubernetes.io/projected/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-kube-api-access-jwjv2\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:29:07.152896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.152887    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:29:07.152896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.152897    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2ff6879-415f-46f0-8a0e-0fe145e7cfa5-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:29:07.773329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.773305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j"
Jul 12 15:29:07.773488 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.773305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4tp8j" event={"ID":"a2ff6879-415f-46f0-8a0e-0fe145e7cfa5","Type":"ContainerDied","Data":"6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937"}
Jul 12 15:29:07.773488 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:07.773428    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6809c14fddb1049c1d4021dd0532c1ff94f3db87fe4382d72550420d1c1b9937"
Jul 12 15:29:10.867435 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867398    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"]
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867707    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="extract"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867717    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="extract"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867725    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="pull"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867730    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="pull"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867740    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="util"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867746    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="util"
Jul 12 15:29:10.867979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.867793    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2ff6879-415f-46f0-8a0e-0fe145e7cfa5" containerName="extract"
Jul 12 15:29:10.889819 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.889789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"]
Jul 12 15:29:10.890005 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.889883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:10.892773 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.892747    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 15:29:10.893923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.893906    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qn6hn\""
Jul 12 15:29:10.894057 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.893941    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 15:29:10.985133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.985101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:10.985316 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:10.985146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq4nl\" (UniqueName: \"kubernetes.io/projected/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-kube-api-access-xq4nl\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.086358 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.086319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.086594 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.086400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq4nl\" (UniqueName: \"kubernetes.io/projected/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-kube-api-access-xq4nl\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.086870 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.086848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.096612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.096592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq4nl\" (UniqueName: \"kubernetes.io/projected/8e2bf27c-d8e5-44b7-b211-3bd5811af0b8-kube-api-access-xq4nl\") pod \"openshift-lws-operator-fd8ccff4c-84fj5\" (UID: \"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.199610 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.199535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"
Jul 12 15:29:11.363919 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.363893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5"]
Jul 12 15:29:11.366752 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:11.366724    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e2bf27c_d8e5_44b7_b211_3bd5811af0b8.slice/crio-c0f2f3c0ed1b9123cd8204af3804c14b24df927383c8ec0c90c8fe169a86a2c8 WatchSource:0}: Error finding container c0f2f3c0ed1b9123cd8204af3804c14b24df927383c8ec0c90c8fe169a86a2c8: Status 404 returned error can't find the container with id c0f2f3c0ed1b9123cd8204af3804c14b24df927383c8ec0c90c8fe169a86a2c8
Jul 12 15:29:11.792010 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:11.791981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5" event={"ID":"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8","Type":"ContainerStarted","Data":"c0f2f3c0ed1b9123cd8204af3804c14b24df927383c8ec0c90c8fe169a86a2c8"}
Jul 12 15:29:13.802857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:13.802820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5" event={"ID":"8e2bf27c-d8e5-44b7-b211-3bd5811af0b8","Type":"ContainerStarted","Data":"b2037c9507695059957ef6327359baa979ea19ec64bb15ec5c988ef3a3998c2f"}
Jul 12 15:29:13.819605 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:13.819516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84fj5" podStartSLOduration=1.631044301 podStartE2EDuration="3.819501499s" totalImagesPullingTime="2.188457198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:29:13.818100974 +0000 UTC m=+531.517829754" watchObservedRunningTime="2026-07-12 15:29:13.819501499 +0000 UTC m=+531.519230278"
Jul 12 15:29:33.481717 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.481687    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"]
Jul 12 15:29:33.484242 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.484220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.486888 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.486855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 15:29:33.486998 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.486924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4sjfz\""
Jul 12 15:29:33.487218 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.487202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 15:29:33.487355 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.487332    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 15:29:33.487715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.487698    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 15:29:33.508693 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.508666    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"]
Jul 12 15:29:33.585654 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.585619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-manifests\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.585817 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.585665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.585817 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.585693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplvn\" (UniqueName: \"kubernetes.io/projected/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-kube-api-access-xplvn\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.585817 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.585716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-tmp\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.585817 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.585757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687209 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xplvn\" (UniqueName: \"kubernetes.io/projected/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-kube-api-access-xplvn\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687209 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-tmp\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-manifests\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.687769 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.687746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-manifests\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.689837 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.689812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-tmp\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.689958 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.689939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.690085 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.690067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.695196 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.695175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplvn\" (UniqueName: \"kubernetes.io/projected/a3bc07cb-2dd1-4e51-a86b-f958c429ddc5-kube-api-access-xplvn\") pod \"opendatahub-operator-controller-manager-7558dcb54-htdxv\" (UID: \"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5\") " pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.794679 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.794577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:33.940962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:33.940915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"]
Jul 12 15:29:33.943238 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:33.943212    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bc07cb_2dd1_4e51_a86b_f958c429ddc5.slice/crio-4f6bb4411bd337b85669c9e17879c197bcae9f590bb3e58ae06e4311d5f14e1d WatchSource:0}: Error finding container 4f6bb4411bd337b85669c9e17879c197bcae9f590bb3e58ae06e4311d5f14e1d: Status 404 returned error can't find the container with id 4f6bb4411bd337b85669c9e17879c197bcae9f590bb3e58ae06e4311d5f14e1d
Jul 12 15:29:34.896587 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:34.896549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv" event={"ID":"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5","Type":"ContainerStarted","Data":"4f6bb4411bd337b85669c9e17879c197bcae9f590bb3e58ae06e4311d5f14e1d"}
Jul 12 15:29:36.907405 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:36.907351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv" event={"ID":"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5","Type":"ContainerStarted","Data":"b901a0389589716badd99b4abddf264f4b18eb51d23198fc4020b4b3309071d0"}
Jul 12 15:29:38.917629 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:38.917594    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3bc07cb-2dd1-4e51-a86b-f958c429ddc5" containerID="b901a0389589716badd99b4abddf264f4b18eb51d23198fc4020b4b3309071d0" exitCode=0
Jul 12 15:29:38.918039 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:38.917648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv" event={"ID":"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5","Type":"ContainerDied","Data":"b901a0389589716badd99b4abddf264f4b18eb51d23198fc4020b4b3309071d0"}
Jul 12 15:29:39.924020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:39.923987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv" event={"ID":"a3bc07cb-2dd1-4e51-a86b-f958c429ddc5","Type":"ContainerStarted","Data":"c34dad32334eb72f2cbd617fe1ff4098baf8a15f1babef74df549f0f82852074"}
Jul 12 15:29:39.924419 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:39.924200    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:39.948251 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:39.948205    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv" podStartSLOduration=2.563359619 podStartE2EDuration="6.948190538s" totalImagesPullingTime="3.3182583s" totalInitContainerRuntime="1.066572619s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:29:39.946336995 +0000 UTC m=+557.646065773" watchObservedRunningTime="2026-07-12 15:29:39.948190538 +0000 UTC m=+557.647919317"
Jul 12 15:29:50.930945 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:50.930915    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7558dcb54-htdxv"
Jul 12 15:29:53.376632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.376596    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5rfsc"]
Jul 12 15:29:53.380978 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.380954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.382357 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.382336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5rfsc"]
Jul 12 15:29:53.384141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.384118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rl9vx\""
Jul 12 15:29:53.384317 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.384282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 12 15:29:53.457133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.457103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf1aad0-0e43-47df-907b-64a77a8c66e4-cert\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.457306 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.457150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sxpl\" (UniqueName: \"kubernetes.io/projected/0bf1aad0-0e43-47df-907b-64a77a8c66e4-kube-api-access-2sxpl\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.558249 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.558215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf1aad0-0e43-47df-907b-64a77a8c66e4-cert\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.558249 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.558262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sxpl\" (UniqueName: \"kubernetes.io/projected/0bf1aad0-0e43-47df-907b-64a77a8c66e4-kube-api-access-2sxpl\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.560784 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.560753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf1aad0-0e43-47df-907b-64a77a8c66e4-cert\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.570497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.570473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sxpl\" (UniqueName: \"kubernetes.io/projected/0bf1aad0-0e43-47df-907b-64a77a8c66e4-kube-api-access-2sxpl\") pod \"odh-model-controller-7998c67dc4-5rfsc\" (UID: \"0bf1aad0-0e43-47df-907b-64a77a8c66e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.694276 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.694188    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:53.827857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.827838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5rfsc"]
Jul 12 15:29:53.830033 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:53.830010    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf1aad0_0e43_47df_907b_64a77a8c66e4.slice/crio-48f97b381087cfe6c12bf29782050bc1dda5bf91db440ad6309f28dbfaf1fd61 WatchSource:0}: Error finding container 48f97b381087cfe6c12bf29782050bc1dda5bf91db440ad6309f28dbfaf1fd61: Status 404 returned error can't find the container with id 48f97b381087cfe6c12bf29782050bc1dda5bf91db440ad6309f28dbfaf1fd61
Jul 12 15:29:53.893855 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.893819    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pgrht"]
Jul 12 15:29:53.899191 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.899171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:53.902200 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:29:53.902171    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-pgrht\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="02bb3645-c869-4c48-81a5-f1edfbb02c99" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:53.914124 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.914100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pgrht"]
Jul 12 15:29:53.914297 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:29:53.914278    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-tls\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret"
Jul 12 15:29:53.963546 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.963456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:53.963546 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.963521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxvp\" (UniqueName: \"kubernetes.io/projected/02bb3645-c869-4c48-81a5-f1edfbb02c99-kube-api-access-fqxvp\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:53.987363 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:53.987325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc" event={"ID":"0bf1aad0-0e43-47df-907b-64a77a8c66e4","Type":"ContainerStarted","Data":"48f97b381087cfe6c12bf29782050bc1dda5bf91db440ad6309f28dbfaf1fd61"}
Jul 12 15:29:54.064914 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:54.064865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:54.065086 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:54.064946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxvp\" (UniqueName: \"kubernetes.io/projected/02bb3645-c869-4c48-81a5-f1edfbb02c99-kube-api-access-fqxvp\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:54.073360 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:54.073327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxvp\" (UniqueName: \"kubernetes.io/projected/02bb3645-c869-4c48-81a5-f1edfbb02c99-kube-api-access-fqxvp\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:55.065782 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:29:55.065753    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: failed to sync secret cache: timed out waiting for the condition
Jul 12 15:29:55.066195 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:29:55.065831    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs podName:02bb3645-c869-4c48-81a5-f1edfbb02c99 nodeName:}" failed. No retries permitted until 2026-07-12 15:29:55.565811171 +0000 UTC m=+573.265539928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs") pod "model-serving-api-54d89bd5fc-pgrht" (UID: "02bb3645-c869-4c48-81a5-f1edfbb02c99") : failed to sync secret cache: timed out waiting for the condition
Jul 12 15:29:55.467215 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:55.467187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 12 15:29:55.578644 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:55.578605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:55.581541 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:55.581511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bb3645-c869-4c48-81a5-f1edfbb02c99-tls-certs\") pod \"model-serving-api-54d89bd5fc-pgrht\" (UID: \"02bb3645-c869-4c48-81a5-f1edfbb02c99\") " pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:55.709177 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:55.709141    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:29:55.997156 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:55.997121    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"]
Jul 12 15:29:56.004886 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.004857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.009103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.008561    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 15:29:56.009103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.008784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wxdvm\""
Jul 12 15:29:56.009103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.008958    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 15:29:56.010322 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.010266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"]
Jul 12 15:29:56.083162 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.083116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tmp\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.083600 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.083177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvrg\" (UniqueName: \"kubernetes.io/projected/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-kube-api-access-zmvrg\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.083600 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.083280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tls-certs\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.183779 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.183743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvrg\" (UniqueName: \"kubernetes.io/projected/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-kube-api-access-zmvrg\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.183976 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.183806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tls-certs\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.183976 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.183902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tmp\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.186561 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.186531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tmp\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.186726 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.186703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-tls-certs\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.191835 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.191808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvrg\" (UniqueName: \"kubernetes.io/projected/8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9-kube-api-access-zmvrg\") pod \"kube-auth-proxy-6fb64c5677-5r622\" (UID: \"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9\") " pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.319269 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.319194    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"
Jul 12 15:29:56.873804 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.873775    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:29:56.877335 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.877310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.879882 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.879859    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 15:29:56.879982 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.879888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 15:29:56.880894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.880679    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 15:29:56.880894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.880398    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 15:29:56.881049 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.880897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9br64\""
Jul 12 15:29:56.891835 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.891811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:29:56.992959 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.992904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.992959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.993005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993161 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.993057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nklwh\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993161 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.993085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993259 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.993213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:56.993314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:56.993268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.044831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.044784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fb64c5677-5r622"]
Jul 12 15:29:57.047902 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:57.047863    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1c1159_d8ba_48d5_8c4a_6c9d29171cf9.slice/crio-e0449e85d54771cc5103f51004e9828690ac113b249375116f3539e37f0350cb WatchSource:0}: Error finding container e0449e85d54771cc5103f51004e9828690ac113b249375116f3539e37f0350cb: Status 404 returned error can't find the container with id e0449e85d54771cc5103f51004e9828690ac113b249375116f3539e37f0350cb
Jul 12 15:29:57.064650 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.064622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pgrht"]
Jul 12 15:29:57.066811 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:57.066770    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bb3645_c869_4c48_81a5_f1edfbb02c99.slice/crio-099ab955b323790db79e663ca1b3b4d71ac637b48c0676ba511fecce1f5fd5a4 WatchSource:0}: Error finding container 099ab955b323790db79e663ca1b3b4d71ac637b48c0676ba511fecce1f5fd5a4: Status 404 returned error can't find the container with id 099ab955b323790db79e663ca1b3b4d71ac637b48c0676ba511fecce1f5fd5a4
Jul 12 15:29:57.093846 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.093954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nklwh\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094229 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.094011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.094801 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.094779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.096355 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.096336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.096536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.096519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.097507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.097486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.097580 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.097529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.102440 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.102415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nklwh\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.102571 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.102551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xq7qz\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.193941 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.193847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:29:57.340415 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:57.340368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:29:57.342836 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:29:57.342812    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedb6494_71f4_4d29_8552_9bf300d6476e.slice/crio-627ebb8272472d56d9457e317a0e22e589d795d163a996d5c084f18e51faa5f3 WatchSource:0}: Error finding container 627ebb8272472d56d9457e317a0e22e589d795d163a996d5c084f18e51faa5f3: Status 404 returned error can't find the container with id 627ebb8272472d56d9457e317a0e22e589d795d163a996d5c084f18e51faa5f3
Jul 12 15:29:58.013637 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.013582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622" event={"ID":"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9","Type":"ContainerStarted","Data":"e0449e85d54771cc5103f51004e9828690ac113b249375116f3539e37f0350cb"}
Jul 12 15:29:58.015422 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.015339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" event={"ID":"cedb6494-71f4-4d29-8552-9bf300d6476e","Type":"ContainerStarted","Data":"627ebb8272472d56d9457e317a0e22e589d795d163a996d5c084f18e51faa5f3"}
Jul 12 15:29:58.017235 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.017203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht" event={"ID":"02bb3645-c869-4c48-81a5-f1edfbb02c99","Type":"ContainerStarted","Data":"099ab955b323790db79e663ca1b3b4d71ac637b48c0676ba511fecce1f5fd5a4"}
Jul 12 15:29:58.019120 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.019090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc" event={"ID":"0bf1aad0-0e43-47df-907b-64a77a8c66e4","Type":"ContainerStarted","Data":"b11787a99450be303e570113e6291dedb81236cdf9e054be0b7fdb89c93ebd0a"}
Jul 12 15:29:58.019245 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.019209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:29:58.039590 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:29:58.039531    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc" podStartSLOduration=1.921518368 podStartE2EDuration="5.039510834s" totalImagesPullingTime="3.117992466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:29:58.035772697 +0000 UTC m=+575.735501476" watchObservedRunningTime="2026-07-12 15:29:58.039510834 +0000 UTC m=+575.739239613"
Jul 12 15:30:00.682416 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:00.682361    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:30:00.682695 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:00.682448    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:30:01.035566 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.035468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" event={"ID":"cedb6494-71f4-4d29-8552-9bf300d6476e","Type":"ContainerStarted","Data":"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"}
Jul 12 15:30:01.035821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.035799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:30:01.037218 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.037188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht" event={"ID":"02bb3645-c869-4c48-81a5-f1edfbb02c99","Type":"ContainerStarted","Data":"1b4f9d82d832ac80811b9e1f6b9c5c55ac1fda16553ee41bca5e705dd08bf528"}
Jul 12 15:30:01.037360 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.037283    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:30:01.037861 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.037834    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xq7qz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:30:01.037965 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.037884    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:30:01.039208 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.039178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622" event={"ID":"8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9","Type":"ContainerStarted","Data":"81cb009a6dfb07ac3b83fc53757974018fca78e78aaf9e01070b8e2ac4962731"}
Jul 12 15:30:01.067642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.067598    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" podStartSLOduration=1.7309423069999998 podStartE2EDuration="5.067583423s" totalImagesPullingTime="3.336641116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:01.066563477 +0000 UTC m=+578.766292258" watchObservedRunningTime="2026-07-12 15:30:01.067583423 +0000 UTC m=+578.767312201"
Jul 12 15:30:01.087575 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.087536    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fb64c5677-5r622" podStartSLOduration=2.459007651 podStartE2EDuration="6.087520953s" totalImagesPullingTime="3.628513302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:01.085874635 +0000 UTC m=+578.785603414" watchObservedRunningTime="2026-07-12 15:30:01.087520953 +0000 UTC m=+578.787249732"
Jul 12 15:30:01.104280 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:01.104230    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht" podStartSLOduration=4.498278421 podStartE2EDuration="8.104209801s" totalImagesPullingTime="3.60593138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:01.102732277 +0000 UTC m=+578.802461059" watchObservedRunningTime="2026-07-12 15:30:01.104209801 +0000 UTC m=+578.803938581"
Jul 12 15:30:02.051718 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.051683    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xq7qz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 15:30:02.052080 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.051747    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 15:30:02.493898 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.493868    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"]
Jul 12 15:30:02.496885 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.496866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.501679 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.501659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gnjsd\""
Jul 12 15:30:02.521058 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.521031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"]
Jul 12 15:30:02.553288 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553795 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553795 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2nd\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-kube-api-access-qj2nd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.553795 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.553644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.654974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.654936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.654985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2nd\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-kube-api-access-qj2nd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655224 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655551 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655551 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655551 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655551 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.655920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.655873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.656256 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.656236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.657749 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.657724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.657915 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.657896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.668749 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.668723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.678811 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.678788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2nd\" (UniqueName: \"kubernetes.io/projected/85f43457-02e5-40fe-ab81-5a3ae5e7f0c1-kube-api-access-qj2nd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48p8r7\" (UID: \"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.807661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.807566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:02.968676 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:02.968648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"]
Jul 12 15:30:02.969061 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:30:02.969039    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f43457_02e5_40fe_ab81_5a3ae5e7f0c1.slice/crio-614b5a24780be8873cbcd1f408fd400b3a45f0698f584bdc59d962e6bd145c1b WatchSource:0}: Error finding container 614b5a24780be8873cbcd1f408fd400b3a45f0698f584bdc59d962e6bd145c1b: Status 404 returned error can't find the container with id 614b5a24780be8873cbcd1f408fd400b3a45f0698f584bdc59d962e6bd145c1b
Jul 12 15:30:03.058491 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.058344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7" event={"ID":"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1","Type":"ContainerStarted","Data":"614b5a24780be8873cbcd1f408fd400b3a45f0698f584bdc59d962e6bd145c1b"}
Jul 12 15:30:03.116438 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.116403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"]
Jul 12 15:30:03.121026 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.121004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.124574 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.124551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 12 15:30:03.124574 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.124565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zsqrr\""
Jul 12 15:30:03.131473 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.131451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"]
Jul 12 15:30:03.135854 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.135832    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"]
Jul 12 15:30:03.139198 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.139180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.142252 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.142233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xtspl\""
Jul 12 15:30:03.142358 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.142278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 12 15:30:03.150784 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.150759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"]
Jul 12 15:30:03.260253 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.260222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxwh\" (UniqueName: \"kubernetes.io/projected/5b52583a-d209-4f01-872b-48f6c2d9611b-kube-api-access-pqxwh\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.260485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.260283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b52583a-d209-4f01-872b-48f6c2d9611b-cert\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.260485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.260339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f5ba4d-377c-4518-84db-b17cb37e7769-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.260485 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.260354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n88z6\" (UniqueName: \"kubernetes.io/projected/a8f5ba4d-377c-4518-84db-b17cb37e7769-kube-api-access-n88z6\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.361473 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.361437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b52583a-d209-4f01-872b-48f6c2d9611b-cert\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.361648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.361499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f5ba4d-377c-4518-84db-b17cb37e7769-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.361648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.361527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n88z6\" (UniqueName: \"kubernetes.io/projected/a8f5ba4d-377c-4518-84db-b17cb37e7769-kube-api-access-n88z6\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.361648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.361591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqxwh\" (UniqueName: \"kubernetes.io/projected/5b52583a-d209-4f01-872b-48f6c2d9611b-kube-api-access-pqxwh\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.364266 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.364243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8f5ba4d-377c-4518-84db-b17cb37e7769-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.364409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.364271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b52583a-d209-4f01-872b-48f6c2d9611b-cert\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.372461 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.372428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n88z6\" (UniqueName: \"kubernetes.io/projected/a8f5ba4d-377c-4518-84db-b17cb37e7769-kube-api-access-n88z6\") pod \"llmisvc-controller-manager-777c6bd7d5-ctr9c\" (UID: \"a8f5ba4d-377c-4518-84db-b17cb37e7769\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.373505 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.373487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqxwh\" (UniqueName: \"kubernetes.io/projected/5b52583a-d209-4f01-872b-48f6c2d9611b-kube-api-access-pqxwh\") pod \"kserve-controller-manager-d6f4b65b8-m69zx\" (UID: \"5b52583a-d209-4f01-872b-48f6c2d9611b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.433175 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.433144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:03.450245 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.450217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:03.596409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.596363    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"]
Jul 12 15:30:03.598137 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:30:03.598112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b52583a_d209_4f01_872b_48f6c2d9611b.slice/crio-5dcf2f6bf3bdd50c0cc1683a25ed6f3a8da8cc949415723154c1901bcd083482 WatchSource:0}: Error finding container 5dcf2f6bf3bdd50c0cc1683a25ed6f3a8da8cc949415723154c1901bcd083482: Status 404 returned error can't find the container with id 5dcf2f6bf3bdd50c0cc1683a25ed6f3a8da8cc949415723154c1901bcd083482
Jul 12 15:30:03.613510 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:03.613485    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"]
Jul 12 15:30:03.615624 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:30:03.615590    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8f5ba4d_377c_4518_84db_b17cb37e7769.slice/crio-5a9b91c3894353116894afa93a18651d41b83f77b4696007e9788604c5865f23 WatchSource:0}: Error finding container 5a9b91c3894353116894afa93a18651d41b83f77b4696007e9788604c5865f23: Status 404 returned error can't find the container with id 5a9b91c3894353116894afa93a18651d41b83f77b4696007e9788604c5865f23
Jul 12 15:30:04.064824 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:04.064728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx" event={"ID":"5b52583a-d209-4f01-872b-48f6c2d9611b","Type":"ContainerStarted","Data":"5dcf2f6bf3bdd50c0cc1683a25ed6f3a8da8cc949415723154c1901bcd083482"}
Jul 12 15:30:04.065821 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:04.065797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c" event={"ID":"a8f5ba4d-377c-4518-84db-b17cb37e7769","Type":"ContainerStarted","Data":"5a9b91c3894353116894afa93a18651d41b83f77b4696007e9788604c5865f23"}
Jul 12 15:30:05.053173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:05.053142    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:30:07.083013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.082987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx" event={"ID":"5b52583a-d209-4f01-872b-48f6c2d9611b","Type":"ContainerStarted","Data":"56a2e4879ae2df8b0cc015d795fd44dba459b1cd84680c4f64787d3c7f9600f6"}
Jul 12 15:30:07.083357 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.083048    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:07.084432 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.084408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c" event={"ID":"a8f5ba4d-377c-4518-84db-b17cb37e7769","Type":"ContainerStarted","Data":"a334246a668da0643abc7865e6b1914e52f704ce87d3aaa824f66dcba0ebb3ea"}
Jul 12 15:30:07.084544 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.084533    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:07.099193 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.099136    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx" podStartSLOduration=1.495322863 podStartE2EDuration="4.099122011s" totalImagesPullingTime="2.603799148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:07.09744031 +0000 UTC m=+584.797169090" watchObservedRunningTime="2026-07-12 15:30:07.099122011 +0000 UTC m=+584.798850768"
Jul 12 15:30:07.113143 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:07.113091    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c" podStartSLOduration=0.827944289 podStartE2EDuration="4.113077244s" totalImagesPullingTime="3.285132955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:07.113020154 +0000 UTC m=+584.812748933" watchObservedRunningTime="2026-07-12 15:30:07.113077244 +0000 UTC m=+584.812806023"
Jul 12 15:30:08.239920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.239880    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:30:08.241413 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.241354    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery" containerID="cri-o://0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17" gracePeriod=30
Jul 12 15:30:08.473073 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.473041    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:30:08.473142 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.473111    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:30:08.473179 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.473139    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:30:08.587822 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.587794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:30:08.718920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.718885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.718920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.718919    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.718946    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.718985    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.719004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nklwh\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.719065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.719120    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert\") pod \"cedb6494-71f4-4d29-8552-9bf300d6476e\" (UID: \"cedb6494-71f4-4d29-8552-9bf300d6476e\") "
Jul 12 15:30:08.719590 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.719556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:30:08.721645 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.721607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs" (OuterVolumeSpecName: "local-certs") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:30:08.721879 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.721796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token" (OuterVolumeSpecName: "istio-token") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:30:08.721975 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.721951    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:30:08.722038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.721989    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh" (OuterVolumeSpecName: "kube-api-access-nklwh") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "kube-api-access-nklwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:30:08.722103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.722087    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts" (OuterVolumeSpecName: "cacerts") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:30:08.722160 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.722137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cedb6494-71f4-4d29-8552-9bf300d6476e" (UID: "cedb6494-71f4-4d29-8552-9bf300d6476e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820914    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-ca-configmap\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820945    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-csr-dns-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820955    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-cacerts\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820964    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-kubeconfig\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820973    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cedb6494-71f4-4d29-8552-9bf300d6476e-local-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820980    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-istio-token\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:08.820996 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:08.820987    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nklwh\" (UniqueName: \"kubernetes.io/projected/cedb6494-71f4-4d29-8552-9bf300d6476e-kube-api-access-nklwh\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:09.027743 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.027707    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5rfsc"
Jul 12 15:30:09.097283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.097249    2581 generic.go:356] "Generic (PLEG): container finished" podID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerID="0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17" exitCode=0
Jul 12 15:30:09.097460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.097302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"
Jul 12 15:30:09.097460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.097324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" event={"ID":"cedb6494-71f4-4d29-8552-9bf300d6476e","Type":"ContainerDied","Data":"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"}
Jul 12 15:30:09.097460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.097413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz" event={"ID":"cedb6494-71f4-4d29-8552-9bf300d6476e","Type":"ContainerDied","Data":"627ebb8272472d56d9457e317a0e22e589d795d163a996d5c084f18e51faa5f3"}
Jul 12 15:30:09.097460 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.097444    2581 scope.go:117] "RemoveContainer" containerID="0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"
Jul 12 15:30:09.099907 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.099303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7" event={"ID":"85f43457-02e5-40fe-ab81-5a3ae5e7f0c1","Type":"ContainerStarted","Data":"13b9d360fa0f0a6dd944b25a8932b66e0a03173ce7d698b9a1131be02d3b76b9"}
Jul 12 15:30:09.107583 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.107560    2581 scope.go:117] "RemoveContainer" containerID="0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"
Jul 12 15:30:09.107888 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:30:09.107866    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17\": container with ID starting with 0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17 not found: ID does not exist" containerID="0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"
Jul 12 15:30:09.107950 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.107900    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17"} err="failed to get container status \"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17\": rpc error: code = NotFound desc = could not find container \"0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17\": container with ID starting with 0a499d86c431d9c72b789e031d340058535eef7e89325e9dba504996a555fc17 not found: ID does not exist"
Jul 12 15:30:09.121592 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.121529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7" podStartSLOduration=1.6197820649999999 podStartE2EDuration="7.121508398s" totalImagesPullingTime="5.501726333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:09.119430259 +0000 UTC m=+586.819159041" watchObservedRunningTime="2026-07-12 15:30:09.121508398 +0000 UTC m=+586.821237183"
Jul 12 15:30:09.135557 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.135527    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:30:09.140722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.140694    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xq7qz"]
Jul 12 15:30:09.808045 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.808004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:09.812693 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:09.812669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:10.105670 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:10.105632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:10.106723 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:10.106707    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48p8r7"
Jul 12 15:30:10.847490 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:10.847457    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" path="/var/lib/kubelet/pods/cedb6494-71f4-4d29-8552-9bf300d6476e/volumes"
Jul 12 15:30:12.055850 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:12.055821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pgrht"
Jul 12 15:30:38.092237 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:38.092206    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ctr9c"
Jul 12 15:30:38.095300 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:38.095281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m69zx"
Jul 12 15:30:54.167057 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.166973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:54.167507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.167404    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery"
Jul 12 15:30:54.167507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.167418    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery"
Jul 12 15:30:54.167507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.167488    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cedb6494-71f4-4d29-8552-9bf300d6476e" containerName="discovery"
Jul 12 15:30:54.169662 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.169635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:54.172361 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.172338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 15:30:54.173587 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.173563    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 15:30:54.173717 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.173563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4ksxt\""
Jul 12 15:30:54.178324 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.178295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:54.327776 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.327744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62nkm\" (UniqueName: \"kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm\") pod \"kuadrant-operator-catalog-swqm2\" (UID: \"6894ce3d-3246-4fd4-a7ea-8da7b7417107\") " pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:54.428260 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.428181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62nkm\" (UniqueName: \"kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm\") pod \"kuadrant-operator-catalog-swqm2\" (UID: \"6894ce3d-3246-4fd4-a7ea-8da7b7417107\") " pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:54.437301 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.437273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62nkm\" (UniqueName: \"kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm\") pod \"kuadrant-operator-catalog-swqm2\" (UID: \"6894ce3d-3246-4fd4-a7ea-8da7b7417107\") " pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:54.482247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.482213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:54.534866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.534827    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:54.615034 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.615013    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:54.617517 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:30:54.617492    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6894ce3d_3246_4fd4_a7ea_8da7b7417107.slice/crio-7fdce5174fc670c186cb1edc72297d516c2ad5b2ee4e72819a1153a88fcbc815 WatchSource:0}: Error finding container 7fdce5174fc670c186cb1edc72297d516c2ad5b2ee4e72819a1153a88fcbc815: Status 404 returned error can't find the container with id 7fdce5174fc670c186cb1edc72297d516c2ad5b2ee4e72819a1153a88fcbc815
Jul 12 15:30:54.747162 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.747077    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-478tw"]
Jul 12 15:30:54.750181 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.750164    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:30:54.757454 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.757427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-478tw"]
Jul 12 15:30:54.832238 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.832195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc288\" (UniqueName: \"kubernetes.io/projected/e9bb1f5e-cf65-496a-b699-62c8109931a1-kube-api-access-cc288\") pod \"kuadrant-operator-catalog-478tw\" (UID: \"e9bb1f5e-cf65-496a-b699-62c8109931a1\") " pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:30:54.933492 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.933456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc288\" (UniqueName: \"kubernetes.io/projected/e9bb1f5e-cf65-496a-b699-62c8109931a1-kube-api-access-cc288\") pod \"kuadrant-operator-catalog-478tw\" (UID: \"e9bb1f5e-cf65-496a-b699-62c8109931a1\") " pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:30:54.941459 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:54.941434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc288\" (UniqueName: \"kubernetes.io/projected/e9bb1f5e-cf65-496a-b699-62c8109931a1-kube-api-access-cc288\") pod \"kuadrant-operator-catalog-478tw\" (UID: \"e9bb1f5e-cf65-496a-b699-62c8109931a1\") " pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:30:55.060899 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:55.060813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:30:55.208890 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:55.208869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-478tw"]
Jul 12 15:30:55.211190 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:30:55.211158    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bb1f5e_cf65_496a_b699_62c8109931a1.slice/crio-3307d5e1e5261b12208a1d54688a7e7caa3e4628db9c2a88e97b46c93ea9da66 WatchSource:0}: Error finding container 3307d5e1e5261b12208a1d54688a7e7caa3e4628db9c2a88e97b46c93ea9da66: Status 404 returned error can't find the container with id 3307d5e1e5261b12208a1d54688a7e7caa3e4628db9c2a88e97b46c93ea9da66
Jul 12 15:30:55.317478 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:55.317397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-478tw" event={"ID":"e9bb1f5e-cf65-496a-b699-62c8109931a1","Type":"ContainerStarted","Data":"3307d5e1e5261b12208a1d54688a7e7caa3e4628db9c2a88e97b46c93ea9da66"}
Jul 12 15:30:55.318728 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:55.318699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" event={"ID":"6894ce3d-3246-4fd4-a7ea-8da7b7417107","Type":"ContainerStarted","Data":"7fdce5174fc670c186cb1edc72297d516c2ad5b2ee4e72819a1153a88fcbc815"}
Jul 12 15:30:57.333779 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.333742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-478tw" event={"ID":"e9bb1f5e-cf65-496a-b699-62c8109931a1","Type":"ContainerStarted","Data":"5b0dbcbe005ac68c4c2b8daf9611fc4836fdf6d4606b92baa3a3103e4540d5a1"}
Jul 12 15:30:57.335239 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.335215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" event={"ID":"6894ce3d-3246-4fd4-a7ea-8da7b7417107","Type":"ContainerStarted","Data":"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"}
Jul 12 15:30:57.335356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.335271    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" podUID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" containerName="registry-server" containerID="cri-o://f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980" gracePeriod=2
Jul 12 15:30:57.350280 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.350234    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-478tw" podStartSLOduration=2.02425953 podStartE2EDuration="3.350217627s" totalImagesPullingTime="1.325958097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:57.348921193 +0000 UTC m=+635.048649973" watchObservedRunningTime="2026-07-12 15:30:57.350217627 +0000 UTC m=+635.049946406"
Jul 12 15:30:57.364954 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.364907    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" podStartSLOduration=1.446333641 podStartE2EDuration="3.364892771s" totalImagesPullingTime="1.91855913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:30:57.362867737 +0000 UTC m=+635.062596518" watchObservedRunningTime="2026-07-12 15:30:57.364892771 +0000 UTC m=+635.064621581"
Jul 12 15:30:57.590638 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.590582    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:57.758350 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.758308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62nkm\" (UniqueName: \"kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm\") pod \"6894ce3d-3246-4fd4-a7ea-8da7b7417107\" (UID: \"6894ce3d-3246-4fd4-a7ea-8da7b7417107\") "
Jul 12 15:30:57.760618 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.760596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm" (OuterVolumeSpecName: "kube-api-access-62nkm") pod "6894ce3d-3246-4fd4-a7ea-8da7b7417107" (UID: "6894ce3d-3246-4fd4-a7ea-8da7b7417107"). InnerVolumeSpecName "kube-api-access-62nkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:30:57.859502 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:57.859479    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62nkm\" (UniqueName: \"kubernetes.io/projected/6894ce3d-3246-4fd4-a7ea-8da7b7417107-kube-api-access-62nkm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:30:58.341289 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.341205    2581 generic.go:356] "Generic (PLEG): container finished" podID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" containerID="f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980" exitCode=0
Jul 12 15:30:58.341289 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.341243    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-swqm2"
Jul 12 15:30:58.341289 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.341277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" event={"ID":"6894ce3d-3246-4fd4-a7ea-8da7b7417107","Type":"ContainerDied","Data":"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"}
Jul 12 15:30:58.341830 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.341315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-swqm2" event={"ID":"6894ce3d-3246-4fd4-a7ea-8da7b7417107","Type":"ContainerDied","Data":"7fdce5174fc670c186cb1edc72297d516c2ad5b2ee4e72819a1153a88fcbc815"}
Jul 12 15:30:58.341830 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.341335    2581 scope.go:117] "RemoveContainer" containerID="f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"
Jul 12 15:30:58.350789 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.350772    2581 scope.go:117] "RemoveContainer" containerID="f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"
Jul 12 15:30:58.351043 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:30:58.351026    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980\": container with ID starting with f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980 not found: ID does not exist" containerID="f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"
Jul 12 15:30:58.351086 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.351053    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980"} err="failed to get container status \"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980\": rpc error: code = NotFound desc = could not find container \"f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980\": container with ID starting with f8c1b6907545476f92db29c9c56956f2c0d15f1fb865b42dcae87ce8e37d7980 not found: ID does not exist"
Jul 12 15:30:58.362149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.362127    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:58.367569 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.367545    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-swqm2"]
Jul 12 15:30:58.846891 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:30:58.846859    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" path="/var/lib/kubelet/pods/6894ce3d-3246-4fd4-a7ea-8da7b7417107/volumes"
Jul 12 15:31:05.060960 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:05.060925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:31:05.061459 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:05.061001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:31:05.084123 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:05.084098    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:31:05.398889 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:05.398854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-478tw"
Jul 12 15:31:09.778244 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.778212    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"]
Jul 12 15:31:09.778649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.778631    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" containerName="registry-server"
Jul 12 15:31:09.778649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.778643    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" containerName="registry-server"
Jul 12 15:31:09.778739 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.778704    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6894ce3d-3246-4fd4-a7ea-8da7b7417107" containerName="registry-server"
Jul 12 15:31:09.782220 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.782203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.784628 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.784609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2bhgs\""
Jul 12 15:31:09.789563 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.789327    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"]
Jul 12 15:31:09.866241 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.866211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bfd\" (UniqueName: \"kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.866451 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.866281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.866451 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.866347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.967524 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.967489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.967660 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.967550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bfd\" (UniqueName: \"kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.967660 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.967604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.967894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.967875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.967943 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.967928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:09.975285 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:09.975262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bfd\" (UniqueName: \"kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:10.092665 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.092573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:10.226221 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.226198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"]
Jul 12 15:31:10.228433 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:10.228407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a85142_e7be_4722_b7a6_87aae572fe73.slice/crio-c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a WatchSource:0}: Error finding container c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a: Status 404 returned error can't find the container with id c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a
Jul 12 15:31:10.376662 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.376636    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"]
Jul 12 15:31:10.380233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.380214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.387338 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.387315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"]
Jul 12 15:31:10.402741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.402708    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerID="6d7e897f7d9354c5800f3bb1459b294ce579655b6f540cddb13f1e9b53041bf1" exitCode=0
Jul 12 15:31:10.402869 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.402790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj" event={"ID":"b3a85142-e7be-4722-b7a6-87aae572fe73","Type":"ContainerDied","Data":"6d7e897f7d9354c5800f3bb1459b294ce579655b6f540cddb13f1e9b53041bf1"}
Jul 12 15:31:10.402869 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.402839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj" event={"ID":"b3a85142-e7be-4722-b7a6-87aae572fe73","Type":"ContainerStarted","Data":"c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a"}
Jul 12 15:31:10.472691 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.472647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bmb\" (UniqueName: \"kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.472691 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.472686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.472950 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.472783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.573891 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.573852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.574078 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.573934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bmb\" (UniqueName: \"kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.574078 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.573962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.574246 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.574212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.574313 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.574285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.582057 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.582033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bmb\" (UniqueName: \"kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.696055 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.695973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:10.834728 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.834700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"]
Jul 12 15:31:10.836238 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:10.836201    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb713a4b2_3d02_4193_91c1_8e5fcaa29815.slice/crio-b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee WatchSource:0}: Error finding container b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee: Status 404 returned error can't find the container with id b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee
Jul 12 15:31:10.971661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.971598    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"]
Jul 12 15:31:10.975202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.975186    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:10.981683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:10.981657    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"]
Jul 12 15:31:11.079580 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.079547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdshz\" (UniqueName: \"kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.079714 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.079600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.079714 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.079659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.180335 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.180301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.180462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.180422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdshz\" (UniqueName: \"kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.180462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.180455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.180789 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.180769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.180857 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.180817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.189311 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.189280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdshz\" (UniqueName: \"kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.340927 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.340842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:11.383938 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.383908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"]
Jul 12 15:31:11.389071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.389048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.401481 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.399290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"]
Jul 12 15:31:11.413141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.412894    2581 generic.go:356] "Generic (PLEG): container finished" podID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerID="3b150de07a0841c5bb16c4f1450d2e621ba89e3ac9b993c2e6f21feb8986e43e" exitCode=0
Jul 12 15:31:11.413141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.412977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k" event={"ID":"b713a4b2-3d02-4193-91c1-8e5fcaa29815","Type":"ContainerDied","Data":"3b150de07a0841c5bb16c4f1450d2e621ba89e3ac9b993c2e6f21feb8986e43e"}
Jul 12 15:31:11.413141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.413035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k" event={"ID":"b713a4b2-3d02-4193-91c1-8e5fcaa29815","Type":"ContainerStarted","Data":"b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee"}
Jul 12 15:31:11.415575 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.415551    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerID="59d17118920ced7ef1be54ae727437c41431e2fcf3bd49ffde9c0f1ac26d5ef7" exitCode=0
Jul 12 15:31:11.415716 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.415594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj" event={"ID":"b3a85142-e7be-4722-b7a6-87aae572fe73","Type":"ContainerDied","Data":"59d17118920ced7ef1be54ae727437c41431e2fcf3bd49ffde9c0f1ac26d5ef7"}
Jul 12 15:31:11.484311 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.484263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.484495 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.484449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fpph\" (UniqueName: \"kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.484555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.484538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.493629 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.493603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"]
Jul 12 15:31:11.495059 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:11.495031    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956a3703_4259_4c51_8fb3_33d8aef6d6d7.slice/crio-95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db WatchSource:0}: Error finding container 95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db: Status 404 returned error can't find the container with id 95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db
Jul 12 15:31:11.585909 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.585880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.586036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.585952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fpph\" (UniqueName: \"kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.586036 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.585983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.586250 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.586229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.586339 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.586322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.594176 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.594154    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fpph\" (UniqueName: \"kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.705443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.705410    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:11.860681 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:11.860660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"]
Jul 12 15:31:11.862771 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:11.862739    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc1edb2_1921_4907_8883_d22c1ff96a4e.slice/crio-1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62 WatchSource:0}: Error finding container 1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62: Status 404 returned error can't find the container with id 1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62
Jul 12 15:31:12.422053 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.421965    2581 generic.go:356] "Generic (PLEG): container finished" podID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerID="7e9b16d5e7d30d7dc6210e92507b5cd6c8a550b2523dc748e441a7b2f359bef0" exitCode=0
Jul 12 15:31:12.422242 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.422068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj" event={"ID":"956a3703-4259-4c51-8fb3-33d8aef6d6d7","Type":"ContainerDied","Data":"7e9b16d5e7d30d7dc6210e92507b5cd6c8a550b2523dc748e441a7b2f359bef0"}
Jul 12 15:31:12.422242 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.422132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj" event={"ID":"956a3703-4259-4c51-8fb3-33d8aef6d6d7","Type":"ContainerStarted","Data":"95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db"}
Jul 12 15:31:12.424267 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.424232    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerID="33252385244f150cfeeacaa5c9e5da39a6fac2a59f71d2691b331d060baa02e4" exitCode=0
Jul 12 15:31:12.424329 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.424308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj" event={"ID":"b3a85142-e7be-4722-b7a6-87aae572fe73","Type":"ContainerDied","Data":"33252385244f150cfeeacaa5c9e5da39a6fac2a59f71d2691b331d060baa02e4"}
Jul 12 15:31:12.426023 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.426006    2581 generic.go:356] "Generic (PLEG): container finished" podID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerID="e1eaca9a4931ddf27fd044d4838dd7d45a1388990ba9ced60bd48e0d40446b66" exitCode=0
Jul 12 15:31:12.426116 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.426070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k" event={"ID":"b713a4b2-3d02-4193-91c1-8e5fcaa29815","Type":"ContainerDied","Data":"e1eaca9a4931ddf27fd044d4838dd7d45a1388990ba9ced60bd48e0d40446b66"}
Jul 12 15:31:12.427616 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.427596    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerID="a4576da8b81cb4a30ad414b0d4c12f23bd3cbf88460bfdffe47ddba81e6d306a" exitCode=0
Jul 12 15:31:12.427683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.427668    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g" event={"ID":"2fc1edb2-1921-4907-8883-d22c1ff96a4e","Type":"ContainerDied","Data":"a4576da8b81cb4a30ad414b0d4c12f23bd3cbf88460bfdffe47ddba81e6d306a"}
Jul 12 15:31:12.427725 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:12.427706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g" event={"ID":"2fc1edb2-1921-4907-8883-d22c1ff96a4e","Type":"ContainerStarted","Data":"1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62"}
Jul 12 15:31:13.435093 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.435059    2581 generic.go:356] "Generic (PLEG): container finished" podID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerID="e9d4cc4be581d8f13985062a3547f0bfd5f4d6140c2631a12ac6ae798bbc7463" exitCode=0
Jul 12 15:31:13.435527 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.435139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k" event={"ID":"b713a4b2-3d02-4193-91c1-8e5fcaa29815","Type":"ContainerDied","Data":"e9d4cc4be581d8f13985062a3547f0bfd5f4d6140c2631a12ac6ae798bbc7463"}
Jul 12 15:31:13.437143 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.437123    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerID="a8cbb5048d67ec8c1acbfc94be75413be02f9e6ee98fb30bd7177b8ca29d50c2" exitCode=0
Jul 12 15:31:13.437263 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.437154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g" event={"ID":"2fc1edb2-1921-4907-8883-d22c1ff96a4e","Type":"ContainerDied","Data":"a8cbb5048d67ec8c1acbfc94be75413be02f9e6ee98fb30bd7177b8ca29d50c2"}
Jul 12 15:31:13.439188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.439167    2581 generic.go:356] "Generic (PLEG): container finished" podID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerID="8dd6d3484639c26fb8d1c976b37c6a5e52c9c32e8db8e0391c86dcb65311e22d" exitCode=0
Jul 12 15:31:13.439489 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.439250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj" event={"ID":"956a3703-4259-4c51-8fb3-33d8aef6d6d7","Type":"ContainerDied","Data":"8dd6d3484639c26fb8d1c976b37c6a5e52c9c32e8db8e0391c86dcb65311e22d"}
Jul 12 15:31:13.575545 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.575522    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:13.602261 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.602230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util\") pod \"b3a85142-e7be-4722-b7a6-87aae572fe73\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") "
Jul 12 15:31:13.602443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.602332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8bfd\" (UniqueName: \"kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd\") pod \"b3a85142-e7be-4722-b7a6-87aae572fe73\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") "
Jul 12 15:31:13.602443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.602410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle\") pod \"b3a85142-e7be-4722-b7a6-87aae572fe73\" (UID: \"b3a85142-e7be-4722-b7a6-87aae572fe73\") "
Jul 12 15:31:13.602866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.602840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle" (OuterVolumeSpecName: "bundle") pod "b3a85142-e7be-4722-b7a6-87aae572fe73" (UID: "b3a85142-e7be-4722-b7a6-87aae572fe73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:13.604554 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.604520    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd" (OuterVolumeSpecName: "kube-api-access-g8bfd") pod "b3a85142-e7be-4722-b7a6-87aae572fe73" (UID: "b3a85142-e7be-4722-b7a6-87aae572fe73"). InnerVolumeSpecName "kube-api-access-g8bfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:31:13.607944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.607924    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util" (OuterVolumeSpecName: "util") pod "b3a85142-e7be-4722-b7a6-87aae572fe73" (UID: "b3a85142-e7be-4722-b7a6-87aae572fe73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:13.703706 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.703673    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8bfd\" (UniqueName: \"kubernetes.io/projected/b3a85142-e7be-4722-b7a6-87aae572fe73-kube-api-access-g8bfd\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:13.703706 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.703699    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:13.703706 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:13.703708    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3a85142-e7be-4722-b7a6-87aae572fe73-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:14.446804 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.446775    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj"
Jul 12 15:31:14.447244 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.446824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj" event={"ID":"b3a85142-e7be-4722-b7a6-87aae572fe73","Type":"ContainerDied","Data":"c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a"}
Jul 12 15:31:14.447244 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.446902    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4e900a6d2b8b6f84741bac95a30a612b71eeda9bb0204b8bdaefa25f67ae40a"
Jul 12 15:31:14.448794 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.448767    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerID="9a463e931b2fd366d27c96b775ed7be254960e602d5095bf2451771075dda31e" exitCode=0
Jul 12 15:31:14.448914 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.448845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g" event={"ID":"2fc1edb2-1921-4907-8883-d22c1ff96a4e","Type":"ContainerDied","Data":"9a463e931b2fd366d27c96b775ed7be254960e602d5095bf2451771075dda31e"}
Jul 12 15:31:14.450840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.450815    2581 generic.go:356] "Generic (PLEG): container finished" podID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerID="9bb60732ec6b73e489afb0a4c05e6cacd49ff46e568188e65bd1e2b59af20489" exitCode=0
Jul 12 15:31:14.450928 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.450877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj" event={"ID":"956a3703-4259-4c51-8fb3-33d8aef6d6d7","Type":"ContainerDied","Data":"9bb60732ec6b73e489afb0a4c05e6cacd49ff46e568188e65bd1e2b59af20489"}
Jul 12 15:31:14.598789 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.598765    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:14.710911 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.710881    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8bmb\" (UniqueName: \"kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb\") pod \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") "
Jul 12 15:31:14.710911 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.710916    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util\") pod \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") "
Jul 12 15:31:14.711122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.710981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle\") pod \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\" (UID: \"b713a4b2-3d02-4193-91c1-8e5fcaa29815\") "
Jul 12 15:31:14.711517 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.711494    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle" (OuterVolumeSpecName: "bundle") pod "b713a4b2-3d02-4193-91c1-8e5fcaa29815" (UID: "b713a4b2-3d02-4193-91c1-8e5fcaa29815"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:14.713123 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.713100    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb" (OuterVolumeSpecName: "kube-api-access-s8bmb") pod "b713a4b2-3d02-4193-91c1-8e5fcaa29815" (UID: "b713a4b2-3d02-4193-91c1-8e5fcaa29815"). InnerVolumeSpecName "kube-api-access-s8bmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:31:14.716481 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.716460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util" (OuterVolumeSpecName: "util") pod "b713a4b2-3d02-4193-91c1-8e5fcaa29815" (UID: "b713a4b2-3d02-4193-91c1-8e5fcaa29815"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:14.812031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.811944    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8bmb\" (UniqueName: \"kubernetes.io/projected/b713a4b2-3d02-4193-91c1-8e5fcaa29815-kube-api-access-s8bmb\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:14.812031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.811977    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:14.812031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:14.811988    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b713a4b2-3d02-4193-91c1-8e5fcaa29815-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.457962 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.457933    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k"
Jul 12 15:31:15.458368 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.457972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k" event={"ID":"b713a4b2-3d02-4193-91c1-8e5fcaa29815","Type":"ContainerDied","Data":"b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee"}
Jul 12 15:31:15.458368 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.458014    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b112a18fb65ac0e5ec9c95b56057f33ff35709277f808f39053c0edf6d6e60ee"
Jul 12 15:31:15.593661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.593632    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:15.621084 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.621063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdshz\" (UniqueName: \"kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz\") pod \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") "
Jul 12 15:31:15.621202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.621104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util\") pod \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") "
Jul 12 15:31:15.621202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.621193    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle\") pod \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\" (UID: \"956a3703-4259-4c51-8fb3-33d8aef6d6d7\") "
Jul 12 15:31:15.621856 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.621830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle" (OuterVolumeSpecName: "bundle") pod "956a3703-4259-4c51-8fb3-33d8aef6d6d7" (UID: "956a3703-4259-4c51-8fb3-33d8aef6d6d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:15.623262 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.623243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz" (OuterVolumeSpecName: "kube-api-access-sdshz") pod "956a3703-4259-4c51-8fb3-33d8aef6d6d7" (UID: "956a3703-4259-4c51-8fb3-33d8aef6d6d7"). InnerVolumeSpecName "kube-api-access-sdshz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:31:15.626642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.626617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util" (OuterVolumeSpecName: "util") pod "956a3703-4259-4c51-8fb3-33d8aef6d6d7" (UID: "956a3703-4259-4c51-8fb3-33d8aef6d6d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:15.641365 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.641346    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:15.721807 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.721724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util\") pod \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") "
Jul 12 15:31:15.721956 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.721833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fpph\" (UniqueName: \"kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph\") pod \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") "
Jul 12 15:31:15.721956 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.721862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle\") pod \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\" (UID: \"2fc1edb2-1921-4907-8883-d22c1ff96a4e\") "
Jul 12 15:31:15.722074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.722037    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.722074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.722048    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/956a3703-4259-4c51-8fb3-33d8aef6d6d7-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.722074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.722056    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdshz\" (UniqueName: \"kubernetes.io/projected/956a3703-4259-4c51-8fb3-33d8aef6d6d7-kube-api-access-sdshz\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.722410 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.722365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle" (OuterVolumeSpecName: "bundle") pod "2fc1edb2-1921-4907-8883-d22c1ff96a4e" (UID: "2fc1edb2-1921-4907-8883-d22c1ff96a4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:15.724170 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.724144    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph" (OuterVolumeSpecName: "kube-api-access-5fpph") pod "2fc1edb2-1921-4907-8883-d22c1ff96a4e" (UID: "2fc1edb2-1921-4907-8883-d22c1ff96a4e"). InnerVolumeSpecName "kube-api-access-5fpph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:31:15.727341 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.727319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util" (OuterVolumeSpecName: "util") pod "2fc1edb2-1921-4907-8883-d22c1ff96a4e" (UID: "2fc1edb2-1921-4907-8883-d22c1ff96a4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:31:15.822700 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.822672    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fpph\" (UniqueName: \"kubernetes.io/projected/2fc1edb2-1921-4907-8883-d22c1ff96a4e-kube-api-access-5fpph\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.822700 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.822698    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:15.822700 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:15.822708    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1edb2-1921-4907-8883-d22c1ff96a4e-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:31:16.465712 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.465671    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g"
Jul 12 15:31:16.465712 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.465697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g" event={"ID":"2fc1edb2-1921-4907-8883-d22c1ff96a4e","Type":"ContainerDied","Data":"1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62"}
Jul 12 15:31:16.466137 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.465745    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1731930fea2e47aa11d1cb8c1ae0253b9b841f62034812c0ee4058f23c90bd62"
Jul 12 15:31:16.467784 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.467757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj" event={"ID":"956a3703-4259-4c51-8fb3-33d8aef6d6d7","Type":"ContainerDied","Data":"95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db"}
Jul 12 15:31:16.467900 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.467800    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj"
Jul 12 15:31:16.467900 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:16.467803    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95944df55c20589bf0ee97d003eda42fe97ca8d75ad0fdeb4069510e6adb49db"
Jul 12 15:31:26.097374 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097340    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"]
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097733    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097745    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097752    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097767    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097772    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097778    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="extract"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097783    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="extract"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097791    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097796    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097803    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097808    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="util"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097817    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="extract"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097822    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="extract"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097831    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097836    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="pull"
Jul 12 15:31:26.097831 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="pull"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097845    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="pull"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097852    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097856    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097865    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="util"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097870    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="util"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097875    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097880    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097946    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc1edb2-1921-4907-8883-d22c1ff96a4e" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097955    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="956a3703-4259-4c51-8fb3-33d8aef6d6d7" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097962    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a85142-e7be-4722-b7a6-87aae572fe73" containerName="extract"
Jul 12 15:31:26.098433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.097968    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b713a4b2-3d02-4193-91c1-8e5fcaa29815" containerName="extract"
Jul 12 15:31:26.102276 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.102258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:26.105720 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.105697    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x8ztb\""
Jul 12 15:31:26.118333 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.118312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"]
Jul 12 15:31:26.218577 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.218543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m7qh\" (UniqueName: \"kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh\") pod \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" (UID: \"feb08a52-baad-4695-94bf-e5bafbcd77e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:26.319865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.319810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m7qh\" (UniqueName: \"kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh\") pod \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" (UID: \"feb08a52-baad-4695-94bf-e5bafbcd77e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:26.334288 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.334257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m7qh\" (UniqueName: \"kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh\") pod \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" (UID: \"feb08a52-baad-4695-94bf-e5bafbcd77e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:26.412171 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.412077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:26.557926 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.557895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"]
Jul 12 15:31:26.560890 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:26.560862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb08a52_baad_4695_94bf_e5bafbcd77e3.slice/crio-cff37defed96243650c2344b37d6cbcaf5a914cca4bd2cc766c8818beb029fbf WatchSource:0}: Error finding container cff37defed96243650c2344b37d6cbcaf5a914cca4bd2cc766c8818beb029fbf: Status 404 returned error can't find the container with id cff37defed96243650c2344b37d6cbcaf5a914cca4bd2cc766c8818beb029fbf
Jul 12 15:31:26.563050 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:26.563034    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:31:27.530009 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:27.529972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm" event={"ID":"feb08a52-baad-4695-94bf-e5bafbcd77e3","Type":"ContainerStarted","Data":"cff37defed96243650c2344b37d6cbcaf5a914cca4bd2cc766c8818beb029fbf"}
Jul 12 15:31:27.942114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:27.942082    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6578d6b7bf-f59rc"]
Jul 12 15:31:27.946014 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:27.945991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:27.959106 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:27.959070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6578d6b7bf-f59rc"]
Jul 12 15:31:28.036041 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-console-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-trusted-ca-bundle\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036347 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-oauth-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036347 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-service-ca\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036452 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9cxk\" (UniqueName: \"kubernetes.io/projected/199be704-df2e-46cc-b530-efc67e7f4e55-kube-api-access-b9cxk\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.036522 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.036500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-oauth-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137621 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137621 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-console-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-trusted-ca-bundle\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-oauth-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-service-ca\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9cxk\" (UniqueName: \"kubernetes.io/projected/199be704-df2e-46cc-b530-efc67e7f4e55-kube-api-access-b9cxk\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.137829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.137819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-oauth-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.138550 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.138524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-service-ca\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.138665 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.138611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-console-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.138665 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.138647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-trusted-ca-bundle\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.138835 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.138812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/199be704-df2e-46cc-b530-efc67e7f4e55-oauth-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.140540 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.140509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-serving-cert\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.140663 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.140612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/199be704-df2e-46cc-b530-efc67e7f4e55-console-oauth-config\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.145896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.145868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9cxk\" (UniqueName: \"kubernetes.io/projected/199be704-df2e-46cc-b530-efc67e7f4e55-kube-api-access-b9cxk\") pod \"console-6578d6b7bf-f59rc\" (UID: \"199be704-df2e-46cc-b530-efc67e7f4e55\") " pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.259796 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.259762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:28.398029 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.398005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6578d6b7bf-f59rc"]
Jul 12 15:31:28.399626 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:28.399597    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199be704_df2e_46cc_b530_efc67e7f4e55.slice/crio-7da47a2e62120df8a4b7bb01c95fd362eed7742d78ce964756ea3089c935bf0a WatchSource:0}: Error finding container 7da47a2e62120df8a4b7bb01c95fd362eed7742d78ce964756ea3089c935bf0a: Status 404 returned error can't find the container with id 7da47a2e62120df8a4b7bb01c95fd362eed7742d78ce964756ea3089c935bf0a
Jul 12 15:31:28.536478 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.536357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578d6b7bf-f59rc" event={"ID":"199be704-df2e-46cc-b530-efc67e7f4e55","Type":"ContainerStarted","Data":"65ef7fe11a9be34a514def1e0cbc8368006dee3eaa53a1b8f0190b4e3caead52"}
Jul 12 15:31:28.536478 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.536434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6578d6b7bf-f59rc" event={"ID":"199be704-df2e-46cc-b530-efc67e7f4e55","Type":"ContainerStarted","Data":"7da47a2e62120df8a4b7bb01c95fd362eed7742d78ce964756ea3089c935bf0a"}
Jul 12 15:31:28.537975 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.537949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm" event={"ID":"feb08a52-baad-4695-94bf-e5bafbcd77e3","Type":"ContainerStarted","Data":"2626637b406764c2cf7d58cff24adae66c35255e6b9ae0c4e06b9dd9a8872f52"}
Jul 12 15:31:28.538100 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.538078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:28.553464 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.553411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6578d6b7bf-f59rc" podStartSLOduration=1.553373202 podStartE2EDuration="1.553373202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:31:28.552822675 +0000 UTC m=+666.252551468" watchObservedRunningTime="2026-07-12 15:31:28.553373202 +0000 UTC m=+666.253101982"
Jul 12 15:31:28.569321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:28.569274    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm" podStartSLOduration=0.958471018 podStartE2EDuration="2.56925847s" totalImagesPullingTime="1.610787452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:31:28.567014024 +0000 UTC m=+666.266742827" watchObservedRunningTime="2026-07-12 15:31:28.56925847 +0000 UTC m=+666.268987305"
Jul 12 15:31:29.593681 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.593647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"]
Jul 12 15:31:29.597247 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.597226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:29.600981 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.600963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p4m6x\""
Jul 12 15:31:29.601123 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.601107    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 12 15:31:29.621505 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.621478    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"]
Jul 12 15:31:29.652078 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.652036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvntp\" (UniqueName: \"kubernetes.io/projected/6954ce14-7957-420b-9ff4-ce5d0e0c96d1-kube-api-access-mvntp\") pod \"dns-operator-controller-manager-864dd78c4c-fz9sg\" (UID: \"6954ce14-7957-420b-9ff4-ce5d0e0c96d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:29.753232 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.753194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvntp\" (UniqueName: \"kubernetes.io/projected/6954ce14-7957-420b-9ff4-ce5d0e0c96d1-kube-api-access-mvntp\") pod \"dns-operator-controller-manager-864dd78c4c-fz9sg\" (UID: \"6954ce14-7957-420b-9ff4-ce5d0e0c96d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:29.764189 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.764160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvntp\" (UniqueName: \"kubernetes.io/projected/6954ce14-7957-420b-9ff4-ce5d0e0c96d1-kube-api-access-mvntp\") pod \"dns-operator-controller-manager-864dd78c4c-fz9sg\" (UID: \"6954ce14-7957-420b-9ff4-ce5d0e0c96d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:29.907637 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:29.907549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:30.043445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:30.043418    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"]
Jul 12 15:31:30.045284 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:30.045258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6954ce14_7957_420b_9ff4_ce5d0e0c96d1.slice/crio-56f3e89866916c6c130c8793293b59518d300b6769304a455ec3761fdfde77ea WatchSource:0}: Error finding container 56f3e89866916c6c130c8793293b59518d300b6769304a455ec3761fdfde77ea: Status 404 returned error can't find the container with id 56f3e89866916c6c130c8793293b59518d300b6769304a455ec3761fdfde77ea
Jul 12 15:31:30.550284 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:30.550250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg" event={"ID":"6954ce14-7957-420b-9ff4-ce5d0e0c96d1","Type":"ContainerStarted","Data":"56f3e89866916c6c130c8793293b59518d300b6769304a455ec3761fdfde77ea"}
Jul 12 15:31:32.563611 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:32.563573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg" event={"ID":"6954ce14-7957-420b-9ff4-ce5d0e0c96d1","Type":"ContainerStarted","Data":"8feea079ec7c185e4423be386d4351739ed178c36e467aab842ee8d35d4412bc"}
Jul 12 15:31:32.564046 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:32.563749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:32.582865 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:32.582746    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg" podStartSLOduration=1.7325753179999999 podStartE2EDuration="3.582727596s" totalImagesPullingTime="1.850152278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:31:32.582490157 +0000 UTC m=+670.282218939" watchObservedRunningTime="2026-07-12 15:31:32.582727596 +0000 UTC m=+670.282456377"
Jul 12 15:31:33.219894 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.219859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"]
Jul 12 15:31:33.223820 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.223797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:33.227832 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.227807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xctn8\""
Jul 12 15:31:33.237256 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.237236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"]
Jul 12 15:31:33.289243 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.289215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjph\" (UniqueName: \"kubernetes.io/projected/958650e1-8acf-42b2-9368-99837f6ea265-kube-api-access-lzjph\") pod \"authorino-operator-75cc8d5cb7-9f8jd\" (UID: \"958650e1-8acf-42b2-9368-99837f6ea265\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:33.390253 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.390225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjph\" (UniqueName: \"kubernetes.io/projected/958650e1-8acf-42b2-9368-99837f6ea265-kube-api-access-lzjph\") pod \"authorino-operator-75cc8d5cb7-9f8jd\" (UID: \"958650e1-8acf-42b2-9368-99837f6ea265\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:33.402298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.402266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjph\" (UniqueName: \"kubernetes.io/projected/958650e1-8acf-42b2-9368-99837f6ea265-kube-api-access-lzjph\") pod \"authorino-operator-75cc8d5cb7-9f8jd\" (UID: \"958650e1-8acf-42b2-9368-99837f6ea265\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:33.534589 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.534505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:33.710476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:33.710453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"]
Jul 12 15:31:33.712095 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:33.712070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958650e1_8acf_42b2_9368_99837f6ea265.slice/crio-abd9a42466709522d268edbe6d254a240005ee09540f8047f7fc2907a1fb7edd WatchSource:0}: Error finding container abd9a42466709522d268edbe6d254a240005ee09540f8047f7fc2907a1fb7edd: Status 404 returned error can't find the container with id abd9a42466709522d268edbe6d254a240005ee09540f8047f7fc2907a1fb7edd
Jul 12 15:31:34.580895 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:34.580854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd" event={"ID":"958650e1-8acf-42b2-9368-99837f6ea265","Type":"ContainerStarted","Data":"abd9a42466709522d268edbe6d254a240005ee09540f8047f7fc2907a1fb7edd"}
Jul 12 15:31:36.593923 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:36.593888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd" event={"ID":"958650e1-8acf-42b2-9368-99837f6ea265","Type":"ContainerStarted","Data":"44a14fbd8f8c4f0cbd793afd8187bfc860f2a90326053b81834fb4b9ccb26d7c"}
Jul 12 15:31:36.594291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:36.594001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:36.613278 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:36.613220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd" podStartSLOduration=1.435978376 podStartE2EDuration="3.613203152s" totalImagesPullingTime="2.177224776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:31:36.611772378 +0000 UTC m=+674.311501158" watchObservedRunningTime="2026-07-12 15:31:36.613203152 +0000 UTC m=+674.312931930"
Jul 12 15:31:38.260579 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:38.260533    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:38.261039 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:38.260596    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:38.265585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:38.265563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:38.609701 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:38.609674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6578d6b7bf-f59rc"
Jul 12 15:31:38.660862 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:38.660823    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:31:39.545562 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:39.545534    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:43.573464 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:43.573435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9sg"
Jul 12 15:31:46.987428 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.987396    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"]
Jul 12 15:31:46.990678 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.990661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:46.993173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.993153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 15:31:46.993283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.993181    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2bhgs\""
Jul 12 15:31:46.993449 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.993436    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 15:31:46.997030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:46.997010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"]
Jul 12 15:31:47.028003 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.027978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492n5\" (UniqueName: \"kubernetes.io/projected/90104e71-f354-406c-8a81-d78d8332c946-kube-api-access-492n5\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.028124 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.028016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/90104e71-f354-406c-8a81-d78d8332c946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.028124 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.028031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90104e71-f354-406c-8a81-d78d8332c946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.129103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.129064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-492n5\" (UniqueName: \"kubernetes.io/projected/90104e71-f354-406c-8a81-d78d8332c946-kube-api-access-492n5\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.129288 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.129113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/90104e71-f354-406c-8a81-d78d8332c946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.129288 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.129182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90104e71-f354-406c-8a81-d78d8332c946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.129812 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.129790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90104e71-f354-406c-8a81-d78d8332c946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.131723 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.131700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/90104e71-f354-406c-8a81-d78d8332c946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.137559 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.137542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-492n5\" (UniqueName: \"kubernetes.io/projected/90104e71-f354-406c-8a81-d78d8332c946-kube-api-access-492n5\") pod \"kuadrant-console-plugin-66b5774985-7bkwf\" (UID: \"90104e71-f354-406c-8a81-d78d8332c946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.300627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.300539    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"
Jul 12 15:31:47.437532 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.437502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf"]
Jul 12 15:31:47.439047 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:31:47.439017    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90104e71_f354_406c_8a81_d78d8332c946.slice/crio-3178b20d968142d202fce81819dfd001f349a53def5f5d1e28b2364dcde36972 WatchSource:0}: Error finding container 3178b20d968142d202fce81819dfd001f349a53def5f5d1e28b2364dcde36972: Status 404 returned error can't find the container with id 3178b20d968142d202fce81819dfd001f349a53def5f5d1e28b2364dcde36972
Jul 12 15:31:47.603661 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.603631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9f8jd"
Jul 12 15:31:47.657644 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:47.657605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf" event={"ID":"90104e71-f354-406c-8a81-d78d8332c946","Type":"ContainerStarted","Data":"3178b20d968142d202fce81819dfd001f349a53def5f5d1e28b2364dcde36972"}
Jul 12 15:31:57.310159 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.310111    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"]
Jul 12 15:31:57.310903 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.310487    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" containerName="manager" containerID="cri-o://2626637b406764c2cf7d58cff24adae66c35255e6b9ae0c4e06b9dd9a8872f52" gracePeriod=2
Jul 12 15:31:57.317093 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.317068    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"]
Jul 12 15:31:57.334724 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.334695    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"]
Jul 12 15:31:57.335260 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.335236    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" containerName="manager"
Jul 12 15:31:57.335260 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.335262    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" containerName="manager"
Jul 12 15:31:57.335478 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.335354    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" containerName="manager"
Jul 12 15:31:57.346039 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.345823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:31:57.350443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.350415    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"]
Jul 12 15:31:57.368132 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:31:57.368088    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:31:57.431805 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.431763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9785b\" (UniqueName: \"kubernetes.io/projected/2b2272b2-489a-4401-afdb-0a8e266bf43e-kube-api-access-9785b\") pod \"limitador-operator-controller-manager-859d7b78bd-fr4mb\" (UID: \"2b2272b2-489a-4401-afdb-0a8e266bf43e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:31:57.533316 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.533280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9785b\" (UniqueName: \"kubernetes.io/projected/2b2272b2-489a-4401-afdb-0a8e266bf43e-kube-api-access-9785b\") pod \"limitador-operator-controller-manager-859d7b78bd-fr4mb\" (UID: \"2b2272b2-489a-4401-afdb-0a8e266bf43e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:31:57.542413 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.542364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9785b\" (UniqueName: \"kubernetes.io/projected/2b2272b2-489a-4401-afdb-0a8e266bf43e-kube-api-access-9785b\") pod \"limitador-operator-controller-manager-859d7b78bd-fr4mb\" (UID: \"2b2272b2-489a-4401-afdb-0a8e266bf43e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:31:57.660463 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:31:57.660421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:32:03.686879 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:03.686836    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-97bccb7d5-ksgxr" podUID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" containerName="console" containerID="cri-o://2192d69df2ba47ad604b3da4a17243361b9b10ca4c86b45aff6e18d47db5b80e" gracePeriod=15
Jul 12 15:32:08.802761 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:08.802729    2581 generic.go:356] "Generic (PLEG): container finished" podID="feb08a52-baad-4695-94bf-e5bafbcd77e3" containerID="2626637b406764c2cf7d58cff24adae66c35255e6b9ae0c4e06b9dd9a8872f52" exitCode=0
Jul 12 15:32:08.807944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:08.807776    2581 generic.go:356] "Generic (PLEG): container finished" podID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" containerID="2192d69df2ba47ad604b3da4a17243361b9b10ca4c86b45aff6e18d47db5b80e" exitCode=0
Jul 12 15:32:08.807944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:08.807817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bccb7d5-ksgxr" event={"ID":"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8","Type":"ContainerDied","Data":"2192d69df2ba47ad604b3da4a17243361b9b10ca4c86b45aff6e18d47db5b80e"}
Jul 12 15:32:08.929920 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:08.929899    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:32:08.933194 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:08.933173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:08.951148 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:32:08.951111    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:09.051330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051286    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm965\" (UniqueName: \"kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051677 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051677 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m7qh\" (UniqueName: \"kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh\") pod \"feb08a52-baad-4695-94bf-e5bafbcd77e3\" (UID: \"feb08a52-baad-4695-94bf-e5bafbcd77e3\") "
Jul 12 15:32:09.051677 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051677 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert\") pod \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\" (UID: \"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8\") "
Jul 12 15:32:09.051892 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051746    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:32:09.051892 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051759    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config" (OuterVolumeSpecName: "console-config") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:32:09.052180 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.051971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:32:09.052180 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.052076    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:32:09.053642 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.053616    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:32:09.053761 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.053738    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965" (OuterVolumeSpecName: "kube-api-access-jm965") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "kube-api-access-jm965". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:32:09.054199 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.054179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh" (OuterVolumeSpecName: "kube-api-access-4m7qh") pod "feb08a52-baad-4695-94bf-e5bafbcd77e3" (UID: "feb08a52-baad-4695-94bf-e5bafbcd77e3"). InnerVolumeSpecName "kube-api-access-4m7qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:32:09.054199 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.054187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" (UID: "4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:32:09.129779 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.129757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"]
Jul 12 15:32:09.131755 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:32:09.131728    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2272b2_489a_4401_afdb_0a8e266bf43e.slice/crio-52596095e5cbab937e88c5035e6fef834fa303c8315e9bc329c2695c390c1076 WatchSource:0}: Error finding container 52596095e5cbab937e88c5035e6fef834fa303c8315e9bc329c2695c390c1076: Status 404 returned error can't find the container with id 52596095e5cbab937e88c5035e6fef834fa303c8315e9bc329c2695c390c1076
Jul 12 15:32:09.152482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152458    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-trusted-ca-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152482 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152482    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-oauth-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152493    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-serving-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152501    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm965\" (UniqueName: \"kubernetes.io/projected/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-kube-api-access-jm965\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152510    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152518    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-console-oauth-config\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152526    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.152627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.152534    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m7qh\" (UniqueName: \"kubernetes.io/projected/feb08a52-baad-4695-94bf-e5bafbcd77e3-kube-api-access-4m7qh\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:09.814989 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.814959    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:09.815472 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.815014    2581 scope.go:117] "RemoveContainer" containerID="2626637b406764c2cf7d58cff24adae66c35255e6b9ae0c4e06b9dd9a8872f52"
Jul 12 15:32:09.817089 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.817058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf" event={"ID":"90104e71-f354-406c-8a81-d78d8332c946","Type":"ContainerStarted","Data":"1c772f97f2bdaa4ad707699f991517b9d26fa96d8c5c81e824361680830b1dcc"}
Jul 12 15:32:09.817416 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:32:09.817366    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:09.818766 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.818750    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bccb7d5-ksgxr"
Jul 12 15:32:09.818766 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.818758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bccb7d5-ksgxr" event={"ID":"4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8","Type":"ContainerDied","Data":"6b892a96990db15769f48060160b1fe1cc1addc280f3ca5e4408f13a669e3cc8"}
Jul 12 15:32:09.821063 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.820881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb" event={"ID":"2b2272b2-489a-4401-afdb-0a8e266bf43e","Type":"ContainerStarted","Data":"1f287274d812b5c5ba3650d4b154a642fc4f969d3a7ad960078135096a74c7f7"}
Jul 12 15:32:09.821063 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.820929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb" event={"ID":"2b2272b2-489a-4401-afdb-0a8e266bf43e","Type":"ContainerStarted","Data":"52596095e5cbab937e88c5035e6fef834fa303c8315e9bc329c2695c390c1076"}
Jul 12 15:32:09.821545 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.821528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:32:09.826515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.826500    2581 scope.go:117] "RemoveContainer" containerID="2192d69df2ba47ad604b3da4a17243361b9b10ca4c86b45aff6e18d47db5b80e"
Jul 12 15:32:09.835987 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:32:09.835960    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:09.836286 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.836251    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7bkwf" podStartSLOduration=2.428255153 podStartE2EDuration="23.836238172s" totalImagesPullingTime="21.407983019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:32:09.83391346 +0000 UTC m=+707.533642242" watchObservedRunningTime="2026-07-12 15:32:09.836238172 +0000 UTC m=+707.535966951"
Jul 12 15:32:09.862257 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.862229    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:32:09.866010 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.865982    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97bccb7d5-ksgxr"]
Jul 12 15:32:09.879758 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:09.879706    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb" podStartSLOduration=12.879690030999999 podStartE2EDuration="12.879690031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:32:09.877950486 +0000 UTC m=+707.577679263" watchObservedRunningTime="2026-07-12 15:32:09.879690031 +0000 UTC m=+707.579418810"
Jul 12 15:32:09.880069 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:32:09.880037    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhsnm\" is forbidden: User \"system:node:ip-10-0-128-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-199.ec2.internal' and this object" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhsnm"
Jul 12 15:32:10.846654 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:10.846626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" path="/var/lib/kubelet/pods/4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8/volumes"
Jul 12 15:32:10.847019 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:10.846955    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb08a52-baad-4695-94bf-e5bafbcd77e3" path="/var/lib/kubelet/pods/feb08a52-baad-4695-94bf-e5bafbcd77e3/volumes"
Jul 12 15:32:20.831033 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:20.830954    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fr4mb"
Jul 12 15:32:26.057010 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.056978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"]
Jul 12 15:32:26.057414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.057398    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" containerName="console"
Jul 12 15:32:26.057414 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.057412    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" containerName="console"
Jul 12 15:32:26.057518 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.057506    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6c6424-9d9c-4e2c-8d0c-805b87c6f7f8" containerName="console"
Jul 12 15:32:26.193261 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.193225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"]
Jul 12 15:32:26.193445 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.193327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.195744 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.195728    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fch9b\""
Jul 12 15:32:26.218020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.217987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgz7\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-kube-api-access-chgz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c55df5-8067-42bf-bc79-38b63aa2b082-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218367 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.218367 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.218321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.318969 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.318882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.318969 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.318945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.318979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgz7\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-kube-api-access-chgz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c55df5-8067-42bf-bc79-38b63aa2b082-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319536 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319699 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.319966 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.320048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.319951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c55df5-8067-42bf-bc79-38b63aa2b082-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.321337 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.321314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.321627 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.321607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.326984 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.326964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.327342 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.327305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgz7\" (UniqueName: \"kubernetes.io/projected/22c55df5-8067-42bf-bc79-38b63aa2b082-kube-api-access-chgz7\") pod \"maas-default-gateway-openshift-default-56654dcf7-njqkl\" (UID: \"22c55df5-8067-42bf-bc79-38b63aa2b082\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.503514 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.503481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:26.681315 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.681288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"]
Jul 12 15:32:26.682341 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:32:26.682316    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c55df5_8067_42bf_bc79_38b63aa2b082.slice/crio-bf35338c6b55eef86233a01d498f8ebabfb0735ff25156b14b6a569495a1c015 WatchSource:0}: Error finding container bf35338c6b55eef86233a01d498f8ebabfb0735ff25156b14b6a569495a1c015: Status 404 returned error can't find the container with id bf35338c6b55eef86233a01d498f8ebabfb0735ff25156b14b6a569495a1c015
Jul 12 15:32:26.684606 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.684573    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:32:26.684712 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.684645    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:32:26.684712 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.684688    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:32:26.921613 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.921571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" event={"ID":"22c55df5-8067-42bf-bc79-38b63aa2b082","Type":"ContainerStarted","Data":"394bf020717982799158e1e0c7a8d9a11b6c5217c1083cda3eb0efebc8343063"}
Jul 12 15:32:26.921796 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.921633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" event={"ID":"22c55df5-8067-42bf-bc79-38b63aa2b082","Type":"ContainerStarted","Data":"bf35338c6b55eef86233a01d498f8ebabfb0735ff25156b14b6a569495a1c015"}
Jul 12 15:32:26.942443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:26.942392    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" podStartSLOduration=0.942357449 podStartE2EDuration="942.357449ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:32:26.939163168 +0000 UTC m=+724.638891946" watchObservedRunningTime="2026-07-12 15:32:26.942357449 +0000 UTC m=+724.642086228"
Jul 12 15:32:27.504355 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:27.504315    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:27.509234 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:27.509213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:27.927281 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:27.927241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:27.928319 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:27.928299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:32:39.948830 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:39.948792    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:39.966722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:39.966689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:39.966906 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:39.966812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:39.969117 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:39.969099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 15:32:40.041830 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.041798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:40.043550 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.043527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfl7k\" (UniqueName: \"kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.043697 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.043625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.144649 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.144614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfl7k\" (UniqueName: \"kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.144829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.144683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.145308 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.145289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.152734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.152714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfl7k\" (UniqueName: \"kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k\") pod \"limitador-limitador-64c94fd64f-ms2rj\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.281252 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.281169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:40.422663 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.422640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:40.424799 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:32:40.424772    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e2c99d_4681_4500_a3d1_df687fbe3a2c.slice/crio-6b6534049e9d8c240d87b64b7948976c1a80e071e5a6fffc6613ef1cc64b9252 WatchSource:0}: Error finding container 6b6534049e9d8c240d87b64b7948976c1a80e071e5a6fffc6613ef1cc64b9252: Status 404 returned error can't find the container with id 6b6534049e9d8c240d87b64b7948976c1a80e071e5a6fffc6613ef1cc64b9252
Jul 12 15:32:40.816320 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.816284    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:32:40.845679 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.845636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:32:40.845849 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.845739    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:32:40.848588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.848533    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5vnbc\""
Jul 12 15:32:40.952291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:40.952254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46j2d\" (UniqueName: \"kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d\") pod \"authorino-75d556bd77-z6rlv\" (UID: \"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd\") " pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:32:41.003977 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:41.003942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" event={"ID":"07e2c99d-4681-4500-a3d1-df687fbe3a2c","Type":"ContainerStarted","Data":"6b6534049e9d8c240d87b64b7948976c1a80e071e5a6fffc6613ef1cc64b9252"}
Jul 12 15:32:41.053274 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:41.053229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46j2d\" (UniqueName: \"kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d\") pod \"authorino-75d556bd77-z6rlv\" (UID: \"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd\") " pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:32:41.061500 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:41.061475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46j2d\" (UniqueName: \"kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d\") pod \"authorino-75d556bd77-z6rlv\" (UID: \"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd\") " pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:32:41.157153 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:41.157119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:32:41.349068 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:41.349036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:32:41.356304 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:32:41.356029    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d1d495_b9cc_48e1_a754_0c7b8b00c0bd.slice/crio-e1e808646dfa13f99cd9b9d72d8793515b6ffa0ba4cf24bcbaac7369e3ac7a3f WatchSource:0}: Error finding container e1e808646dfa13f99cd9b9d72d8793515b6ffa0ba4cf24bcbaac7369e3ac7a3f: Status 404 returned error can't find the container with id e1e808646dfa13f99cd9b9d72d8793515b6ffa0ba4cf24bcbaac7369e3ac7a3f
Jul 12 15:32:42.017138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:42.017070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z6rlv" event={"ID":"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd","Type":"ContainerStarted","Data":"e1e808646dfa13f99cd9b9d72d8793515b6ffa0ba4cf24bcbaac7369e3ac7a3f"}
Jul 12 15:32:46.043883 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:46.043842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" event={"ID":"07e2c99d-4681-4500-a3d1-df687fbe3a2c","Type":"ContainerStarted","Data":"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"}
Jul 12 15:32:46.044427 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:46.043923    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:46.045423 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:46.045373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z6rlv" event={"ID":"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd","Type":"ContainerStarted","Data":"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"}
Jul 12 15:32:46.059731 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:46.059691    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" podStartSLOduration=2.258046422 podStartE2EDuration="7.059675722s" totalImagesPullingTime="4.8016293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:32:46.057972351 +0000 UTC m=+743.757701130" watchObservedRunningTime="2026-07-12 15:32:46.059675722 +0000 UTC m=+743.759404500"
Jul 12 15:32:46.072724 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:46.072678    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z6rlv" podStartSLOduration=2.200823138 podStartE2EDuration="6.072663588s" totalImagesPullingTime="3.87184045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:32:46.070865616 +0000 UTC m=+743.770594396" watchObservedRunningTime="2026-07-12 15:32:46.072663588 +0000 UTC m=+743.772392366"
Jul 12 15:32:54.793598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:54.793565    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:54.794109 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:54.793787    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" podUID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" containerName="limitador" containerID="cri-o://416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7" gracePeriod=30
Jul 12 15:32:54.795412 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:54.795353    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:55.352746 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.352723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:55.502173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.502087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file\") pod \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") "
Jul 12 15:32:55.502341 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.502184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfl7k\" (UniqueName: \"kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k\") pod \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\" (UID: \"07e2c99d-4681-4500-a3d1-df687fbe3a2c\") "
Jul 12 15:32:55.502709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.502688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file" (OuterVolumeSpecName: "config-file") pod "07e2c99d-4681-4500-a3d1-df687fbe3a2c" (UID: "07e2c99d-4681-4500-a3d1-df687fbe3a2c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:32:55.504393 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.504354    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k" (OuterVolumeSpecName: "kube-api-access-jfl7k") pod "07e2c99d-4681-4500-a3d1-df687fbe3a2c" (UID: "07e2c99d-4681-4500-a3d1-df687fbe3a2c"). InnerVolumeSpecName "kube-api-access-jfl7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:32:55.603667 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.603631    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfl7k\" (UniqueName: \"kubernetes.io/projected/07e2c99d-4681-4500-a3d1-df687fbe3a2c-kube-api-access-jfl7k\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:55.603667 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:55.603660    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e2c99d-4681-4500-a3d1-df687fbe3a2c-config-file\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:32:56.104852 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.104813    2581 generic.go:356] "Generic (PLEG): container finished" podID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" containerID="416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7" exitCode=0
Jul 12 15:32:56.104852 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.104857    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"
Jul 12 15:32:56.105366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.104904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" event={"ID":"07e2c99d-4681-4500-a3d1-df687fbe3a2c","Type":"ContainerDied","Data":"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"}
Jul 12 15:32:56.105366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.104970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ms2rj" event={"ID":"07e2c99d-4681-4500-a3d1-df687fbe3a2c","Type":"ContainerDied","Data":"6b6534049e9d8c240d87b64b7948976c1a80e071e5a6fffc6613ef1cc64b9252"}
Jul 12 15:32:56.105366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.105004    2581 scope.go:117] "RemoveContainer" containerID="416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"
Jul 12 15:32:56.113995 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.113975    2581 scope.go:117] "RemoveContainer" containerID="416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"
Jul 12 15:32:56.114267 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:32:56.114248    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7\": container with ID starting with 416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7 not found: ID does not exist" containerID="416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"
Jul 12 15:32:56.114321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.114277    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7"} err="failed to get container status \"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7\": rpc error: code = NotFound desc = could not find container \"416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7\": container with ID starting with 416d8a660b714e3698ba57f24c85643aa20f5f31cbb24db3febd7c92790256a7 not found: ID does not exist"
Jul 12 15:32:56.129197 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.129171    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:56.132905 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.132884    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ms2rj"]
Jul 12 15:32:56.847540 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:32:56.847507    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" path="/var/lib/kubelet/pods/07e2c99d-4681-4500-a3d1-df687fbe3a2c/volumes"
Jul 12 15:33:12.612467 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.612411    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:12.613443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.613411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" containerName="limitador"
Jul 12 15:33:12.613443 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.613434    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" containerName="limitador"
Jul 12 15:33:12.613707 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.613685    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e2c99d-4681-4500-a3d1-df687fbe3a2c" containerName="limitador"
Jul 12 15:33:12.617898 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.617868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:12.622779 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.622756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:12.672623 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.672588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw2wx\" (UniqueName: \"kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx\") pod \"authorino-5d4b67c446-bz7dn\" (UID: \"664c7e41-3337-4a09-b2d8-0ca7bae416f3\") " pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:12.773699 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.773665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw2wx\" (UniqueName: \"kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx\") pod \"authorino-5d4b67c446-bz7dn\" (UID: \"664c7e41-3337-4a09-b2d8-0ca7bae416f3\") " pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:12.782420 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.782368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw2wx\" (UniqueName: \"kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx\") pod \"authorino-5d4b67c446-bz7dn\" (UID: \"664c7e41-3337-4a09-b2d8-0ca7bae416f3\") " pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:12.831333 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.831298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:12.831619 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.831607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:12.976817 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:12.976794    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:12.978696 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:33:12.978666    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod664c7e41_3337_4a09_b2d8_0ca7bae416f3.slice/crio-6470af31c31d31f8e67f17a997c84c6e07ab6484adbe47050518401f9db9967c WatchSource:0}: Error finding container 6470af31c31d31f8e67f17a997c84c6e07ab6484adbe47050518401f9db9967c: Status 404 returned error can't find the container with id 6470af31c31d31f8e67f17a997c84c6e07ab6484adbe47050518401f9db9967c
Jul 12 15:33:13.204231 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:13.204149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" event={"ID":"664c7e41-3337-4a09-b2d8-0ca7bae416f3","Type":"ContainerStarted","Data":"6470af31c31d31f8e67f17a997c84c6e07ab6484adbe47050518401f9db9967c"}
Jul 12 15:33:14.116149 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.116116    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:33:14.116634 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.116310    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z6rlv" podUID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" containerName="authorino" containerID="cri-o://a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612" gracePeriod=30
Jul 12 15:33:14.212135 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.212102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" event={"ID":"664c7e41-3337-4a09-b2d8-0ca7bae416f3","Type":"ContainerStarted","Data":"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"}
Jul 12 15:33:14.212309 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.212148    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" podUID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" containerName="authorino" containerID="cri-o://80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e" gracePeriod=30
Jul 12 15:33:14.229462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.229414    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" podStartSLOduration=1.908497423 podStartE2EDuration="2.229391429s" totalImagesPullingTime="320.894006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:14.227038398 +0000 UTC m=+771.926767176" watchObservedRunningTime="2026-07-12 15:33:14.229391429 +0000 UTC m=+771.929120207"
Jul 12 15:33:14.383730 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.383699    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:33:14.489241 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.489217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46j2d\" (UniqueName: \"kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d\") pod \"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd\" (UID: \"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd\") "
Jul 12 15:33:14.491317 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.491289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d" (OuterVolumeSpecName: "kube-api-access-46j2d") pod "62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" (UID: "62d1d495-b9cc-48e1-a754-0c7b8b00c0bd"). InnerVolumeSpecName "kube-api-access-46j2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:33:14.502428 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.502372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:14.590442 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.590408    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw2wx\" (UniqueName: \"kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx\") pod \"664c7e41-3337-4a09-b2d8-0ca7bae416f3\" (UID: \"664c7e41-3337-4a09-b2d8-0ca7bae416f3\") "
Jul 12 15:33:14.590632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.590619    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46j2d\" (UniqueName: \"kubernetes.io/projected/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd-kube-api-access-46j2d\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:33:14.592572 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.592542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx" (OuterVolumeSpecName: "kube-api-access-rw2wx") pod "664c7e41-3337-4a09-b2d8-0ca7bae416f3" (UID: "664c7e41-3337-4a09-b2d8-0ca7bae416f3"). InnerVolumeSpecName "kube-api-access-rw2wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:33:14.691180 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:14.691100    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw2wx\" (UniqueName: \"kubernetes.io/projected/664c7e41-3337-4a09-b2d8-0ca7bae416f3-kube-api-access-rw2wx\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:33:15.220588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.220545    2581 generic.go:356] "Generic (PLEG): container finished" podID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" containerID="a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612" exitCode=0
Jul 12 15:33:15.221052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.220706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z6rlv" event={"ID":"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd","Type":"ContainerDied","Data":"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"}
Jul 12 15:33:15.221052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.220747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z6rlv" event={"ID":"62d1d495-b9cc-48e1-a754-0c7b8b00c0bd","Type":"ContainerDied","Data":"e1e808646dfa13f99cd9b9d72d8793515b6ffa0ba4cf24bcbaac7369e3ac7a3f"}
Jul 12 15:33:15.221052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.220781    2581 scope.go:117] "RemoveContainer" containerID="a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"
Jul 12 15:33:15.221052 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.220973    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z6rlv"
Jul 12 15:33:15.227715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.227677    2581 generic.go:356] "Generic (PLEG): container finished" podID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" containerID="80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e" exitCode=0
Jul 12 15:33:15.227820 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.227780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" event={"ID":"664c7e41-3337-4a09-b2d8-0ca7bae416f3","Type":"ContainerDied","Data":"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"}
Jul 12 15:33:15.227820 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.227784    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bz7dn"
Jul 12 15:33:15.227820 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.227810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bz7dn" event={"ID":"664c7e41-3337-4a09-b2d8-0ca7bae416f3","Type":"ContainerDied","Data":"6470af31c31d31f8e67f17a997c84c6e07ab6484adbe47050518401f9db9967c"}
Jul 12 15:33:15.236233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.236208    2581 scope.go:117] "RemoveContainer" containerID="a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"
Jul 12 15:33:15.236580 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:33:15.236558    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612\": container with ID starting with a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612 not found: ID does not exist" containerID="a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"
Jul 12 15:33:15.236648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.236590    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612"} err="failed to get container status \"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612\": rpc error: code = NotFound desc = could not find container \"a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612\": container with ID starting with a5af37058ac602b155b3740cb2b736f0d7f9c7e00057c5c619973ca1e03ec612 not found: ID does not exist"
Jul 12 15:33:15.236648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.236608    2581 scope.go:117] "RemoveContainer" containerID="80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"
Jul 12 15:33:15.242477 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.242439    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:33:15.246117 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.246092    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z6rlv"]
Jul 12 15:33:15.246914 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.246898    2581 scope.go:117] "RemoveContainer" containerID="80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"
Jul 12 15:33:15.247200 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:33:15.247181    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e\": container with ID starting with 80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e not found: ID does not exist" containerID="80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"
Jul 12 15:33:15.247271 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.247205    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e"} err="failed to get container status \"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e\": rpc error: code = NotFound desc = could not find container \"80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e\": container with ID starting with 80f11c13ac284037653928f4519d724a00763811084c3c0d8f40d5e302a1705e not found: ID does not exist"
Jul 12 15:33:15.259674 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.259648    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:15.265174 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:15.265152    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bz7dn"]
Jul 12 15:33:16.847665 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:16.847632    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" path="/var/lib/kubelet/pods/62d1d495-b9cc-48e1-a754-0c7b8b00c0bd/volumes"
Jul 12 15:33:16.848108 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:16.847948    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" path="/var/lib/kubelet/pods/664c7e41-3337-4a09-b2d8-0ca7bae416f3/volumes"
Jul 12 15:33:18.291030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.290999    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:18.291469 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291455    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" containerName="authorino"
Jul 12 15:33:18.291520 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291470    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" containerName="authorino"
Jul 12 15:33:18.291520 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291482    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" containerName="authorino"
Jul 12 15:33:18.291520 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291488    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" containerName="authorino"
Jul 12 15:33:18.291613 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291553    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d1d495-b9cc-48e1-a754-0c7b8b00c0bd" containerName="authorino"
Jul 12 15:33:18.291613 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.291564    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="664c7e41-3337-4a09-b2d8-0ca7bae416f3" containerName="authorino"
Jul 12 15:33:18.294827 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.294811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.297476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.297452    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 15:33:18.297610 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.297592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rj6cr\""
Jul 12 15:33:18.297658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.297594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 15:33:18.308144 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.308119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:18.424648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.424599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgxr8\" (UniqueName: \"kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.424846 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.424671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.489232 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.489196    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:33:18.495832 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.495806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.503520 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.503496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:33:18.525626 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.525599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgxr8\" (UniqueName: \"kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.525796 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.525661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.528084 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.528057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.534125 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.534105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgxr8\" (UniqueName: \"kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8\") pod \"maas-controller-694b65dcf4-drg2h\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") " pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.605519 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.605493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:18.626967 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.626936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.627136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.626997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj6h2\" (UniqueName: \"kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.727904 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.727873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.727904 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.727917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj6h2\" (UniqueName: \"kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.730612 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.730589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.738412 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.738358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj6h2\" (UniqueName: \"kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2\") pod \"maas-controller-5557ccbdc6-lbs27\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") " pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.751456 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.751434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:18.752962 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:33:18.752939    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72720f57_43fd_4676_9ba8_73b744a660ee.slice/crio-05cdfe5bea4a2ab9cdb7556ca3239385e0cbb5c21f79c986a690f8b37c86c04d WatchSource:0}: Error finding container 05cdfe5bea4a2ab9cdb7556ca3239385e0cbb5c21f79c986a690f8b37c86c04d: Status 404 returned error can't find the container with id 05cdfe5bea4a2ab9cdb7556ca3239385e0cbb5c21f79c986a690f8b37c86c04d
Jul 12 15:33:18.807648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.807617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:18.987035 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:18.987012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:33:18.988191 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:33:18.988161    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef943bc3_1474_47ef_8319_bf8cce38a040.slice/crio-77142dace8160931ad8bc9e2e157dff64fb0f054fcbc1a02b2fb6bdb09342c7b WatchSource:0}: Error finding container 77142dace8160931ad8bc9e2e157dff64fb0f054fcbc1a02b2fb6bdb09342c7b: Status 404 returned error can't find the container with id 77142dace8160931ad8bc9e2e157dff64fb0f054fcbc1a02b2fb6bdb09342c7b
Jul 12 15:33:19.254867 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:19.254774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-drg2h" event={"ID":"72720f57-43fd-4676-9ba8-73b744a660ee","Type":"ContainerStarted","Data":"05cdfe5bea4a2ab9cdb7556ca3239385e0cbb5c21f79c986a690f8b37c86c04d"}
Jul 12 15:33:19.255903 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:19.255878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" event={"ID":"ef943bc3-1474-47ef-8319-bf8cce38a040","Type":"ContainerStarted","Data":"77142dace8160931ad8bc9e2e157dff64fb0f054fcbc1a02b2fb6bdb09342c7b"}
Jul 12 15:33:21.271835 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:21.271706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-drg2h" event={"ID":"72720f57-43fd-4676-9ba8-73b744a660ee","Type":"ContainerStarted","Data":"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"}
Jul 12 15:33:21.272360 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:21.272013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:21.273330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:21.273239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" event={"ID":"ef943bc3-1474-47ef-8319-bf8cce38a040","Type":"ContainerStarted","Data":"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"}
Jul 12 15:33:21.273510 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:21.273367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:21.307054 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:21.307002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-694b65dcf4-drg2h" podStartSLOduration=1.258927345 podStartE2EDuration="3.306986893s" totalImagesPullingTime="2.048059548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:21.306015782 +0000 UTC m=+779.005744563" watchObservedRunningTime="2026-07-12 15:33:21.306986893 +0000 UTC m=+779.006715671"
Jul 12 15:33:32.283911 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.283871    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:33:32.284304 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.284172    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:32.304287 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.304242    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" podStartSLOduration=12.486196148 podStartE2EDuration="14.304229022s" totalImagesPullingTime="1.818032874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:21.354072227 +0000 UTC m=+779.053801007" watchObservedRunningTime="2026-07-12 15:33:32.304229022 +0000 UTC m=+790.003957802"
Jul 12 15:33:32.355250 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.355221    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:32.355470 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.355431    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-694b65dcf4-drg2h" podUID="72720f57-43fd-4676-9ba8-73b744a660ee" containerName="manager" containerID="cri-o://a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc" gracePeriod=30
Jul 12 15:33:32.607624 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.607599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:32.775071 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.775031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgxr8\" (UniqueName: \"kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8\") pod \"72720f57-43fd-4676-9ba8-73b744a660ee\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") "
Jul 12 15:33:32.775240 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.775146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert\") pod \"72720f57-43fd-4676-9ba8-73b744a660ee\" (UID: \"72720f57-43fd-4676-9ba8-73b744a660ee\") "
Jul 12 15:33:32.777543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.777516    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8" (OuterVolumeSpecName: "kube-api-access-cgxr8") pod "72720f57-43fd-4676-9ba8-73b744a660ee" (UID: "72720f57-43fd-4676-9ba8-73b744a660ee"). InnerVolumeSpecName "kube-api-access-cgxr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:33:32.777632 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.777541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "72720f57-43fd-4676-9ba8-73b744a660ee" (UID: "72720f57-43fd-4676-9ba8-73b744a660ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:33:32.875887 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.875862    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72720f57-43fd-4676-9ba8-73b744a660ee-webhook-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:33:32.875887 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:32.875887    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgxr8\" (UniqueName: \"kubernetes.io/projected/72720f57-43fd-4676-9ba8-73b744a660ee-kube-api-access-cgxr8\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:33:33.342709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.342582    2581 generic.go:356] "Generic (PLEG): container finished" podID="72720f57-43fd-4676-9ba8-73b744a660ee" containerID="a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc" exitCode=0
Jul 12 15:33:33.342709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.342625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694b65dcf4-drg2h"
Jul 12 15:33:33.342709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.342635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-drg2h" event={"ID":"72720f57-43fd-4676-9ba8-73b744a660ee","Type":"ContainerDied","Data":"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"}
Jul 12 15:33:33.343202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.342713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694b65dcf4-drg2h" event={"ID":"72720f57-43fd-4676-9ba8-73b744a660ee","Type":"ContainerDied","Data":"05cdfe5bea4a2ab9cdb7556ca3239385e0cbb5c21f79c986a690f8b37c86c04d"}
Jul 12 15:33:33.343202 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.342743    2581 scope.go:117] "RemoveContainer" containerID="a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"
Jul 12 15:33:33.352021 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.352003    2581 scope.go:117] "RemoveContainer" containerID="a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"
Jul 12 15:33:33.352306 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:33:33.352287    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc\": container with ID starting with a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc not found: ID does not exist" containerID="a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"
Jul 12 15:33:33.352366 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.352316    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc"} err="failed to get container status \"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc\": rpc error: code = NotFound desc = could not find container \"a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc\": container with ID starting with a570fe1d4933cad2cd443e30f2e6c8416c7e6621fe81b67385eddbb68a118cfc not found: ID does not exist"
Jul 12 15:33:33.361269 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.361247    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:33.364973 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:33.364950    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-694b65dcf4-drg2h"]
Jul 12 15:33:34.847330 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:34.847288    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72720f57-43fd-4676-9ba8-73b744a660ee" path="/var/lib/kubelet/pods/72720f57-43fd-4676-9ba8-73b744a660ee/volumes"
Jul 12 15:33:50.692306 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.692226    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b9df6c7bd-684qd"]
Jul 12 15:33:50.692914 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.692893    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72720f57-43fd-4676-9ba8-73b744a660ee" containerName="manager"
Jul 12 15:33:50.693000 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.692916    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72720f57-43fd-4676-9ba8-73b744a660ee" containerName="manager"
Jul 12 15:33:50.693054 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.693017    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72720f57-43fd-4676-9ba8-73b744a660ee" containerName="manager"
Jul 12 15:33:50.696137 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.696116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.700728 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.700704    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 12 15:33:50.700844 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.700727    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mc8ms\""
Jul 12 15:33:50.708257 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.708235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b9df6c7bd-684qd"]
Jul 12 15:33:50.739604 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.739574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mhlt\" (UniqueName: \"kubernetes.io/projected/fd2f5e2f-da10-4b34-8b48-3ba24127d826-kube-api-access-2mhlt\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.739604 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.739615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2f5e2f-da10-4b34-8b48-3ba24127d826-openshift-service-ca\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.739812 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.739731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd2f5e2f-da10-4b34-8b48-3ba24127d826-maas-api-tls\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.841174 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.841143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mhlt\" (UniqueName: \"kubernetes.io/projected/fd2f5e2f-da10-4b34-8b48-3ba24127d826-kube-api-access-2mhlt\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.841174 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.841180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2f5e2f-da10-4b34-8b48-3ba24127d826-openshift-service-ca\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.841448 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.841232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd2f5e2f-da10-4b34-8b48-3ba24127d826-maas-api-tls\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.841980 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.841953    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd2f5e2f-da10-4b34-8b48-3ba24127d826-openshift-service-ca\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.843974 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.843955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd2f5e2f-da10-4b34-8b48-3ba24127d826-maas-api-tls\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:50.852300 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:50.852279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mhlt\" (UniqueName: \"kubernetes.io/projected/fd2f5e2f-da10-4b34-8b48-3ba24127d826-kube-api-access-2mhlt\") pod \"maas-api-6b9df6c7bd-684qd\" (UID: \"fd2f5e2f-da10-4b34-8b48-3ba24127d826\") " pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:51.007539 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.007454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:51.170439 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.170393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b9df6c7bd-684qd"]
Jul 12 15:33:51.405392 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.405349    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2vrw7"]
Jul 12 15:33:51.420054 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.420030    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2vrw7"]
Jul 12 15:33:51.420212 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.420134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.423167 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.423144    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 12 15:33:51.423167 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.423155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vn27s\""
Jul 12 15:33:51.446146 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.446115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b9df6c7bd-684qd" event={"ID":"fd2f5e2f-da10-4b34-8b48-3ba24127d826","Type":"ContainerStarted","Data":"46a192bd4b29cc58c027fa1409b275c61b922f4863ddf68537c8d2a492eb1930"}
Jul 12 15:33:51.450864 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.450840    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hxqnj"]
Jul 12 15:33:51.453420 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.453400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.464921 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.464897    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hxqnj"]
Jul 12 15:33:51.549142 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.549112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvd5\" (UniqueName: \"kubernetes.io/projected/9e7d62be-9f0c-49f1-a061-e95428610ab5-kube-api-access-bhvd5\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.549328 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.549155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbmg\" (UniqueName: \"kubernetes.io/projected/e49d243b-6e2c-4c0e-aa46-973d1f241a73-kube-api-access-qpbmg\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.549328 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.549176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e7d62be-9f0c-49f1-a061-e95428610ab5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.549328 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.549254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e49d243b-6e2c-4c0e-aa46-973d1f241a73-plugins-config-volume\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.650497 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.650454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvd5\" (UniqueName: \"kubernetes.io/projected/9e7d62be-9f0c-49f1-a061-e95428610ab5-kube-api-access-bhvd5\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.650703 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.650512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbmg\" (UniqueName: \"kubernetes.io/projected/e49d243b-6e2c-4c0e-aa46-973d1f241a73-kube-api-access-qpbmg\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.650703 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.650540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e7d62be-9f0c-49f1-a061-e95428610ab5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.650703 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.650573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e49d243b-6e2c-4c0e-aa46-973d1f241a73-plugins-config-volume\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.651331 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.651306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e49d243b-6e2c-4c0e-aa46-973d1f241a73-plugins-config-volume\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.651462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.651306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e7d62be-9f0c-49f1-a061-e95428610ab5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.659934 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.659881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvd5\" (UniqueName: \"kubernetes.io/projected/9e7d62be-9f0c-49f1-a061-e95428610ab5-kube-api-access-bhvd5\") pod \"payload-pre-processing-7964457696-hxqnj\" (UID: \"9e7d62be-9f0c-49f1-a061-e95428610ab5\") " pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.660806 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.660790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbmg\" (UniqueName: \"kubernetes.io/projected/e49d243b-6e2c-4c0e-aa46-973d1f241a73-kube-api-access-qpbmg\") pod \"payload-processing-58f86c7798-2vrw7\" (UID: \"e49d243b-6e2c-4c0e-aa46-973d1f241a73\") " pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.734578 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.734544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:51.764655 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.764570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:51.916114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.916090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2vrw7"]
Jul 12 15:33:51.917752 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:33:51.917721    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49d243b_6e2c_4c0e_aa46_973d1f241a73.slice/crio-b7e0c63a0035d6bee29d145a8426f24c92f49f84b536794c007e9c8494415c9b WatchSource:0}: Error finding container b7e0c63a0035d6bee29d145a8426f24c92f49f84b536794c007e9c8494415c9b: Status 404 returned error can't find the container with id b7e0c63a0035d6bee29d145a8426f24c92f49f84b536794c007e9c8494415c9b
Jul 12 15:33:51.951919 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:51.951869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hxqnj"]
Jul 12 15:33:51.954845 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:33:51.954820    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7d62be_9f0c_49f1_a061_e95428610ab5.slice/crio-2b0d347d58e904fac488d12219d3e6230fee1f2cc353289722c227a0bd8dafc6 WatchSource:0}: Error finding container 2b0d347d58e904fac488d12219d3e6230fee1f2cc353289722c227a0bd8dafc6: Status 404 returned error can't find the container with id 2b0d347d58e904fac488d12219d3e6230fee1f2cc353289722c227a0bd8dafc6
Jul 12 15:33:52.468516 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:52.468482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj" event={"ID":"9e7d62be-9f0c-49f1-a061-e95428610ab5","Type":"ContainerStarted","Data":"2b0d347d58e904fac488d12219d3e6230fee1f2cc353289722c227a0bd8dafc6"}
Jul 12 15:33:52.469896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:52.469868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7" event={"ID":"e49d243b-6e2c-4c0e-aa46-973d1f241a73","Type":"ContainerStarted","Data":"b7e0c63a0035d6bee29d145a8426f24c92f49f84b536794c007e9c8494415c9b"}
Jul 12 15:33:53.479038 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:53.478952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b9df6c7bd-684qd" event={"ID":"fd2f5e2f-da10-4b34-8b48-3ba24127d826","Type":"ContainerStarted","Data":"7b8df0c41d2eae563d60d738b68f7d67fd60eb22dace8bc0e04a6970aa5e535b"}
Jul 12 15:33:53.479555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:53.479082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:53.501688 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:53.501636    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6b9df6c7bd-684qd" podStartSLOduration=1.855208419 podStartE2EDuration="3.50161977s" totalImagesPullingTime="1.646411351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:53.498202949 +0000 UTC m=+811.197931730" watchObservedRunningTime="2026-07-12 15:33:53.50161977 +0000 UTC m=+811.201348548"
Jul 12 15:33:54.486696 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.486658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7" event={"ID":"e49d243b-6e2c-4c0e-aa46-973d1f241a73","Type":"ContainerStarted","Data":"918f2fabd94628d184cbb5ebe81cdafd65dac18ea9074a92c2f9006dad81425b"}
Jul 12 15:33:54.487138 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.486733    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:33:54.488197 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.488173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj" event={"ID":"9e7d62be-9f0c-49f1-a061-e95428610ab5","Type":"ContainerStarted","Data":"8c10da605f497a0f188501e58af1d178e7f6bbdfc36124e0c3461bf9015dc3b3"}
Jul 12 15:33:54.488356 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.488338    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:33:54.505028 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.504986    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7" podStartSLOduration=1.4609577169999999 podStartE2EDuration="3.504970521s" totalImagesPullingTime="2.044012804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:54.502493069 +0000 UTC m=+812.202221850" watchObservedRunningTime="2026-07-12 15:33:54.504970521 +0000 UTC m=+812.204699354"
Jul 12 15:33:54.518843 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:54.518804    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj" podStartSLOduration=1.50904814 podStartE2EDuration="3.518789162s" totalImagesPullingTime="2.009741022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:33:54.517488731 +0000 UTC m=+812.217217511" watchObservedRunningTime="2026-07-12 15:33:54.518789162 +0000 UTC m=+812.218517940"
Jul 12 15:33:58.968550 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:58.968513    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njqkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 12 15:33:58.968944 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:58.968576    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" podUID="22c55df5-8067-42bf-bc79-38b63aa2b082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 12 15:33:59.494020 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.493989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b9df6c7bd-684qd"
Jul 12 15:33:59.520829 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.520790    2581 generic.go:356] "Generic (PLEG): container finished" podID="22c55df5-8067-42bf-bc79-38b63aa2b082" containerID="394bf020717982799158e1e0c7a8d9a11b6c5217c1083cda3eb0efebc8343063" exitCode=0
Jul 12 15:33:59.521017 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.520839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" event={"ID":"22c55df5-8067-42bf-bc79-38b63aa2b082","Type":"ContainerDied","Data":"394bf020717982799158e1e0c7a8d9a11b6c5217c1083cda3eb0efebc8343063"}
Jul 12 15:33:59.521322 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.521305    2581 scope.go:117] "RemoveContainer" containerID="394bf020717982799158e1e0c7a8d9a11b6c5217c1083cda3eb0efebc8343063"
Jul 12 15:33:59.522486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.522450    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:33:59.522560 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.522527    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:33:59.522615 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:33:59.522566    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 12 15:34:00.528129 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:00.528097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" event={"ID":"22c55df5-8067-42bf-bc79-38b63aa2b082","Type":"ContainerStarted","Data":"efbc16a1345f5dc8573cffbbdd5a6a54bf5ec01eb6990a3d0c8d30786358dd87"}
Jul 12 15:34:01.504092 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:01.504056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:34:01.504274 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:01.504214    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 12 15:34:01.504323 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:01.504267    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" podUID="22c55df5-8067-42bf-bc79-38b63aa2b082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 12 15:34:02.504671 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:02.504633    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 12 15:34:02.505080 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:02.504691    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" podUID="22c55df5-8067-42bf-bc79-38b63aa2b082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 12 15:34:03.504500 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:03.504453    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 12 15:34:03.504686 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:03.504520    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl" podUID="22c55df5-8067-42bf-bc79-38b63aa2b082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 12 15:34:04.513907 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:04.513874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:34:04.514285 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:04.514235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:34:04.514840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:04.514825    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njqkl"
Jul 12 15:34:05.496594 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:05.496562    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-2vrw7"
Jul 12 15:34:05.496811 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:05.496780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-hxqnj"
Jul 12 15:34:08.909982 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.909939    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"]
Jul 12 15:34:08.916537 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.916507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:08.920216 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.920191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nqvwk\""
Jul 12 15:34:08.920216 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.920205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 12 15:34:08.920552 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.920519    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 15:34:08.920641 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.920590    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 15:34:08.922219 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:08.922198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"]
Jul 12 15:34:09.032524 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c520d855-9797-414e-9362-973e0eaad406-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.032734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.032734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.032734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.032734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pnn\" (UniqueName: \"kubernetes.io/projected/c520d855-9797-414e-9362-973e0eaad406-kube-api-access-56pnn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.032734 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.032679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.133658 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c520d855-9797-414e-9362-973e0eaad406-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.133840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.133840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.133840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.134012 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pnn\" (UniqueName: \"kubernetes.io/projected/c520d855-9797-414e-9362-973e0eaad406-kube-api-access-56pnn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.134012 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.133967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.134121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.134023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.134121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.134089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.134267 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.134249    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.136134 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.136111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c520d855-9797-414e-9362-973e0eaad406-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.136685 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.136666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c520d855-9797-414e-9362-973e0eaad406-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.142337 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.142316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pnn\" (UniqueName: \"kubernetes.io/projected/c520d855-9797-414e-9362-973e0eaad406-kube-api-access-56pnn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv\" (UID: \"c520d855-9797-414e-9362-973e0eaad406\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.228913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.228812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:09.401765 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.401739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"]
Jul 12 15:34:09.403838 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:34:09.403811    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc520d855_9797_414e_9362_973e0eaad406.slice/crio-bdd2a6a7142ad032b29fb2feb9835032be6626728728f279482cab4ec090f959 WatchSource:0}: Error finding container bdd2a6a7142ad032b29fb2feb9835032be6626728728f279482cab4ec090f959: Status 404 returned error can't find the container with id bdd2a6a7142ad032b29fb2feb9835032be6626728728f279482cab4ec090f959
Jul 12 15:34:09.586182 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:09.586087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv" event={"ID":"c520d855-9797-414e-9362-973e0eaad406","Type":"ContainerStarted","Data":"bdd2a6a7142ad032b29fb2feb9835032be6626728728f279482cab4ec090f959"}
Jul 12 15:34:10.594147 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:10.594111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv" event={"ID":"c520d855-9797-414e-9362-973e0eaad406","Type":"ContainerStarted","Data":"f80ef7d1930036f2eb6c09e1e8f71ebe12cc0ed85ea53b6378068bdcb28bed6a"}
Jul 12 15:34:10.614778 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:10.614729    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv" podStartSLOduration=1.532845834 podStartE2EDuration="2.614710839s" totalImagesPullingTime="1.081865005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:34:10.613127756 +0000 UTC m=+828.312856537" watchObservedRunningTime="2026-07-12 15:34:10.614710839 +0000 UTC m=+828.314439656"
Jul 12 15:34:19.229248 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:19.229209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:19.229798 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:19.229287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:19.241590 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:19.241569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:19.659332 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:19.659302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv"
Jul 12 15:34:32.299947 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.299911    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"]
Jul 12 15:34:32.303743 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.303726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.307156 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.307136    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 15:34:32.311769 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.311745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"]
Jul 12 15:34:32.352275 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.352475 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.352475 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.352475 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.352585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d8zv\" (UniqueName: \"kubernetes.io/projected/79adb24e-cab8-4054-b2e4-4165f2af10ff-kube-api-access-6d8zv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.352585 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.352505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79adb24e-cab8-4054-b2e4-4165f2af10ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453397 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453569 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453569 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d8zv\" (UniqueName: \"kubernetes.io/projected/79adb24e-cab8-4054-b2e4-4165f2af10ff-kube-api-access-6d8zv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453569 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79adb24e-cab8-4054-b2e4-4165f2af10ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453756 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453756 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.453913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.454276 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.453962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.455729 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.455710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79adb24e-cab8-4054-b2e4-4165f2af10ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.455988 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.455970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79adb24e-cab8-4054-b2e4-4165f2af10ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.463206 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.463173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d8zv\" (UniqueName: \"kubernetes.io/projected/79adb24e-cab8-4054-b2e4-4165f2af10ff-kube-api-access-6d8zv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-96gqf\" (UID: \"79adb24e-cab8-4054-b2e4-4165f2af10ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.615868 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.615828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:32.762741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:32.762697    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"]
Jul 12 15:34:32.763680 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:34:32.763653    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79adb24e_cab8_4054_b2e4_4165f2af10ff.slice/crio-6fdf5c61f2e8d01a0675f4100a6bf5a48a9af951c5ba39b043ae70bb378b28d9 WatchSource:0}: Error finding container 6fdf5c61f2e8d01a0675f4100a6bf5a48a9af951c5ba39b043ae70bb378b28d9: Status 404 returned error can't find the container with id 6fdf5c61f2e8d01a0675f4100a6bf5a48a9af951c5ba39b043ae70bb378b28d9
Jul 12 15:34:33.742705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:33.742670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf" event={"ID":"79adb24e-cab8-4054-b2e4-4165f2af10ff","Type":"ContainerStarted","Data":"66ff7d6199a670a12bcc5535f51b5e6eebef7f414e22993a3d906d2dead61c4a"}
Jul 12 15:34:33.743107 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:33.742727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf" event={"ID":"79adb24e-cab8-4054-b2e4-4165f2af10ff","Type":"ContainerStarted","Data":"6fdf5c61f2e8d01a0675f4100a6bf5a48a9af951c5ba39b043ae70bb378b28d9"}
Jul 12 15:34:33.768424 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:33.768351    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf" podStartSLOduration=1.6092506960000001 podStartE2EDuration="1.768334327s" totalImagesPullingTime="159.083631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:34:33.76703519 +0000 UTC m=+851.466763971" watchObservedRunningTime="2026-07-12 15:34:33.768334327 +0000 UTC m=+851.468063141"
Jul 12 15:34:42.616950 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:42.616910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:42.617462 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:42.616972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:42.629599 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:42.629574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:42.808238 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:42.808204    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-96gqf"
Jul 12 15:34:58.002111 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.002077    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"]
Jul 12 15:34:58.015663 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.015607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.016694 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.016613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"]
Jul 12 15:34:58.018915 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.018890    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 15:34:58.203211 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq72q\" (UniqueName: \"kubernetes.io/projected/5ff082e9-4ff3-4f51-a747-c23592f50888-kube-api-access-gq72q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.203409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.203409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.203409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff082e9-4ff3-4f51-a747-c23592f50888-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.203409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.203409 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.203372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304722 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff082e9-4ff3-4f51-a747-c23592f50888-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304949 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304949 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.304949 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.304934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq72q\" (UniqueName: \"kubernetes.io/projected/5ff082e9-4ff3-4f51-a747-c23592f50888-kube-api-access-gq72q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.305108 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.305050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.305195 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.305164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.305331 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.305260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.307069 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.307048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff082e9-4ff3-4f51-a747-c23592f50888-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.307316 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.307297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff082e9-4ff3-4f51-a747-c23592f50888-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.314619 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.314599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq72q\" (UniqueName: \"kubernetes.io/projected/5ff082e9-4ff3-4f51-a747-c23592f50888-kube-api-access-gq72q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4\" (UID: \"5ff082e9-4ff3-4f51-a747-c23592f50888\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.328472 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.328452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:34:58.465629 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.465604    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"]
Jul 12 15:34:58.467450 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:34:58.467420    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ff082e9_4ff3_4f51_a747_c23592f50888.slice/crio-9388f147423b7c7851883f80fb1f35cb4d98d1a315d799d137dcc5bb159e4dc7 WatchSource:0}: Error finding container 9388f147423b7c7851883f80fb1f35cb4d98d1a315d799d137dcc5bb159e4dc7: Status 404 returned error can't find the container with id 9388f147423b7c7851883f80fb1f35cb4d98d1a315d799d137dcc5bb159e4dc7
Jul 12 15:34:58.890458 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.890420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4" event={"ID":"5ff082e9-4ff3-4f51-a747-c23592f50888","Type":"ContainerStarted","Data":"0eb14a0fe1fd6eb3005ce64db4cefcaeebd98b54c212f0545a476a2096d6f65d"}
Jul 12 15:34:58.890648 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.890467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4" event={"ID":"5ff082e9-4ff3-4f51-a747-c23592f50888","Type":"ContainerStarted","Data":"9388f147423b7c7851883f80fb1f35cb4d98d1a315d799d137dcc5bb159e4dc7"}
Jul 12 15:34:58.908074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:34:58.907978    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4" podStartSLOduration=1.7269315490000001 podStartE2EDuration="1.907959862s" totalImagesPullingTime="181.028313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:34:58.907433692 +0000 UTC m=+876.607162473" watchObservedRunningTime="2026-07-12 15:34:58.907959862 +0000 UTC m=+876.607688641"
Jul 12 15:35:08.329161 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:35:08.329126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:35:08.329701 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:35:08.329181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:35:08.342506 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:35:08.342480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:35:08.972073 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:35:08.972039    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4"
Jul 12 15:37:05.967491 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:05.967406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:37:05.968051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:05.967619    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" podUID="ef943bc3-1474-47ef-8319-bf8cce38a040" containerName="manager" containerID="cri-o://19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226" gracePeriod=30
Jul 12 15:37:06.230047 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.229974    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:37:06.258650 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.258616    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj6h2\" (UniqueName: \"kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2\") pod \"ef943bc3-1474-47ef-8319-bf8cce38a040\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") "
Jul 12 15:37:06.258818 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.258754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert\") pod \"ef943bc3-1474-47ef-8319-bf8cce38a040\" (UID: \"ef943bc3-1474-47ef-8319-bf8cce38a040\") "
Jul 12 15:37:06.260912 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.260887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef943bc3-1474-47ef-8319-bf8cce38a040" (UID: "ef943bc3-1474-47ef-8319-bf8cce38a040"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:37:06.261323 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.261302    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2" (OuterVolumeSpecName: "kube-api-access-tj6h2") pod "ef943bc3-1474-47ef-8319-bf8cce38a040" (UID: "ef943bc3-1474-47ef-8319-bf8cce38a040"). InnerVolumeSpecName "kube-api-access-tj6h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:37:06.360321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.360286    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj6h2\" (UniqueName: \"kubernetes.io/projected/ef943bc3-1474-47ef-8319-bf8cce38a040-kube-api-access-tj6h2\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:37:06.360321 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.360316    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef943bc3-1474-47ef-8319-bf8cce38a040-webhook-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:37:06.636113 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.636072    2581 generic.go:356] "Generic (PLEG): container finished" podID="ef943bc3-1474-47ef-8319-bf8cce38a040" containerID="19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226" exitCode=0
Jul 12 15:37:06.636113 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.636114    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-lbs27"
Jul 12 15:37:06.636333 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.636137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" event={"ID":"ef943bc3-1474-47ef-8319-bf8cce38a040","Type":"ContainerDied","Data":"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"}
Jul 12 15:37:06.636333 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.636180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-lbs27" event={"ID":"ef943bc3-1474-47ef-8319-bf8cce38a040","Type":"ContainerDied","Data":"77142dace8160931ad8bc9e2e157dff64fb0f054fcbc1a02b2fb6bdb09342c7b"}
Jul 12 15:37:06.636333 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.636204    2581 scope.go:117] "RemoveContainer" containerID="19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"
Jul 12 15:37:06.650056 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.650038    2581 scope.go:117] "RemoveContainer" containerID="19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"
Jul 12 15:37:06.650324 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:37:06.650304    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226\": container with ID starting with 19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226 not found: ID does not exist" containerID="19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"
Jul 12 15:37:06.650423 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.650331    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226"} err="failed to get container status \"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226\": rpc error: code = NotFound desc = could not find container \"19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226\": container with ID starting with 19425d1ae9cf030e3a495fdd3579cf77d6287ee1925b4ce68430d8f822813226 not found: ID does not exist"
Jul 12 15:37:06.662251 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.662221    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:37:06.666077 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.666057    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-lbs27"]
Jul 12 15:37:06.847694 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:06.847666    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef943bc3-1474-47ef-8319-bf8cce38a040" path="/var/lib/kubelet/pods/ef943bc3-1474-47ef-8319-bf8cce38a040/volumes"
Jul 12 15:37:07.439351 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.439313    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-4wxvt"]
Jul 12 15:37:07.439786 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.439773    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef943bc3-1474-47ef-8319-bf8cce38a040" containerName="manager"
Jul 12 15:37:07.439832 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.439788    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef943bc3-1474-47ef-8319-bf8cce38a040" containerName="manager"
Jul 12 15:37:07.439876 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.439867    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef943bc3-1474-47ef-8319-bf8cce38a040" containerName="manager"
Jul 12 15:37:07.444323 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.444306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.448114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.448092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rj6cr\""
Jul 12 15:37:07.448225 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.448134    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 15:37:07.448225 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.448165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 15:37:07.453449 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.453428    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-4wxvt"]
Jul 12 15:37:07.471979 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.471952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tcmf\" (UniqueName: \"kubernetes.io/projected/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-kube-api-access-4tcmf\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.472129 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.472040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-webhook-cert\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.573178 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.573140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tcmf\" (UniqueName: \"kubernetes.io/projected/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-kube-api-access-4tcmf\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.573342 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.573264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-webhook-cert\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.575899 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.575866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-webhook-cert\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.581554 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.581532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tcmf\" (UniqueName: \"kubernetes.io/projected/5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9-kube-api-access-4tcmf\") pod \"maas-controller-5557ccbdc6-4wxvt\" (UID: \"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9\") " pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.755778 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.755686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:07.903866 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.903835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5557ccbdc6-4wxvt"]
Jul 12 15:37:07.905398 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:37:07.905360    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0ec8a4_2afe_4e80_8bf7_ee28ccd4f6a9.slice/crio-432fd64f5608ac04c18f369aaf012b0dcec4572d9e8f8cbec1755422abcbd981 WatchSource:0}: Error finding container 432fd64f5608ac04c18f369aaf012b0dcec4572d9e8f8cbec1755422abcbd981: Status 404 returned error can't find the container with id 432fd64f5608ac04c18f369aaf012b0dcec4572d9e8f8cbec1755422abcbd981
Jul 12 15:37:07.907103 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:07.907083    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:37:08.651140 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:08.651080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt" event={"ID":"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9","Type":"ContainerStarted","Data":"42fa5f7c0ebfcbd8ea0f1782e4d42354aa1ce6114b0ac520d6b6e020fd718fec"}
Jul 12 15:37:08.651590 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:08.651202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt" event={"ID":"5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9","Type":"ContainerStarted","Data":"432fd64f5608ac04c18f369aaf012b0dcec4572d9e8f8cbec1755422abcbd981"}
Jul 12 15:37:08.651590 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:08.651337    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:37:08.670709 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:08.670662    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt" podStartSLOduration=1.11919191 podStartE2EDuration="1.670645599s" totalImagesPullingTime="551.453689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:37:08.668059861 +0000 UTC m=+1006.367788639" watchObservedRunningTime="2026-07-12 15:37:08.670645599 +0000 UTC m=+1006.370374377"
Jul 12 15:37:19.663913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:37:19.663882    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5557ccbdc6-4wxvt"
Jul 12 15:49:32.673501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.673454    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:32.678013 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.677990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.680682 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.680656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-7ed6f425-serving-cert\""
Jul 12 15:49:32.687683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.687661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:32.755605 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.755566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.755783 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.755619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.755783 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.755674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdv7w\" (UniqueName: \"kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.856538 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.856503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.856715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.856547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.856715 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.856594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdv7w\" (UniqueName: \"kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.856804 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:49:32.856722    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-7ed6f425-serving-cert: secret "maas-api-e2e-derive-7ed6f425-serving-cert" not found
Jul 12 15:49:32.856804 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:49:32.856793    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls podName:a5ef4921-3790-4931-af5c-de799e97a116 nodeName:}" failed. No retries permitted until 2026-07-12 15:49:33.356777986 +0000 UTC m=+1751.056506742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls") pod "maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" (UID: "a5ef4921-3790-4931-af5c-de799e97a116") : secret "maas-api-e2e-derive-7ed6f425-serving-cert" not found
Jul 12 15:49:32.857114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.857096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:32.864967 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:32.864941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdv7w\" (UniqueName: \"kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:33.361298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:33.361252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:33.363896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:33.363873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") pod \"maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") " pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:33.591082 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:33.591051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:33.946788 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:33.946750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:33.948894 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:49:33.948865    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ef4921_3790_4931_af5c_de799e97a116.slice/crio-601b7736457659afd79677742436372638562f18b2c7508b223528600eebce83 WatchSource:0}: Error finding container 601b7736457659afd79677742436372638562f18b2c7508b223528600eebce83: Status 404 returned error can't find the container with id 601b7736457659afd79677742436372638562f18b2c7508b223528600eebce83
Jul 12 15:49:33.950699 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:33.950675    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:49:34.001999 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:34.001964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" event={"ID":"a5ef4921-3790-4931-af5c-de799e97a116","Type":"ContainerStarted","Data":"601b7736457659afd79677742436372638562f18b2c7508b223528600eebce83"}
Jul 12 15:49:35.009435 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:35.009398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" event={"ID":"a5ef4921-3790-4931-af5c-de799e97a116","Type":"ContainerStarted","Data":"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"}
Jul 12 15:49:35.009916 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:35.009524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:35.025691 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:35.025644    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" podStartSLOduration=2.716484619 podStartE2EDuration="3.025627639s" totalImagesPullingTime="309.14302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:49:35.024858432 +0000 UTC m=+1752.724587211" watchObservedRunningTime="2026-07-12 15:49:35.025627639 +0000 UTC m=+1752.725356418"
Jul 12 15:49:37.305514 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.305478    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:37.305991 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.305760    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" podUID="a5ef4921-3790-4931-af5c-de799e97a116" containerName="maas-api" containerID="cri-o://657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3" gracePeriod=30
Jul 12 15:49:37.573131 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.573067    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:37.708152 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.708111    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca\") pod \"a5ef4921-3790-4931-af5c-de799e97a116\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") "
Jul 12 15:49:37.708340 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.708178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdv7w\" (UniqueName: \"kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w\") pod \"a5ef4921-3790-4931-af5c-de799e97a116\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") "
Jul 12 15:49:37.708340 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.708292    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") pod \"a5ef4921-3790-4931-af5c-de799e97a116\" (UID: \"a5ef4921-3790-4931-af5c-de799e97a116\") "
Jul 12 15:49:37.708618 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.708590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5ef4921-3790-4931-af5c-de799e97a116" (UID: "a5ef4921-3790-4931-af5c-de799e97a116"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:49:37.710625 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.710599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w" (OuterVolumeSpecName: "kube-api-access-sdv7w") pod "a5ef4921-3790-4931-af5c-de799e97a116" (UID: "a5ef4921-3790-4931-af5c-de799e97a116"). InnerVolumeSpecName "kube-api-access-sdv7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:49:37.710625 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.710599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5ef4921-3790-4931-af5c-de799e97a116" (UID: "a5ef4921-3790-4931-af5c-de799e97a116"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:49:37.809809 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.809766    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ef4921-3790-4931-af5c-de799e97a116-maas-api-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:49:37.809809 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.809796    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ef4921-3790-4931-af5c-de799e97a116-openshift-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:49:37.809809 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:37.809806    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdv7w\" (UniqueName: \"kubernetes.io/projected/a5ef4921-3790-4931-af5c-de799e97a116-kube-api-access-sdv7w\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:49:38.028078 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.028039    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5ef4921-3790-4931-af5c-de799e97a116" containerID="657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3" exitCode=0
Jul 12 15:49:38.028291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.028086    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"
Jul 12 15:49:38.028291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.028132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" event={"ID":"a5ef4921-3790-4931-af5c-de799e97a116","Type":"ContainerDied","Data":"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"}
Jul 12 15:49:38.028291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.028191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh" event={"ID":"a5ef4921-3790-4931-af5c-de799e97a116","Type":"ContainerDied","Data":"601b7736457659afd79677742436372638562f18b2c7508b223528600eebce83"}
Jul 12 15:49:38.028291 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.028223    2581 scope.go:117] "RemoveContainer" containerID="657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"
Jul 12 15:49:38.038188 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.038168    2581 scope.go:117] "RemoveContainer" containerID="657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"
Jul 12 15:49:38.038505 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:49:38.038480    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3\": container with ID starting with 657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3 not found: ID does not exist" containerID="657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"
Jul 12 15:49:38.038579 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.038518    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3"} err="failed to get container status \"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3\": rpc error: code = NotFound desc = could not find container \"657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3\": container with ID starting with 657469947ffca4f816a3f3afb3e7ac25e53371fddaba09f20705cf026bd6f2a3 not found: ID does not exist"
Jul 12 15:49:38.050395 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.050357    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:38.053474 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.053441    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-7ed6f425-767c7d4cf5-bwvdh"]
Jul 12 15:49:38.847299 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:49:38.847270    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ef4921-3790-4931-af5c-de799e97a116" path="/var/lib/kubelet/pods/a5ef4921-3790-4931-af5c-de799e97a116/volumes"
Jul 12 15:52:13.388374 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.388330    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:52:13.389088 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.389066    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ef4921-3790-4931-af5c-de799e97a116" containerName="maas-api"
Jul 12 15:52:13.389136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.389094    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ef4921-3790-4931-af5c-de799e97a116" containerName="maas-api"
Jul 12 15:52:13.389233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.389221    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ef4921-3790-4931-af5c-de799e97a116" containerName="maas-api"
Jul 12 15:52:13.393116 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.393096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.395775 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.395750    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cd9517a2\"/\"openshift-service-ca.crt\""
Jul 12 15:52:13.397152 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.397126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cd9517a2\"/\"e2e-lifecycle-model-cd9517a2-kserve-self-signed-certs\""
Jul 12 15:52:13.397422 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.397401    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cd9517a2\"/\"default-dockercfg-trdkq\""
Jul 12 15:52:13.397534 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.397403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cd9517a2\"/\"kube-root-ca.crt\""
Jul 12 15:52:13.398269 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.398243    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:52:13.472152 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.472314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.472314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.472314 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.472486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvmf\" (UniqueName: \"kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.472486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.472442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573752 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvmf\" (UniqueName: \"kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.573932 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.573909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.574209 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.574152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.574209 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.574191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.574305 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.574288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.576299 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.576266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.576552 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.576535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.581492 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.581471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvmf\" (UniqueName: \"kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf\") pod \"e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") " pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.704541 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.704436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:13.847622 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.847595    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:52:13.849082 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:52:13.849060    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1026378c_1654_4e96_9f1e_7c5ae7323b26.slice/crio-055267c91ddc067541fa69ab18cabd9954a23b4b528305d4e591f40971448bcc WatchSource:0}: Error finding container 055267c91ddc067541fa69ab18cabd9954a23b4b528305d4e591f40971448bcc: Status 404 returned error can't find the container with id 055267c91ddc067541fa69ab18cabd9954a23b4b528305d4e591f40971448bcc
Jul 12 15:52:13.942886 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.942846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" event={"ID":"1026378c-1654-4e96-9f1e-7c5ae7323b26","Type":"ContainerStarted","Data":"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"}
Jul 12 15:52:13.943084 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.942896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" event={"ID":"1026378c-1654-4e96-9f1e-7c5ae7323b26","Type":"ContainerStarted","Data":"055267c91ddc067541fa69ab18cabd9954a23b4b528305d4e591f40971448bcc"}
Jul 12 15:52:13.959941 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:13.959832    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" podStartSLOduration=0.959815591 podStartE2EDuration="959.815591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:52:13.958054101 +0000 UTC m=+1911.657782881" watchObservedRunningTime="2026-07-12 15:52:13.959815591 +0000 UTC m=+1911.659544370"
Jul 12 15:52:23.704579 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:23.704541    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:23.705000 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:23.704598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:23.717125 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:23.717100    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:24.013168 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:24.013084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:43.248086 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:43.248045    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:52:58.270938 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.270883    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" podUID="1026378c-1654-4e96-9f1e-7c5ae7323b26" containerName="main" containerID="cri-o://d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1" gracePeriod=45
Jul 12 15:52:58.540847 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.540822    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:58.631700 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.631896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.631896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631766    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.631896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvmf\" (UniqueName: \"kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.631896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.631896 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631876    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs\") pod \"1026378c-1654-4e96-9f1e-7c5ae7323b26\" (UID: \"1026378c-1654-4e96-9f1e-7c5ae7323b26\") "
Jul 12 15:52:58.632133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.631929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:52:58.632133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.632019    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home" (OuterVolumeSpecName: "home") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:52:58.632133 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.632057    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache" (OuterVolumeSpecName: "model-cache") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:52:58.632298 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.632280    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-tmp-dir\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:58.632344 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.632306    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-home\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:58.632344 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.632319    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-model-cache\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:58.634275 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.634252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm" (OuterVolumeSpecName: "dshm") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:52:58.634358 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.634274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf" (OuterVolumeSpecName: "kube-api-access-2tvmf") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "kube-api-access-2tvmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:52:58.634358 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.634320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1026378c-1654-4e96-9f1e-7c5ae7323b26" (UID: "1026378c-1654-4e96-9f1e-7c5ae7323b26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:52:58.733122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.733082    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tvmf\" (UniqueName: \"kubernetes.io/projected/1026378c-1654-4e96-9f1e-7c5ae7323b26-kube-api-access-2tvmf\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:58.733122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.733116    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1026378c-1654-4e96-9f1e-7c5ae7323b26-dshm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:58.733122 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:58.733127    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1026378c-1654-4e96-9f1e-7c5ae7323b26-tls-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:52:59.212733 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.212636    2581 generic.go:356] "Generic (PLEG): container finished" podID="1026378c-1654-4e96-9f1e-7c5ae7323b26" containerID="d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1" exitCode=0
Jul 12 15:52:59.212733 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.212674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"
Jul 12 15:52:59.212733 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.212692    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" event={"ID":"1026378c-1654-4e96-9f1e-7c5ae7323b26","Type":"ContainerDied","Data":"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"}
Jul 12 15:52:59.212733 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.212731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx" event={"ID":"1026378c-1654-4e96-9f1e-7c5ae7323b26","Type":"ContainerDied","Data":"055267c91ddc067541fa69ab18cabd9954a23b4b528305d4e591f40971448bcc"}
Jul 12 15:52:59.213031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.212749    2581 scope.go:117] "RemoveContainer" containerID="d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"
Jul 12 15:52:59.221988 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.221969    2581 scope.go:117] "RemoveContainer" containerID="d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"
Jul 12 15:52:59.222235 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:52:59.222218    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1\": container with ID starting with d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1 not found: ID does not exist" containerID="d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"
Jul 12 15:52:59.222281 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.222244    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1"} err="failed to get container status \"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1\": rpc error: code = NotFound desc = could not find container \"d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1\": container with ID starting with d000aec636d7f63409db3f52ad94c32e7c9445609a583f806b4b2a6e2c7a7be1 not found: ID does not exist"
Jul 12 15:52:59.229114 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.229087    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:52:59.234622 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:52:59.234595    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cd9517a2/e2e-lifecycle-model-cd9517a2-kserve-5db4d97779-8n5mx"]
Jul 12 15:53:00.848141 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:53:00.848106    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1026378c-1654-4e96-9f1e-7c5ae7323b26" path="/var/lib/kubelet/pods/1026378c-1654-4e96-9f1e-7c5ae7323b26/volumes"
Jul 12 15:54:28.388167 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.388122    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:54:28.388846 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.388823    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1026378c-1654-4e96-9f1e-7c5ae7323b26" containerName="main"
Jul 12 15:54:28.388938 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.388850    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1026378c-1654-4e96-9f1e-7c5ae7323b26" containerName="main"
Jul 12 15:54:28.388993 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.388975    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1026378c-1654-4e96-9f1e-7c5ae7323b26" containerName="main"
Jul 12 15:54:28.392586 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.392565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.395083 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.395062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8ac237-serving-cert\""
Jul 12 15:54:28.402853 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.402833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:54:28.425325 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.425293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.425495 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.425340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx9tv\" (UniqueName: \"kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.425548 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.425508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.526708 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.526668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.526887 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.526723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx9tv\" (UniqueName: \"kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.526887 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.526801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.526987 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:54:28.526967    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-8ac237-serving-cert: secret "maas-api-e2e-inf-a-8ac237-serving-cert" not found
Jul 12 15:54:28.527056 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:54:28.527045    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls podName:78f63090-7334-4c19-96d3-a558e6d4eacb nodeName:}" failed. No retries permitted until 2026-07-12 15:54:29.027027575 +0000 UTC m=+2046.726756332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls") pod "maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" (UID: "78f63090-7334-4c19-96d3-a558e6d4eacb") : secret "maas-api-e2e-inf-a-8ac237-serving-cert" not found
Jul 12 15:54:28.527322 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.527304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:28.537530 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:28.537498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx9tv\" (UniqueName: \"kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:29.032310 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:29.032268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:29.035222 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:29.035199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") pod \"maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") " pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:29.306120 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:29.306026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:29.454550 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:29.454524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:54:29.455913 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:54:29.455883    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f63090_7334_4c19_96d3_a558e6d4eacb.slice/crio-bf2a764783d32d7f7b3616d5f9cea229c76480faa47639a2b76ddf4e28674a21 WatchSource:0}: Error finding container bf2a764783d32d7f7b3616d5f9cea229c76480faa47639a2b76ddf4e28674a21: Status 404 returned error can't find the container with id bf2a764783d32d7f7b3616d5f9cea229c76480faa47639a2b76ddf4e28674a21
Jul 12 15:54:29.754313 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:29.754280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" event={"ID":"78f63090-7334-4c19-96d3-a558e6d4eacb","Type":"ContainerStarted","Data":"bf2a764783d32d7f7b3616d5f9cea229c76480faa47639a2b76ddf4e28674a21"}
Jul 12 15:54:30.762567 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:30.762525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" event={"ID":"78f63090-7334-4c19-96d3-a558e6d4eacb","Type":"ContainerStarted","Data":"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"}
Jul 12 15:54:30.762953 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:30.762652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:30.779502 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:30.779457    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" podStartSLOduration=2.341433432 podStartE2EDuration="2.779441059s" totalImagesPullingTime="438.007627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:54:30.77819156 +0000 UTC m=+2048.477920364" watchObservedRunningTime="2026-07-12 15:54:30.779441059 +0000 UTC m=+2048.479169856"
Jul 12 15:54:36.774919 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:36.774890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:54:46.691283 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.691200    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:54:46.694965 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.694943    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.698784 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.698759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8ac237\"/\"test-model-8ac237-kserve-self-signed-certs\""
Jul 12 15:54:46.698997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.698970    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8ac237\"/\"openshift-service-ca.crt\""
Jul 12 15:54:46.699119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.698825    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8ac237\"/\"default-dockercfg-wh6fw\""
Jul 12 15:54:46.699119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.698782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8ac237\"/\"kube-root-ca.crt\""
Jul 12 15:54:46.702543 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.702519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:54:46.809859 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.809811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.810051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.809881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.810051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.809948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.810051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.809997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.810221 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.810088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.810221 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.810116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbxfs\" (UniqueName: \"kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911201 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911201 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbxfs\" (UniqueName: \"kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911515 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911741 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911809 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.911809 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.911774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.913683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.913659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.913961 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.913943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:46.919299 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:46.919280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbxfs\" (UniqueName: \"kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs\") pod \"test-model-8ac237-kserve-6f787d6b8f-rtpsd\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") " pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:47.006173 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:47.006078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:47.154660 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:47.154632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:54:47.155981 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:54:47.155949    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod661b5cbb_0038_4d62_979b_7613d791a7f3.slice/crio-beba9c3b8ebc1aee6f070c10103d3cf5b1e6d3a5c97c47178b7e0eb2eeaa3bd5 WatchSource:0}: Error finding container beba9c3b8ebc1aee6f070c10103d3cf5b1e6d3a5c97c47178b7e0eb2eeaa3bd5: Status 404 returned error can't find the container with id beba9c3b8ebc1aee6f070c10103d3cf5b1e6d3a5c97c47178b7e0eb2eeaa3bd5
Jul 12 15:54:47.864294 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:47.864252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" event={"ID":"661b5cbb-0038-4d62-979b-7613d791a7f3","Type":"ContainerStarted","Data":"c3f35a39ef363f044a6ecfe2a16ff884fe0deeceb41cd38bdb846f36c36ddc50"}
Jul 12 15:54:47.864751 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:47.864306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" event={"ID":"661b5cbb-0038-4d62-979b-7613d791a7f3","Type":"ContainerStarted","Data":"beba9c3b8ebc1aee6f070c10103d3cf5b1e6d3a5c97c47178b7e0eb2eeaa3bd5"}
Jul 12 15:54:47.881199 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:47.881153    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" podStartSLOduration=1.881138108 podStartE2EDuration="1.881138108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:54:47.879123325 +0000 UTC m=+2065.578852117" watchObservedRunningTime="2026-07-12 15:54:47.881138108 +0000 UTC m=+2065.580866886"
Jul 12 15:54:57.007153 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:57.007111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:57.007610 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:57.007167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:57.020276 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:57.020249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:54:57.935113 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:54:57.935080    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:55:39.030031 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:39.030001    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:55:40.725097 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:40.725061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:55:40.725588 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:40.725274    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" podUID="78f63090-7334-4c19-96d3-a558e6d4eacb" containerName="maas-api" containerID="cri-o://b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378" gracePeriod=30
Jul 12 15:55:40.981705 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:40.981642    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:55:41.072042 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.072012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca\") pod \"78f63090-7334-4c19-96d3-a558e6d4eacb\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") "
Jul 12 15:55:41.072203 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.072077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx9tv\" (UniqueName: \"kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv\") pod \"78f63090-7334-4c19-96d3-a558e6d4eacb\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") "
Jul 12 15:55:41.072203 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.072142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") pod \"78f63090-7334-4c19-96d3-a558e6d4eacb\" (UID: \"78f63090-7334-4c19-96d3-a558e6d4eacb\") "
Jul 12 15:55:41.072511 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.072486    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78f63090-7334-4c19-96d3-a558e6d4eacb" (UID: "78f63090-7334-4c19-96d3-a558e6d4eacb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:55:41.074346 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.074316    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78f63090-7334-4c19-96d3-a558e6d4eacb" (UID: "78f63090-7334-4c19-96d3-a558e6d4eacb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:55:41.074484 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.074362    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv" (OuterVolumeSpecName: "kube-api-access-nx9tv") pod "78f63090-7334-4c19-96d3-a558e6d4eacb" (UID: "78f63090-7334-4c19-96d3-a558e6d4eacb"). InnerVolumeSpecName "kube-api-access-nx9tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:55:41.174081 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.174042    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f63090-7334-4c19-96d3-a558e6d4eacb-openshift-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:41.174081 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.174081    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx9tv\" (UniqueName: \"kubernetes.io/projected/78f63090-7334-4c19-96d3-a558e6d4eacb-kube-api-access-nx9tv\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:41.174279 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.174097    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78f63090-7334-4c19-96d3-a558e6d4eacb-maas-api-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:41.178657 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.178620    2581 generic.go:356] "Generic (PLEG): container finished" podID="78f63090-7334-4c19-96d3-a558e6d4eacb" containerID="b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378" exitCode=0
Jul 12 15:55:41.178783 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.178677    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"
Jul 12 15:55:41.178783 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.178710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" event={"ID":"78f63090-7334-4c19-96d3-a558e6d4eacb","Type":"ContainerDied","Data":"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"}
Jul 12 15:55:41.178860 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.178789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7" event={"ID":"78f63090-7334-4c19-96d3-a558e6d4eacb","Type":"ContainerDied","Data":"bf2a764783d32d7f7b3616d5f9cea229c76480faa47639a2b76ddf4e28674a21"}
Jul 12 15:55:41.178860 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.178815    2581 scope.go:117] "RemoveContainer" containerID="b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"
Jul 12 15:55:41.188533 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.188521    2581 scope.go:117] "RemoveContainer" containerID="b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"
Jul 12 15:55:41.188763 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:55:41.188745    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378\": container with ID starting with b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378 not found: ID does not exist" containerID="b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"
Jul 12 15:55:41.188815 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.188776    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378"} err="failed to get container status \"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378\": rpc error: code = NotFound desc = could not find container \"b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378\": container with ID starting with b9e7de66dffac3d06626027afa96cb121e768ef7b2f59f69ac3130931af71378 not found: ID does not exist"
Jul 12 15:55:41.201474 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.201451    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:55:41.204049 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:41.204030    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8ac237-7c777ffc74-6x7q7"]
Jul 12 15:55:42.847680 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:42.847647    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f63090-7334-4c19-96d3-a558e6d4eacb" path="/var/lib/kubelet/pods/78f63090-7334-4c19-96d3-a558e6d4eacb/volumes"
Jul 12 15:55:54.053770 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.053725    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" podUID="661b5cbb-0038-4d62-979b-7613d791a7f3" containerName="main" containerID="cri-o://c3f35a39ef363f044a6ecfe2a16ff884fe0deeceb41cd38bdb846f36c36ddc50" gracePeriod=45
Jul 12 15:55:54.260048 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.260013    2581 generic.go:356] "Generic (PLEG): container finished" podID="661b5cbb-0038-4d62-979b-7613d791a7f3" containerID="c3f35a39ef363f044a6ecfe2a16ff884fe0deeceb41cd38bdb846f36c36ddc50" exitCode=0
Jul 12 15:55:54.260189 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.260067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" event={"ID":"661b5cbb-0038-4d62-979b-7613d791a7f3","Type":"ContainerDied","Data":"c3f35a39ef363f044a6ecfe2a16ff884fe0deeceb41cd38bdb846f36c36ddc50"}
Jul 12 15:55:54.319877 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.319810    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:55:54.407540 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.407713 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.407713 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.407801 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.407801 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.407902 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbxfs\" (UniqueName: \"kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs\") pod \"661b5cbb-0038-4d62-979b-7613d791a7f3\" (UID: \"661b5cbb-0038-4d62-979b-7613d791a7f3\") "
Jul 12 15:55:54.408051 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.407978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:55:54.408136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.408061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home" (OuterVolumeSpecName: "home") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:55:54.408136 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.408072    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:55:54.408235 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.408172    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-model-cache\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:54.408235 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.408184    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-home\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:54.408235 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.408192    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-tmp-dir\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:54.410119 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.410091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:55:54.410233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.410191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm" (OuterVolumeSpecName: "dshm") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 15:55:54.410233 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.410189    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs" (OuterVolumeSpecName: "kube-api-access-tbxfs") pod "661b5cbb-0038-4d62-979b-7613d791a7f3" (UID: "661b5cbb-0038-4d62-979b-7613d791a7f3"). InnerVolumeSpecName "kube-api-access-tbxfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:55:54.509121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.509088    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/661b5cbb-0038-4d62-979b-7613d791a7f3-dshm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:54.509121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.509115    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbxfs\" (UniqueName: \"kubernetes.io/projected/661b5cbb-0038-4d62-979b-7613d791a7f3-kube-api-access-tbxfs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:54.509121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:54.509126    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/661b5cbb-0038-4d62-979b-7613d791a7f3-tls-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:55:55.266794 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:55.266709    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"
Jul 12 15:55:55.266794 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:55.266729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd" event={"ID":"661b5cbb-0038-4d62-979b-7613d791a7f3","Type":"ContainerDied","Data":"beba9c3b8ebc1aee6f070c10103d3cf5b1e6d3a5c97c47178b7e0eb2eeaa3bd5"}
Jul 12 15:55:55.266794 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:55.266773    2581 scope.go:117] "RemoveContainer" containerID="c3f35a39ef363f044a6ecfe2a16ff884fe0deeceb41cd38bdb846f36c36ddc50"
Jul 12 15:55:55.286558 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:55.286529    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:55:55.289093 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:55.289069    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8ac237/test-model-8ac237-kserve-6f787d6b8f-rtpsd"]
Jul 12 15:55:56.847248 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:55:56.847208    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="661b5cbb-0038-4d62-979b-7613d791a7f3" path="/var/lib/kubelet/pods/661b5cbb-0038-4d62-979b-7613d791a7f3/volumes"
Jul 12 15:56:41.893555 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.893520    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:56:41.894030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.893976    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f63090-7334-4c19-96d3-a558e6d4eacb" containerName="maas-api"
Jul 12 15:56:41.894030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.893987    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f63090-7334-4c19-96d3-a558e6d4eacb" containerName="maas-api"
Jul 12 15:56:41.894030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.894000    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="661b5cbb-0038-4d62-979b-7613d791a7f3" containerName="main"
Jul 12 15:56:41.894030 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.894005    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="661b5cbb-0038-4d62-979b-7613d791a7f3" containerName="main"
Jul 12 15:56:41.894160 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.894073    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="661b5cbb-0038-4d62-979b-7613d791a7f3" containerName="main"
Jul 12 15:56:41.894160 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.894080    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f63090-7334-4c19-96d3-a558e6d4eacb" containerName="maas-api"
Jul 12 15:56:41.897318 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.897295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:41.900572 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.900557    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-e6ad77-serving-cert\""
Jul 12 15:56:41.910838 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.910815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:56:41.976441 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.976400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n75j\" (UniqueName: \"kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:41.976626 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.976464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:41.976626 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:41.976579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.077307 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.077273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.077501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.077353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n75j\" (UniqueName: \"kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.077501 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.077423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.077953 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.077929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.079843 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.079818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.088786 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.088764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n75j\" (UniqueName: \"kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j\") pod \"maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") " pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.207970 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.207879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:42.357542 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.357506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:56:42.358401 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:56:42.358348    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca9dc3a_2b59_4286_b53c_174191300f77.slice/crio-e626074b1e9e0a2ccc01c722c8f9fda5de7b9ea691b997ddd8bca5ca0495b29b WatchSource:0}: Error finding container e626074b1e9e0a2ccc01c722c8f9fda5de7b9ea691b997ddd8bca5ca0495b29b: Status 404 returned error can't find the container with id e626074b1e9e0a2ccc01c722c8f9fda5de7b9ea691b997ddd8bca5ca0495b29b
Jul 12 15:56:42.360126 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.360104    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 15:56:42.551287 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:42.551201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" event={"ID":"3ca9dc3a-2b59-4286-b53c-174191300f77","Type":"ContainerStarted","Data":"e626074b1e9e0a2ccc01c722c8f9fda5de7b9ea691b997ddd8bca5ca0495b29b"}
Jul 12 15:56:43.558476 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:43.558428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" event={"ID":"3ca9dc3a-2b59-4286-b53c-174191300f77","Type":"ContainerStarted","Data":"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"}
Jul 12 15:56:43.558880 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:43.558511    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:56:43.575195 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:43.575129    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" podStartSLOduration=2.232406012 podStartE2EDuration="2.575114763s" totalImagesPullingTime="342.708751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:56:43.574626412 +0000 UTC m=+2181.274355191" watchObservedRunningTime="2026-07-12 15:56:43.575114763 +0000 UTC m=+2181.274843542"
Jul 12 15:56:49.570253 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:56:49.570221    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:57:01.551683 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.551642    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:57:01.552514 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.552474    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" podUID="3ca9dc3a-2b59-4286-b53c-174191300f77" containerName="maas-api" containerID="cri-o://2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7" gracePeriod=30
Jul 12 15:57:01.822046 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.822023    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:57:01.861121 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.861081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n75j\" (UniqueName: \"kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j\") pod \"3ca9dc3a-2b59-4286-b53c-174191300f77\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") "
Jul 12 15:57:01.861325 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.861158    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls\") pod \"3ca9dc3a-2b59-4286-b53c-174191300f77\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") "
Jul 12 15:57:01.861325 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.861255    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca\") pod \"3ca9dc3a-2b59-4286-b53c-174191300f77\" (UID: \"3ca9dc3a-2b59-4286-b53c-174191300f77\") "
Jul 12 15:57:01.861717 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.861685    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ca9dc3a-2b59-4286-b53c-174191300f77" (UID: "3ca9dc3a-2b59-4286-b53c-174191300f77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 15:57:01.863371 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.863349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j" (OuterVolumeSpecName: "kube-api-access-9n75j") pod "3ca9dc3a-2b59-4286-b53c-174191300f77" (UID: "3ca9dc3a-2b59-4286-b53c-174191300f77"). InnerVolumeSpecName "kube-api-access-9n75j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 15:57:01.863486 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.863392    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ca9dc3a-2b59-4286-b53c-174191300f77" (UID: "3ca9dc3a-2b59-4286-b53c-174191300f77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 15:57:01.962851 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.962811    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ca9dc3a-2b59-4286-b53c-174191300f77-maas-api-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:57:01.962851 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.962845    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca9dc3a-2b59-4286-b53c-174191300f77-openshift-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:57:01.962851 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:01.962859    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n75j\" (UniqueName: \"kubernetes.io/projected/3ca9dc3a-2b59-4286-b53c-174191300f77-kube-api-access-9n75j\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 15:57:02.669431 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.669394    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ca9dc3a-2b59-4286-b53c-174191300f77" containerID="2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7" exitCode=0
Jul 12 15:57:02.669431 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.669426    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" event={"ID":"3ca9dc3a-2b59-4286-b53c-174191300f77","Type":"ContainerDied","Data":"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"}
Jul 12 15:57:02.669997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.669451    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"
Jul 12 15:57:02.669997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.669492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc" event={"ID":"3ca9dc3a-2b59-4286-b53c-174191300f77","Type":"ContainerDied","Data":"e626074b1e9e0a2ccc01c722c8f9fda5de7b9ea691b997ddd8bca5ca0495b29b"}
Jul 12 15:57:02.669997 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.669515    2581 scope.go:117] "RemoveContainer" containerID="2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"
Jul 12 15:57:02.679767 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.679750    2581 scope.go:117] "RemoveContainer" containerID="2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"
Jul 12 15:57:02.680037 ip-10-0-128-199 kubenswrapper[2581]: E0712 15:57:02.680018    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7\": container with ID starting with 2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7 not found: ID does not exist" containerID="2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"
Jul 12 15:57:02.680098 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.680047    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7"} err="failed to get container status \"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7\": rpc error: code = NotFound desc = could not find container \"2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7\": container with ID starting with 2ccf2de693f0fa37d99c85954f609dd699c14c91415aca2bdac4eb4772f910a7 not found: ID does not exist"
Jul 12 15:57:02.691395 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.691359    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:57:02.695161 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.695138    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e6ad77-698fc655dd-8wsgc"]
Jul 12 15:57:02.848082 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:02.848049    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca9dc3a-2b59-4286-b53c-174191300f77" path="/var/lib/kubelet/pods/3ca9dc3a-2b59-4286-b53c-174191300f77/volumes"
Jul 12 15:57:10.937132 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.937093    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 15:57:10.937913 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.937891    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca9dc3a-2b59-4286-b53c-174191300f77" containerName="maas-api"
Jul 12 15:57:10.937985 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.937918    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca9dc3a-2b59-4286-b53c-174191300f77" containerName="maas-api"
Jul 12 15:57:10.938093 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.938080    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca9dc3a-2b59-4286-b53c-174191300f77" containerName="maas-api"
Jul 12 15:57:10.943212 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.943191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:10.946074 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.946048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-a99179-serving-cert\""
Jul 12 15:57:10.950340 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:10.950313    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 15:57:11.053819 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.053783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.054066 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.053846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nld4d\" (UniqueName: \"kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.054066 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.054002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.154984 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.154938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.155194 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.155027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.155194 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.155065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nld4d\" (UniqueName: \"kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.155675 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.155656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.157621 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.157604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.162986 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.162963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nld4d\" (UniqueName: \"kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d\") pod \"maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") " pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.256049 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.255949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:11.399985 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.399961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 15:57:11.401474 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:57:11.401450    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1614c3d_28d2_4883_91a6_617333d813ad.slice/crio-9481ecf009b33398fcd308c8d32f6f11b037f71e83595d4d4df0920f76974684 WatchSource:0}: Error finding container 9481ecf009b33398fcd308c8d32f6f11b037f71e83595d4d4df0920f76974684: Status 404 returned error can't find the container with id 9481ecf009b33398fcd308c8d32f6f11b037f71e83595d4d4df0920f76974684
Jul 12 15:57:11.724850 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:11.724818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" event={"ID":"b1614c3d-28d2-4883-91a6-617333d813ad","Type":"ContainerStarted","Data":"9481ecf009b33398fcd308c8d32f6f11b037f71e83595d4d4df0920f76974684"}
Jul 12 15:57:12.732504 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:12.732463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" event={"ID":"b1614c3d-28d2-4883-91a6-617333d813ad","Type":"ContainerStarted","Data":"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"}
Jul 12 15:57:12.732922 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:12.732524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:57:12.750859 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:12.750815    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" podStartSLOduration=2.402893541 podStartE2EDuration="2.750798619s" totalImagesPullingTime="347.905078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:57:12.749656781 +0000 UTC m=+2210.449385563" watchObservedRunningTime="2026-07-12 15:57:12.750798619 +0000 UTC m=+2210.450527397"
Jul 12 15:57:18.745349 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:57:18.745316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 15:58:25.203106 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.203062    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 15:58:25.207433 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.207414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.209971 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.209947    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"openshift-service-ca.crt\""
Jul 12 15:58:25.211155 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.211132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"auth-test-model-3da434-kserve-self-signed-certs\""
Jul 12 15:58:25.211341 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.211317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"default-dockercfg-njf7m\""
Jul 12 15:58:25.211507 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.211317    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"kube-root-ca.crt\""
Jul 12 15:58:25.212619 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.212580    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 15:58:25.287494 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdbhj\" (UniqueName: \"kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.287673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.287673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.287673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.287673 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.287827 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.287738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdbhj\" (UniqueName: \"kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.388859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.389217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.389598 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.389308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.390171 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.389895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.391295 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.391269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.391862 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.391843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.397343 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.397317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdbhj\" (UniqueName: \"kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj\") pod \"auth-test-model-3da434-kserve-d88f79455-nbc9g\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") " pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.518286 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.518197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:25.660840 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:25.660808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 15:58:25.666277 ip-10-0-128-199 kubenswrapper[2581]: W0712 15:58:25.666247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8efffd6_594b_4e2a_9a17_67ba78f1cccf.slice/crio-a96774c6c72b0383add3fed57d9da6b8d8b194afd619dcefd6a825d7a9c9d0bc WatchSource:0}: Error finding container a96774c6c72b0383add3fed57d9da6b8d8b194afd619dcefd6a825d7a9c9d0bc: Status 404 returned error can't find the container with id a96774c6c72b0383add3fed57d9da6b8d8b194afd619dcefd6a825d7a9c9d0bc
Jul 12 15:58:26.169859 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:26.169815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" event={"ID":"a8efffd6-594b-4e2a-9a17-67ba78f1cccf","Type":"ContainerStarted","Data":"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"}
Jul 12 15:58:26.169859 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:26.169863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" event={"ID":"a8efffd6-594b-4e2a-9a17-67ba78f1cccf","Type":"ContainerStarted","Data":"a96774c6c72b0383add3fed57d9da6b8d8b194afd619dcefd6a825d7a9c9d0bc"}
Jul 12 15:58:26.186532 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:26.186479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" podStartSLOduration=1.186463704 podStartE2EDuration="1.186463704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 15:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 15:58:26.185143239 +0000 UTC m=+2283.884872019" watchObservedRunningTime="2026-07-12 15:58:26.186463704 +0000 UTC m=+2283.886192482"
Jul 12 15:58:35.518521 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:35.518485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:35.518917 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:35.518544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:35.531350 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:35.531325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 15:58:36.246781 ip-10-0-128-199 kubenswrapper[2581]: I0712 15:58:36.246747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 16:00:00.135807 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.135772    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29731200-xdtk6"]
Jul 12 16:00:00.139430 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.139413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:00.146704 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.146679    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29731200-xdtk6"]
Jul 12 16:00:00.258248 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.258207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlf4\" (UniqueName: \"kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4\") pod \"maas-api-key-cleanup-29731200-xdtk6\" (UID: \"787d8595-1299-4654-96d2-2a1965389ab4\") " pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:00.359028 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.358990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlf4\" (UniqueName: \"kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4\") pod \"maas-api-key-cleanup-29731200-xdtk6\" (UID: \"787d8595-1299-4654-96d2-2a1965389ab4\") " pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:00.367494 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.367467    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlf4\" (UniqueName: \"kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4\") pod \"maas-api-key-cleanup-29731200-xdtk6\" (UID: \"787d8595-1299-4654-96d2-2a1965389ab4\") " pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:00.451493 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.451402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:00.599995 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.599964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29731200-xdtk6"]
Jul 12 16:00:00.601651 ip-10-0-128-199 kubenswrapper[2581]: W0712 16:00:00.601626    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787d8595_1299_4654_96d2_2a1965389ab4.slice/crio-277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1 WatchSource:0}: Error finding container 277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1: Status 404 returned error can't find the container with id 277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1
Jul 12 16:00:00.727815 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:00.727724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6" event={"ID":"787d8595-1299-4654-96d2-2a1965389ab4","Type":"ContainerStarted","Data":"277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1"}
Jul 12 16:00:05.761894 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:05.761856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6" event={"ID":"787d8595-1299-4654-96d2-2a1965389ab4","Type":"ContainerStarted","Data":"3f0cb5422a10e6db179d2085000bb04b9ecf8b095d6743fa1040c92c84b5bfb1"}
Jul 12 16:00:05.779975 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:05.779920    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6" podStartSLOduration=1.4590172319999999 podStartE2EDuration="5.779905762s" totalImagesPullingTime="4.32088853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:00:05.777830983 +0000 UTC m=+2383.477559764" watchObservedRunningTime="2026-07-12 16:00:05.779905762 +0000 UTC m=+2383.479634540"
Jul 12 16:00:06.768857 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:06.768825    2581 generic.go:356] "Generic (PLEG): container finished" podID="787d8595-1299-4654-96d2-2a1965389ab4" containerID="3f0cb5422a10e6db179d2085000bb04b9ecf8b095d6743fa1040c92c84b5bfb1" exitCode=0
Jul 12 16:00:06.769226 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:06.768907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6" event={"ID":"787d8595-1299-4654-96d2-2a1965389ab4","Type":"ContainerDied","Data":"3f0cb5422a10e6db179d2085000bb04b9ecf8b095d6743fa1040c92c84b5bfb1"}
Jul 12 16:00:07.918949 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:07.918922    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:08.039132 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.039045    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxlf4\" (UniqueName: \"kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4\") pod \"787d8595-1299-4654-96d2-2a1965389ab4\" (UID: \"787d8595-1299-4654-96d2-2a1965389ab4\") "
Jul 12 16:00:08.041251 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.041220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4" (OuterVolumeSpecName: "kube-api-access-zxlf4") pod "787d8595-1299-4654-96d2-2a1965389ab4" (UID: "787d8595-1299-4654-96d2-2a1965389ab4"). InnerVolumeSpecName "kube-api-access-zxlf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:00:08.140509 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.140477    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxlf4\" (UniqueName: \"kubernetes.io/projected/787d8595-1299-4654-96d2-2a1965389ab4-kube-api-access-zxlf4\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:08.781974 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.781933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6" event={"ID":"787d8595-1299-4654-96d2-2a1965389ab4","Type":"ContainerDied","Data":"277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1"}
Jul 12 16:00:08.782156 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.781979    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731200-xdtk6"
Jul 12 16:00:08.782156 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:08.782025    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="277814babe54ec15c2f1049d7ea13a7b1cbed3a5f5bc9b5936a324ed0e8ae2e1"
Jul 12 16:00:17.397902 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:17.397862    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 16:00:32.419721 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.419674    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" podUID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" containerName="main" containerID="cri-o://566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8" gracePeriod=45
Jul 12 16:00:32.683438 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.683368    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 16:00:32.789522 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789487    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789522 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789745 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdbhj\" (UniqueName: \"kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789745 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789745 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789889 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs\") pod \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\" (UID: \"a8efffd6-594b-4e2a-9a17-67ba78f1cccf\") "
Jul 12 16:00:32.789889 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.789872    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:00:32.790049 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.790030    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home" (OuterVolumeSpecName: "home") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:00:32.790138 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.790113    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tmp-dir\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.790239 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.790217    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:00:32.792066 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.792044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:00:32.792137 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.792100    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj" (OuterVolumeSpecName: "kube-api-access-kdbhj") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "kube-api-access-kdbhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:00:32.792137 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.792123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm" (OuterVolumeSpecName: "dshm") pod "a8efffd6-594b-4e2a-9a17-67ba78f1cccf" (UID: "a8efffd6-594b-4e2a-9a17-67ba78f1cccf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:00:32.890656 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.890621    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-model-cache\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.890656 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.890648    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-tls-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.890656 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.890656    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-dshm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.890870 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.890664    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdbhj\" (UniqueName: \"kubernetes.io/projected/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-kube-api-access-kdbhj\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.890870 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.890673    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8efffd6-594b-4e2a-9a17-67ba78f1cccf-home\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:00:32.942860 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.942781    2581 generic.go:356] "Generic (PLEG): container finished" podID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" containerID="566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8" exitCode=0
Jul 12 16:00:32.942860 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.942818    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"
Jul 12 16:00:32.943039 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.942819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" event={"ID":"a8efffd6-594b-4e2a-9a17-67ba78f1cccf","Type":"ContainerDied","Data":"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"}
Jul 12 16:00:32.943039 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.942940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g" event={"ID":"a8efffd6-594b-4e2a-9a17-67ba78f1cccf","Type":"ContainerDied","Data":"a96774c6c72b0383add3fed57d9da6b8d8b194afd619dcefd6a825d7a9c9d0bc"}
Jul 12 16:00:32.943039 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.942962    2581 scope.go:117] "RemoveContainer" containerID="566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"
Jul 12 16:00:32.952538 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.952516    2581 scope.go:117] "RemoveContainer" containerID="566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"
Jul 12 16:00:32.952832 ip-10-0-128-199 kubenswrapper[2581]: E0712 16:00:32.952804    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8\": container with ID starting with 566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8 not found: ID does not exist" containerID="566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"
Jul 12 16:00:32.952880 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.952833    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8"} err="failed to get container status \"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8\": rpc error: code = NotFound desc = could not find container \"566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8\": container with ID starting with 566da04d3ec7be80fc973e85c5d9793877e65c94b75a9c6c2b45ed9cf3640aa8 not found: ID does not exist"
Jul 12 16:00:32.961851 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.961829    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 16:00:32.964397 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:32.964363    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/auth-test-model-3da434-kserve-d88f79455-nbc9g"]
Jul 12 16:00:34.848298 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:34.848264    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" path="/var/lib/kubelet/pods/a8efffd6-594b-4e2a-9a17-67ba78f1cccf/volumes"
Jul 12 16:00:57.200427 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.200300    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201041    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" containerName="main"
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201058    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" containerName="main"
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201069    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787d8595-1299-4654-96d2-2a1965389ab4" containerName="cleanup"
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201077    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="787d8595-1299-4654-96d2-2a1965389ab4" containerName="cleanup"
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201213    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8efffd6-594b-4e2a-9a17-67ba78f1cccf" containerName="main"
Jul 12 16:00:57.203024 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.201225    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="787d8595-1299-4654-96d2-2a1965389ab4" containerName="cleanup"
Jul 12 16:00:57.204749 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.204729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.208649 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.208625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"kube-root-ca.crt\""
Jul 12 16:00:57.208772 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.208631    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"openshift-service-ca.crt\""
Jul 12 16:00:57.210115 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.209899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"default-dockercfg-njf7m\""
Jul 12 16:00:57.210115 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.209916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3da434\"/\"sub-test-model-3da434-kserve-self-signed-certs\""
Jul 12 16:00:57.214992 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.214969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:00:57.240754 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.240924 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.240924 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr599\" (UniqueName: \"kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.241028 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.241028 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.241028 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.240976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.341838 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.341796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342029 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.341872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342029 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.341911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342135 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342135 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342135 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr599\" (UniqueName: \"kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342297 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342466 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.342555 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.342520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.344310 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.344284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.344771 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.344753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.349789 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.349767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr599\" (UniqueName: \"kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599\") pod \"sub-test-model-3da434-kserve-69cfb5c957-6bn7d\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") " pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.517095 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.517006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:00:57.660094 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:57.660065    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:00:57.661343 ip-10-0-128-199 kubenswrapper[2581]: W0712 16:00:57.661314    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c425fe0_7530_4409_9220_f651a6fcf100.slice/crio-fa6df0a29da5d1808e054b5e3a8f5767bf37531f45a866c5fdc1650d33a9820e WatchSource:0}: Error finding container fa6df0a29da5d1808e054b5e3a8f5767bf37531f45a866c5fdc1650d33a9820e: Status 404 returned error can't find the container with id fa6df0a29da5d1808e054b5e3a8f5767bf37531f45a866c5fdc1650d33a9820e
Jul 12 16:00:58.097817 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:58.097782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" event={"ID":"7c425fe0-7530-4409-9220-f651a6fcf100","Type":"ContainerStarted","Data":"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"}
Jul 12 16:00:58.098000 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:58.097831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" event={"ID":"7c425fe0-7530-4409-9220-f651a6fcf100","Type":"ContainerStarted","Data":"fa6df0a29da5d1808e054b5e3a8f5767bf37531f45a866c5fdc1650d33a9820e"}
Jul 12 16:00:58.115581 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:00:58.115529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" podStartSLOduration=1.11551277 podStartE2EDuration="1.11551277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:00:58.113319122 +0000 UTC m=+2435.813047898" watchObservedRunningTime="2026-07-12 16:00:58.11551277 +0000 UTC m=+2435.815241549"
Jul 12 16:01:07.517686 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:07.517632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:07.517686 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:07.517694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:07.530538 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:07.530510    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:08.174458 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:08.174425    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:40.678574 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:40.678527    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:01:52.483492 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.483455    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:01:52.487251 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.487233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.490879 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.490850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a99179\"/\"default-dockercfg-9jwlz\""
Jul 12 16:01:52.491009 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.490889    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a99179\"/\"kube-root-ca.crt\""
Jul 12 16:01:52.491009 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.490890    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a99179\"/\"openshift-service-ca.crt\""
Jul 12 16:01:52.491227 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.491201    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a99179\"/\"rate-test-model-a99179-kserve-self-signed-certs\""
Jul 12 16:01:52.495183 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.495158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:01:52.600203 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.600503 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.600503 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.600503 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4bm\" (UniqueName: \"kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.600503 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.600503 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.600346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701458 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701663 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4bm\" (UniqueName: \"kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701663 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701663 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701846 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.701846 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.701737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.702157 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.702130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.702253 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.702157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.702302 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.702269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.704007 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.703983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.704295 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.704278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.709113 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.709088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4bm\" (UniqueName: \"kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm\") pod \"rate-test-model-a99179-kserve-745989dcff-n5w6f\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") " pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.799890 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.799797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:01:52.942585 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:52.942555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:01:52.943555 ip-10-0-128-199 kubenswrapper[2581]: W0712 16:01:52.943526    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7dafb97_8fa4_4200_a640_3e11fd6f14d1.slice/crio-a1191e3f1de73fadd03cd78a4428f80894ad31a2dd5099a311c431f8a9e8dcc0 WatchSource:0}: Error finding container a1191e3f1de73fadd03cd78a4428f80894ad31a2dd5099a311c431f8a9e8dcc0: Status 404 returned error can't find the container with id a1191e3f1de73fadd03cd78a4428f80894ad31a2dd5099a311c431f8a9e8dcc0
Jul 12 16:01:53.448320 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:53.448274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" event={"ID":"e7dafb97-8fa4-4200-a640-3e11fd6f14d1","Type":"ContainerStarted","Data":"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"}
Jul 12 16:01:53.448565 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:53.448334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" event={"ID":"e7dafb97-8fa4-4200-a640-3e11fd6f14d1","Type":"ContainerStarted","Data":"a1191e3f1de73fadd03cd78a4428f80894ad31a2dd5099a311c431f8a9e8dcc0"}
Jul 12 16:01:53.465521 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:53.465465    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" podStartSLOduration=1.465451035 podStartE2EDuration="1.465451035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:01:53.464152549 +0000 UTC m=+2491.163881332" watchObservedRunningTime="2026-07-12 16:01:53.465451035 +0000 UTC m=+2491.165179813"
Jul 12 16:01:55.700539 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:55.700501    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" podUID="7c425fe0-7530-4409-9220-f651a6fcf100" containerName="main" containerID="cri-o://8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67" gracePeriod=45
Jul 12 16:01:55.967911 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:55.967885    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:56.035974 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.035939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036149 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.035992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036149 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036149 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr599\" (UniqueName: \"kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036149 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036103    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036410 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home\") pod \"7c425fe0-7530-4409-9220-f651a6fcf100\" (UID: \"7c425fe0-7530-4409-9220-f651a6fcf100\") "
Jul 12 16:01:56.036410 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036272    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:01:56.036564 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036486    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:01:56.036564 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036521    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home" (OuterVolumeSpecName: "home") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:01:56.036701 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036651    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-home\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.036701 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036694    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-model-cache\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.036801 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.036710    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-tmp-dir\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.038645 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.038620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599" (OuterVolumeSpecName: "kube-api-access-tr599") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "kube-api-access-tr599". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:01:56.038844 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.038819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm" (OuterVolumeSpecName: "dshm") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:01:56.038950 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.038858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c425fe0-7530-4409-9220-f651a6fcf100" (UID: "7c425fe0-7530-4409-9220-f651a6fcf100"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:01:56.137767 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.137724    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c425fe0-7530-4409-9220-f651a6fcf100-dshm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.137767 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.137761    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c425fe0-7530-4409-9220-f651a6fcf100-tls-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.137767 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.137771    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr599\" (UniqueName: \"kubernetes.io/projected/7c425fe0-7530-4409-9220-f651a6fcf100-kube-api-access-tr599\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:01:56.467728 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.467693    2581 generic.go:356] "Generic (PLEG): container finished" podID="7c425fe0-7530-4409-9220-f651a6fcf100" containerID="8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67" exitCode=0
Jul 12 16:01:56.467913 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.467734    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"
Jul 12 16:01:56.467913 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.467736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" event={"ID":"7c425fe0-7530-4409-9220-f651a6fcf100","Type":"ContainerDied","Data":"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"}
Jul 12 16:01:56.467913 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.467770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d" event={"ID":"7c425fe0-7530-4409-9220-f651a6fcf100","Type":"ContainerDied","Data":"fa6df0a29da5d1808e054b5e3a8f5767bf37531f45a866c5fdc1650d33a9820e"}
Jul 12 16:01:56.467913 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.467792    2581 scope.go:117] "RemoveContainer" containerID="8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"
Jul 12 16:01:56.478457 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.478438    2581 scope.go:117] "RemoveContainer" containerID="8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"
Jul 12 16:01:56.478758 ip-10-0-128-199 kubenswrapper[2581]: E0712 16:01:56.478734    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67\": container with ID starting with 8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67 not found: ID does not exist" containerID="8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"
Jul 12 16:01:56.478854 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.478764    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67"} err="failed to get container status \"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67\": rpc error: code = NotFound desc = could not find container \"8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67\": container with ID starting with 8ae467acc47732b16790394daad51569b4567f0d087cbd61e1d25f87a95ebd67 not found: ID does not exist"
Jul 12 16:01:56.489806 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.489779    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:01:56.492588 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.492570    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3da434/sub-test-model-3da434-kserve-69cfb5c957-6bn7d"]
Jul 12 16:01:56.851557 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:01:56.851524    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c425fe0-7530-4409-9220-f651a6fcf100" path="/var/lib/kubelet/pods/7c425fe0-7530-4409-9220-f651a6fcf100/volumes"
Jul 12 16:02:02.800364 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:02.800332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:02:02.800896 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:02.800591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:02:02.813240 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:02.813211    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:02:03.520116 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:03.520085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:02:54.305805 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:54.305772    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:02:56.742081 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:56.742044    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 16:02:56.742914 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:56.742877    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" podUID="b1614c3d-28d2-4883-91a6-617333d813ad" containerName="maas-api" containerID="cri-o://d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e" gracePeriod=30
Jul 12 16:02:56.996634 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:56.996561    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 16:02:57.066593 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.066555    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nld4d\" (UniqueName: \"kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d\") pod \"b1614c3d-28d2-4883-91a6-617333d813ad\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") "
Jul 12 16:02:57.066775 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.066661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca\") pod \"b1614c3d-28d2-4883-91a6-617333d813ad\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") "
Jul 12 16:02:57.066775 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.066704    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls\") pod \"b1614c3d-28d2-4883-91a6-617333d813ad\" (UID: \"b1614c3d-28d2-4883-91a6-617333d813ad\") "
Jul 12 16:02:57.067031 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.067005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1614c3d-28d2-4883-91a6-617333d813ad" (UID: "b1614c3d-28d2-4883-91a6-617333d813ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:02:57.068880 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.068859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1614c3d-28d2-4883-91a6-617333d813ad" (UID: "b1614c3d-28d2-4883-91a6-617333d813ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:02:57.068950 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.068898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d" (OuterVolumeSpecName: "kube-api-access-nld4d") pod "b1614c3d-28d2-4883-91a6-617333d813ad" (UID: "b1614c3d-28d2-4883-91a6-617333d813ad"). InnerVolumeSpecName "kube-api-access-nld4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:02:57.168406 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.168337    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1614c3d-28d2-4883-91a6-617333d813ad-openshift-service-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:02:57.168406 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.168369    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1614c3d-28d2-4883-91a6-617333d813ad-maas-api-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:02:57.168406 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.168408    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nld4d\" (UniqueName: \"kubernetes.io/projected/b1614c3d-28d2-4883-91a6-617333d813ad-kube-api-access-nld4d\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:02:57.831343 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.831306    2581 generic.go:356] "Generic (PLEG): container finished" podID="b1614c3d-28d2-4883-91a6-617333d813ad" containerID="d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e" exitCode=0
Jul 12 16:02:57.832242 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.831359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"
Jul 12 16:02:57.832242 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.831368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" event={"ID":"b1614c3d-28d2-4883-91a6-617333d813ad","Type":"ContainerDied","Data":"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"}
Jul 12 16:02:57.832242 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.831439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r" event={"ID":"b1614c3d-28d2-4883-91a6-617333d813ad","Type":"ContainerDied","Data":"9481ecf009b33398fcd308c8d32f6f11b037f71e83595d4d4df0920f76974684"}
Jul 12 16:02:57.832242 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.831477    2581 scope.go:117] "RemoveContainer" containerID="d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"
Jul 12 16:02:57.842215 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.842196    2581 scope.go:117] "RemoveContainer" containerID="d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"
Jul 12 16:02:57.842524 ip-10-0-128-199 kubenswrapper[2581]: E0712 16:02:57.842504    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e\": container with ID starting with d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e not found: ID does not exist" containerID="d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"
Jul 12 16:02:57.842589 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.842534    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e"} err="failed to get container status \"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e\": rpc error: code = NotFound desc = could not find container \"d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e\": container with ID starting with d96dfdabc929ddaff1e67785c57fffcf711d5f1f2744d5a1468fc8f09cfefd1e not found: ID does not exist"
Jul 12 16:02:57.854793 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.854771    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 16:02:57.857965 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:57.857945    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a99179-7b98d5d99b-ch58r"]
Jul 12 16:02:58.848056 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:02:58.848028    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1614c3d-28d2-4883-91a6-617333d813ad" path="/var/lib/kubelet/pods/b1614c3d-28d2-4883-91a6-617333d813ad/volumes"
Jul 12 16:03:09.327672 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.327602    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" podUID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" containerName="main" containerID="cri-o://8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324" gracePeriod=45
Jul 12 16:03:09.583997 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.583939    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:03:09.689863 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.689828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690053 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.689872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz4bm\" (UniqueName: \"kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690053 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.689909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690053 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.689958    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690053 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690305 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home\") pod \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\" (UID: \"e7dafb97-8fa4-4200-a640-3e11fd6f14d1\") "
Jul 12 16:03:09.690305 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:03:09.690305 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690208    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:03:09.690491 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690397    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home" (OuterVolumeSpecName: "home") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:03:09.690576 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690556    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tmp-dir\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.690633 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690581    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-model-cache\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.690633 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.690594    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-home\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.692295 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.692271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm" (OuterVolumeSpecName: "dshm") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:03:09.692405 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.692351    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:03:09.692480 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.692460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm" (OuterVolumeSpecName: "kube-api-access-mz4bm") pod "e7dafb97-8fa4-4200-a640-3e11fd6f14d1" (UID: "e7dafb97-8fa4-4200-a640-3e11fd6f14d1"). InnerVolumeSpecName "kube-api-access-mz4bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:03:09.791841 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.791806    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz4bm\" (UniqueName: \"kubernetes.io/projected/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-kube-api-access-mz4bm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.791841 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.791838    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-dshm\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.791841 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.791849    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dafb97-8fa4-4200-a640-3e11fd6f14d1-tls-certs\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\""
Jul 12 16:03:09.907919 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.907886    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" containerID="8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324" exitCode=0
Jul 12 16:03:09.908133 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.907990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" event={"ID":"e7dafb97-8fa4-4200-a640-3e11fd6f14d1","Type":"ContainerDied","Data":"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"}
Jul 12 16:03:09.908133 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.908002    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"
Jul 12 16:03:09.908133 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.908027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f" event={"ID":"e7dafb97-8fa4-4200-a640-3e11fd6f14d1","Type":"ContainerDied","Data":"a1191e3f1de73fadd03cd78a4428f80894ad31a2dd5099a311c431f8a9e8dcc0"}
Jul 12 16:03:09.908133 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.908047    2581 scope.go:117] "RemoveContainer" containerID="8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"
Jul 12 16:03:09.919361 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.919337    2581 scope.go:117] "RemoveContainer" containerID="8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"
Jul 12 16:03:09.919670 ip-10-0-128-199 kubenswrapper[2581]: E0712 16:03:09.919647    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324\": container with ID starting with 8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324 not found: ID does not exist" containerID="8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"
Jul 12 16:03:09.919731 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.919679    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324"} err="failed to get container status \"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324\": rpc error: code = NotFound desc = could not find container \"8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324\": container with ID starting with 8dce47fe04ed21bc827f4ae572d40b7bd2913e8988b6db22d9715f51fd590324 not found: ID does not exist"
Jul 12 16:03:09.930332 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.930298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:03:09.932999 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:09.932980    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a99179/rate-test-model-a99179-kserve-745989dcff-n5w6f"]
Jul 12 16:03:10.848812 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:10.848780    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" path="/var/lib/kubelet/pods/e7dafb97-8fa4-4200-a640-3e11fd6f14d1/volumes"
Jul 12 16:03:50.586839 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:50.586764    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m69zx_5b52583a-d209-4f01-872b-48f6c2d9611b/manager/0.log"
Jul 12 16:03:50.698462 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:50.698432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ctr9c_a8f5ba4d-377c-4518-84db-b17cb37e7769/manager/0.log"
Jul 12 16:03:50.812136 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:50.812102    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b9df6c7bd-684qd_fd2f5e2f-da10-4b34-8b48-3ba24127d826/maas-api/0.log"
Jul 12 16:03:51.027255 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.027224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29731200-xdtk6_787d8595-1299-4654-96d2-2a1965389ab4/cleanup/0.log"
Jul 12 16:03:51.145971 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.145941    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5557ccbdc6-4wxvt_5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9/manager/0.log"
Jul 12 16:03:51.259993 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.259969    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pgrht_02bb3645-c869-4c48-81a5-f1edfbb02c99/server/0.log"
Jul 12 16:03:51.372688 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.372657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5rfsc_0bf1aad0-0e43-47df-907b-64a77a8c66e4/manager/0.log"
Jul 12 16:03:51.589190 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.589160    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7558dcb54-htdxv_a3bc07cb-2dd1-4e51-a86b-f958c429ddc5/copy-manifests/0.log"
Jul 12 16:03:51.594646 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:51.594626    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7558dcb54-htdxv_a3bc07cb-2dd1-4e51-a86b-f958c429ddc5/manager/0.log"
Jul 12 16:03:52.570292 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.570257    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/util/0.log"
Jul 12 16:03:52.576624 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.576602    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/pull/0.log"
Jul 12 16:03:52.582076 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.582052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/extract/0.log"
Jul 12 16:03:52.688766 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.688719    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/pull/0.log"
Jul 12 16:03:52.694298 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.694279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/extract/0.log"
Jul 12 16:03:52.699435 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.699419    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/util/0.log"
Jul 12 16:03:52.820671 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.820593    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/util/0.log"
Jul 12 16:03:52.827065 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.827035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/pull/0.log"
Jul 12 16:03:52.833107 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.833087    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/extract/0.log"
Jul 12 16:03:52.942304 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.942278    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/util/0.log"
Jul 12 16:03:52.948448 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.948424    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/pull/0.log"
Jul 12 16:03:52.954280 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:52.954261    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/extract/0.log"
Jul 12 16:03:53.187744 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:53.187712    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9f8jd_958650e1-8acf-42b2-9368-99837f6ea265/manager/0.log"
Jul 12 16:03:53.299964 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:53.299938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fz9sg_6954ce14-7957-420b-9ff4-ce5d0e0c96d1/manager/0.log"
Jul 12 16:03:53.403372 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:53.403344    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7bkwf_90104e71-f354-406c-8a81-d78d8332c946/kuadrant-console-plugin/0.log"
Jul 12 16:03:53.516301 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:53.516222    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-478tw_e9bb1f5e-cf65-496a-b699-62c8109931a1/registry-server/0.log"
Jul 12 16:03:53.865798 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:53.865763    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fr4mb_2b2272b2-489a-4401-afdb-0a8e266bf43e/manager/0.log"
Jul 12 16:03:54.198213 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.198105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48p8r7_85f43457-02e5-40fe-ab81-5a3ae5e7f0c1/istio-proxy/0.log"
Jul 12 16:03:54.412781 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.412755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fb64c5677-5r622_8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9/kube-auth-proxy/0.log"
Jul 12 16:03:54.634848 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.634818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/1.log"
Jul 12 16:03:54.749675 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.749645    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hxqnj_9e7d62be-9f0c-49f1-a061-e95428610ab5/payload-pre-processing/0.log"
Jul 12 16:03:54.861483 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.861441    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2vrw7_e49d243b-6e2c-4c0e-aa46-973d1f241a73/payload-processing/0.log"
Jul 12 16:03:54.966521 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:54.966445    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c5d54b844-nzqwh_840cc992-4ed5-4816-a199-826fd2a24a5c/router/0.log"
Jul 12 16:03:55.294172 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:55.294093    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z26jv_c520d855-9797-414e-9362-973e0eaad406/main/0.log"
Jul 12 16:03:55.514533 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:55.514500    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-96gqf_79adb24e-cab8-4054-b2e4-4165f2af10ff/main/0.log"
Jul 12 16:03:55.839444 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:03:55.839391    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nvpz4_5ff082e9-4ff3-4f51-a747-c23592f50888/main/0.log"
Jul 12 16:04:02.796172 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:02.796132    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gtfj4_7f3cd987-8bf0-4709-bab2-356b6554c845/global-pull-secret-syncer/0.log"
Jul 12 16:04:02.968165 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:02.968124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vgh2w_58936986-6fdf-4528-9b34-8a0f5ee62e48/konnectivity-agent/0.log"
Jul 12 16:04:02.987331 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:02.987298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-199.ec2.internal_9a49ac858e8c63dd08ec6b65adc4b376/haproxy/0.log"
Jul 12 16:04:07.701498 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.701467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/extract/0.log"
Jul 12 16:04:07.728054 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.728025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/util/0.log"
Jul 12 16:04:07.747602 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.747579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592646g_2fc1edb2-1921-4907-8883-d22c1ff96a4e/pull/0.log"
Jul 12 16:04:07.771957 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.771928    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/extract/0.log"
Jul 12 16:04:07.797196 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.797175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/util/0.log"
Jul 12 16:04:07.818202 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.818177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ckvzj_b3a85142-e7be-4722-b7a6-87aae572fe73/pull/0.log"
Jul 12 16:04:07.858021 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.857977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/extract/0.log"
Jul 12 16:04:07.883730 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.883698    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/util/0.log"
Jul 12 16:04:07.910478 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.910449    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ghbsj_956a3703-4259-4c51-8fb3-33d8aef6d6d7/pull/0.log"
Jul 12 16:04:07.948320 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.948296    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/extract/0.log"
Jul 12 16:04:07.972073 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.972015    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/util/0.log"
Jul 12 16:04:07.992884 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:07.992861    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1snn7k_b713a4b2-3d02-4193-91c1-8e5fcaa29815/pull/0.log"
Jul 12 16:04:08.497234 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:08.497204    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9f8jd_958650e1-8acf-42b2-9368-99837f6ea265/manager/0.log"
Jul 12 16:04:08.534711 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:08.534679    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fz9sg_6954ce14-7957-420b-9ff4-ce5d0e0c96d1/manager/0.log"
Jul 12 16:04:08.567820 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:08.567797    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7bkwf_90104e71-f354-406c-8a81-d78d8332c946/kuadrant-console-plugin/0.log"
Jul 12 16:04:08.607449 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:08.607420    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-478tw_e9bb1f5e-cf65-496a-b699-62c8109931a1/registry-server/0.log"
Jul 12 16:04:08.883671 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:08.883638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fr4mb_2b2272b2-489a-4401-afdb-0a8e266bf43e/manager/0.log"
Jul 12 16:04:10.545299 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.545262    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/alertmanager/0.log"
Jul 12 16:04:10.575952 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.575923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/config-reloader/0.log"
Jul 12 16:04:10.596662 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.596641    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/kube-rbac-proxy-web/0.log"
Jul 12 16:04:10.619149 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.619125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/kube-rbac-proxy/0.log"
Jul 12 16:04:10.638019 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.637995    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/kube-rbac-proxy-metric/0.log"
Jul 12 16:04:10.657244 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.657187    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/prom-label-proxy/0.log"
Jul 12 16:04:10.685768 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.685745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfeffddc-730c-4865-ade4-c50c9e192273/init-config-reloader/0.log"
Jul 12 16:04:10.898418 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:10.898369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6nzpn_e7d7c291-642c-46e9-b047-bd86ec69df7d/monitoring-plugin/0.log"
Jul 12 16:04:11.072249 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.072135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhd84_61b90ba5-b261-4ae1-96e1-e00ff69014d1/node-exporter/0.log"
Jul 12 16:04:11.094071 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.094045    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhd84_61b90ba5-b261-4ae1-96e1-e00ff69014d1/kube-rbac-proxy/0.log"
Jul 12 16:04:11.113496 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.113469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhd84_61b90ba5-b261-4ae1-96e1-e00ff69014d1/init-textfile/0.log"
Jul 12 16:04:11.491127 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.491078    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8hrzr_85a3940d-627b-41c4-ba26-6c9367e2bae6/prometheus-operator/0.log"
Jul 12 16:04:11.510543 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.510517    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8hrzr_85a3940d-627b-41c4-ba26-6c9367e2bae6/kube-rbac-proxy/0.log"
Jul 12 16:04:11.572869 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.572839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794495bcd6-bl4kt_947a9dc1-3770-4533-adcd-4615379fe7de/telemeter-client/0.log"
Jul 12 16:04:11.595688 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.595661    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794495bcd6-bl4kt_947a9dc1-3770-4533-adcd-4615379fe7de/reload/0.log"
Jul 12 16:04:11.617462 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.617434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794495bcd6-bl4kt_947a9dc1-3770-4533-adcd-4615379fe7de/kube-rbac-proxy/0.log"
Jul 12 16:04:11.663514 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.663483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/thanos-query/0.log"
Jul 12 16:04:11.685970 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.685944    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/kube-rbac-proxy-web/0.log"
Jul 12 16:04:11.707093 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.707064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/kube-rbac-proxy/0.log"
Jul 12 16:04:11.727229 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.727208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/prom-label-proxy/0.log"
Jul 12 16:04:11.764091 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.763995    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/kube-rbac-proxy-rules/0.log"
Jul 12 16:04:11.783725 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:11.783695    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66965f85d8-g98f6_e4b5d08c-3243-4a58-980d-5518c209cde1/kube-rbac-proxy-metrics/0.log"
Jul 12 16:04:13.526085 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526053    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"]
Jul 12 16:04:13.526706 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526683    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1614c3d-28d2-4883-91a6-617333d813ad" containerName="maas-api"
Jul 12 16:04:13.526706 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1614c3d-28d2-4883-91a6-617333d813ad" containerName="maas-api"
Jul 12 16:04:13.526865 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526714    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c425fe0-7530-4409-9220-f651a6fcf100" containerName="main"
Jul 12 16:04:13.526865 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526719    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c425fe0-7530-4409-9220-f651a6fcf100" containerName="main"
Jul 12 16:04:13.526865 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526756    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" containerName="main"
Jul 12 16:04:13.526865 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526761    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" containerName="main"
Jul 12 16:04:13.527046 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526872    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1614c3d-28d2-4883-91a6-617333d813ad" containerName="maas-api"
Jul 12 16:04:13.527046 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526884    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c425fe0-7530-4409-9220-f651a6fcf100" containerName="main"
Jul 12 16:04:13.527046 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.526892    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7dafb97-8fa4-4200-a640-3e11fd6f14d1" containerName="main"
Jul 12 16:04:13.530336 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.530320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.532724 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.532707    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nth9q\"/\"kube-root-ca.crt\""
Jul 12 16:04:13.533759 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.533745    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nth9q\"/\"default-dockercfg-p7gsx\""
Jul 12 16:04:13.533814 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.533753    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nth9q\"/\"openshift-service-ca.crt\""
Jul 12 16:04:13.543113 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.541252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"]
Jul 12 16:04:13.621968 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.621932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-proc\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.622169 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.622045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-podres\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.622169 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.622069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-sys\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.622169 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.622138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkrlm\" (UniqueName: \"kubernetes.io/projected/02d6e45b-8328-4205-9a81-65dae7393403-kube-api-access-rkrlm\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.622327 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.622191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-lib-modules\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723420 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-podres\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723420 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-sys\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkrlm\" (UniqueName: \"kubernetes.io/projected/02d6e45b-8328-4205-9a81-65dae7393403-kube-api-access-rkrlm\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-lib-modules\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-proc\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-podres\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-sys\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723667 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-lib-modules\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.723889 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.723680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d6e45b-8328-4205-9a81-65dae7393403-proc\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.731553 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.731531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkrlm\" (UniqueName: \"kubernetes.io/projected/02d6e45b-8328-4205-9a81-65dae7393403-kube-api-access-rkrlm\") pod \"perf-node-gather-daemonset-t2zdc\" (UID: \"02d6e45b-8328-4205-9a81-65dae7393403\") " pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.841923 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.841835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:13.982415 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:13.982388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"]
Jul 12 16:04:13.983448 ip-10-0-128-199 kubenswrapper[2581]: W0712 16:04:13.983415    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02d6e45b_8328_4205_9a81_65dae7393403.slice/crio-713e2d201c9677df9a1e301eb63ab9e3008b73d99873f1d8effd574aae157fd6 WatchSource:0}: Error finding container 713e2d201c9677df9a1e301eb63ab9e3008b73d99873f1d8effd574aae157fd6: Status 404 returned error can't find the container with id 713e2d201c9677df9a1e301eb63ab9e3008b73d99873f1d8effd574aae157fd6
Jul 12 16:04:14.140328 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:14.140297    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6578d6b7bf-f59rc_199be704-df2e-46cc-b530-efc67e7f4e55/console/0.log"
Jul 12 16:04:14.293351 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:14.293314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc" event={"ID":"02d6e45b-8328-4205-9a81-65dae7393403","Type":"ContainerStarted","Data":"0d26f724259be2ab44512e1344216877ec39c1962e8e21006c54c3b13e188fc1"}
Jul 12 16:04:14.293535 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:14.293396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc" event={"ID":"02d6e45b-8328-4205-9a81-65dae7393403","Type":"ContainerStarted","Data":"713e2d201c9677df9a1e301eb63ab9e3008b73d99873f1d8effd574aae157fd6"}
Jul 12 16:04:14.293535 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:14.293426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:14.309532 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:14.309481    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc" podStartSLOduration=1.3094651210000001 podStartE2EDuration="1.309465121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:04:14.307118738 +0000 UTC m=+2632.006847518" watchObservedRunningTime="2026-07-12 16:04:14.309465121 +0000 UTC m=+2632.009193900"
Jul 12 16:04:15.773835 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:15.773802    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h65rm_cb6e1548-b802-47e4-af2d-bf6c19691a7e/dns/0.log"
Jul 12 16:04:15.793661 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:15.793634    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h65rm_cb6e1548-b802-47e4-af2d-bf6c19691a7e/kube-rbac-proxy/0.log"
Jul 12 16:04:15.835032 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:15.835006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69hkn_b7e21e19-9e0e-42fe-9064-82fbadfa5102/dns-node-resolver/0.log"
Jul 12 16:04:16.435697 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:16.435665    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86dddbc9f6-jmntg_e4eb3196-0e36-4497-8ee0-1555fad51808/registry/0.log"
Jul 12 16:04:16.546231 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:16.546204    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq5x6_dd4a9417-10bf-4e2e-8fc9-a5500cdf44e5/node-ca/0.log"
Jul 12 16:04:17.490787 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.490759    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48p8r7_85f43457-02e5-40fe-ab81-5a3ae5e7f0c1/istio-proxy/0.log"
Jul 12 16:04:17.616817 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.616772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fb64c5677-5r622_8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9/kube-auth-proxy/0.log"
Jul 12 16:04:17.667019 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.666985    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/0.log"
Jul 12 16:04:17.693958 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.693925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/1.log"
Jul 12 16:04:17.722329 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.722295    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hxqnj_9e7d62be-9f0c-49f1-a061-e95428610ab5/payload-pre-processing/0.log"
Jul 12 16:04:17.766760 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.766677    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2vrw7_e49d243b-6e2c-4c0e-aa46-973d1f241a73/payload-processing/0.log"
Jul 12 16:04:17.788892 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:17.788863    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c5d54b844-nzqwh_840cc992-4ed5-4816-a199-826fd2a24a5c/router/0.log"
Jul 12 16:04:18.504590 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:18.504557    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4xvb_57889e21-296d-4e58-98d7-847374c2d221/serve-healthcheck-canary/0.log"
Jul 12 16:04:18.920951 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:18.920919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pw7mv_8fffdf3f-a241-48ee-b5f0-2b0e50a384d8/insights-operator/0.log"
Jul 12 16:04:18.921293 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:18.921276    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pw7mv_8fffdf3f-a241-48ee-b5f0-2b0e50a384d8/insights-operator/1.log"
Jul 12 16:04:19.002491 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:19.002463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ccf54_32bd4e7f-f2d9-4e60-b448-f89c7af81b6b/kube-rbac-proxy/0.log"
Jul 12 16:04:19.022604 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:19.022573    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ccf54_32bd4e7f-f2d9-4e60-b448-f89c7af81b6b/exporter/0.log"
Jul 12 16:04:19.043710 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:19.043686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ccf54_32bd4e7f-f2d9-4e60-b448-f89c7af81b6b/extractor/0.log"
Jul 12 16:04:20.309715 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:20.309685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nth9q/perf-node-gather-daemonset-t2zdc"
Jul 12 16:04:21.182824 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.182793    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m69zx_5b52583a-d209-4f01-872b-48f6c2d9611b/manager/0.log"
Jul 12 16:04:21.308620 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.308579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ctr9c_a8f5ba4d-377c-4518-84db-b17cb37e7769/manager/0.log"
Jul 12 16:04:21.341582 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.341552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b9df6c7bd-684qd_fd2f5e2f-da10-4b34-8b48-3ba24127d826/maas-api/0.log"
Jul 12 16:04:21.380415 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.380356    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29731200-xdtk6_787d8595-1299-4654-96d2-2a1965389ab4/cleanup/0.log"
Jul 12 16:04:21.475360 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.475261    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5557ccbdc6-4wxvt_5d0ec8a4-2afe-4e80-8bf7-ee28ccd4f6a9/manager/0.log"
Jul 12 16:04:21.492226 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.492198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pgrht_02bb3645-c869-4c48-81a5-f1edfbb02c99/server/0.log"
Jul 12 16:04:21.554780 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.554752    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5rfsc_0bf1aad0-0e43-47df-907b-64a77a8c66e4/manager/0.log"
Jul 12 16:04:21.631790 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.631744    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7558dcb54-htdxv_a3bc07cb-2dd1-4e51-a86b-f958c429ddc5/manager/0.log"
Jul 12 16:04:21.652357 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:21.652333    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7558dcb54-htdxv_a3bc07cb-2dd1-4e51-a86b-f958c429ddc5/copy-manifests/0.log"
Jul 12 16:04:23.294135 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:23.294112    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-84fj5_8e2bf27c-d8e5-44b7-b211-3bd5811af0b8/openshift-lws-operator/0.log"
Jul 12 16:04:24.024841 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.024734    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48p8r7_85f43457-02e5-40fe-ab81-5a3ae5e7f0c1/istio-proxy/0.log"
Jul 12 16:04:24.128865 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.128834    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fb64c5677-5r622_8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9/kube-auth-proxy/0.log"
Jul 12 16:04:24.159803 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.159772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/0.log"
Jul 12 16:04:24.185069 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.185040    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/1.log"
Jul 12 16:04:24.206008 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.205981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hxqnj_9e7d62be-9f0c-49f1-a061-e95428610ab5/payload-pre-processing/0.log"
Jul 12 16:04:24.245458 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.245427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2vrw7_e49d243b-6e2c-4c0e-aa46-973d1f241a73/payload-processing/0.log"
Jul 12 16:04:24.257333 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:24.257312    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c5d54b844-nzqwh_840cc992-4ed5-4816-a199-826fd2a24a5c/router/0.log"
Jul 12 16:04:25.442286 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.442241    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48p8r7_85f43457-02e5-40fe-ab81-5a3ae5e7f0c1/istio-proxy/0.log"
Jul 12 16:04:25.562536 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.562500    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fb64c5677-5r622_8c1c1159-d8ba-48d5-8c4a-6c9d29171cf9/kube-auth-proxy/0.log"
Jul 12 16:04:25.604051 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.604025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/0.log"
Jul 12 16:04:25.631011 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.630979    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njqkl_22c55df5-8067-42bf-bc79-38b63aa2b082/istio-proxy/1.log"
Jul 12 16:04:25.653922 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.653897    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hxqnj_9e7d62be-9f0c-49f1-a061-e95428610ab5/payload-pre-processing/0.log"
Jul 12 16:04:25.692254 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.692176    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2vrw7_e49d243b-6e2c-4c0e-aa46-973d1f241a73/payload-processing/0.log"
Jul 12 16:04:25.704590 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:25.704564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c5d54b844-nzqwh_840cc992-4ed5-4816-a199-826fd2a24a5c/router/0.log"
Jul 12 16:04:28.587863 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:28.587827    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-czl4g_0cec0eef-624e-4d4f-b07b-28dcbec1e979/kube-storage-version-migrator-operator/1.log"
Jul 12 16:04:28.588534 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:28.588511    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-czl4g_0cec0eef-624e-4d4f-b07b-28dcbec1e979/kube-storage-version-migrator-operator/0.log"
Jul 12 16:04:29.773480 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.773443    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/kube-multus-additional-cni-plugins/0.log"
Jul 12 16:04:29.791660 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.791631    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/egress-router-binary-copy/0.log"
Jul 12 16:04:29.810785 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.810755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/cni-plugins/0.log"
Jul 12 16:04:29.828829 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.828807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/bond-cni-plugin/0.log"
Jul 12 16:04:29.846709 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.846689    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/routeoverride-cni/0.log"
Jul 12 16:04:29.865514 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.865484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/whereabouts-cni-bincopy/0.log"
Jul 12 16:04:29.883524 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.883500    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7rpq_a259dbfb-9702-463e-8a59-e9e019cbd73d/whereabouts-cni/0.log"
Jul 12 16:04:29.952061 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:29.952031    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rmxb9_f442bd45-c165-4613-bb5e-f7cab3b6c00b/kube-multus/0.log"
Jul 12 16:04:30.052181 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:30.052106    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gm2r8_7a2452ce-e603-4061-9cdf-baedd16ad299/network-metrics-daemon/0.log"
Jul 12 16:04:30.069877 ip-10-0-128-199 kubenswrapper[2581]: I0712 16:04:30.069852    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gm2r8_7a2452ce-e603-4061-9cdf-baedd16ad299/kube-rbac-proxy/0.log"