Jul 29 08:45:57.095394 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 08:45:57.095405 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 08:45:57.095412 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 08:45:57.095691 ip-10-0-133-190 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 08:46:07.156461 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 08:46:07.156482 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c147e4c1de1549938def702705e9389f --
Jul 29 08:47:40.456594 ip-10-0-133-190 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 08:47:40.906607 ip-10-0-133-190 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:40.906607 ip-10-0-133-190 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 08:47:40.906607 ip-10-0-133-190 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:40.906607 ip-10-0-133-190 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 08:47:40.906607 ip-10-0-133-190 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:40.907771 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.907681    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 08:47:40.912687 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912672    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.912687 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912688    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912692    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912696    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912699    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912702    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912704    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912707    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912710    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912713    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912716    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912720    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912724    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912728    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912731    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912734    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912737    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912739    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912742    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912745    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912748    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.912758 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912751    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912754    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912757    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912760    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912763    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912766    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912769    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912777    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912780    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912783    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912786    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912789    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912791    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912794    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912797    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912801    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912803    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912806    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912808    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912811    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.913241 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912813    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912816    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912818    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912821    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912823    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912826    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912828    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912831    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912833    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912836    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912838    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912841    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912844    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912846    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912849    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912852    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912855    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912864    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912866    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912869    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.913751 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912871    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912880    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912883    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912886    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912889    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912891    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912894    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912896    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912899    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912902    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912904    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912907    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912909    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912913    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912915    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912918    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912920    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912923    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912925    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.914252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912929    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912932    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912936    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912939    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912942    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912945    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912947    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912951    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912954    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912987    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912990    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912993    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912996    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.912999    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913002    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913005    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913008    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913011    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913015    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.914772 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913742    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913749    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913752    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913755    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913758    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913761    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913763    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913767    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913769    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913772    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913775    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913777    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913780    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913782    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913785    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913788    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913791    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913793    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913796    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913798    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.915244 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913801    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913805    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913809    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913812    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913815    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913817    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913820    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913822    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913827    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913830    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913833    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913836    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913839    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913842    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913844    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913847    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913849    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913853    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913855    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.915764 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913858    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913860    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913863    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913865    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913868    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913870    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913873    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913875    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913878    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913881    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913883    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913886    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913888    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913892    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913896    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913898    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913901    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913904    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913907    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913909    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.916220 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913912    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913914    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913917    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913919    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913922    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913924    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913927    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913930    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913932    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913935    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913938    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913940    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913943    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913946    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913948    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913951    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913953    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913956    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913959    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913962    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.916716 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913964    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913968    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913970    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913973    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913975    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913978    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913981    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913983    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913988    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913990    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913993    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913995    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.913998    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914000    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914003    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914005    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914007    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914012    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914015    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.917213 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914018    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914410    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914415    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914418    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914421    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914423    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914426    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914429    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914431    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914434    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914437    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914440    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914444    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914447    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914450    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914453    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914456    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914458    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914463    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914466    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.917701 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914469    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914472    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914474    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914477    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914479    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914482    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914485    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914489    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914492    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914495    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914498    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914501    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914504    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914507    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914510    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914512    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914515    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914518    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914521    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.918252 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914524    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914526    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914530    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914533    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914536    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914538    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914541    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914543    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914547    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914550    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914552    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914556    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914559    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914561    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914564    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914566    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914569    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914571    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914574    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914576    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.918754 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914579    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914581    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914584    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914586    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914589    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914591    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914594    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914596    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914599    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914601    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914603    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914606    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914608    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914611    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914613    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914616    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914619    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914622    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914624    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914627    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.919269 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914629    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914632    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914635    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914640    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914642    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914645    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914649    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914651    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914654    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914657    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914659    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914662    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914664    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914667    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914670    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914672    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914675    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914677    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914680    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.919801 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914682    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.914685    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914758    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914769    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914777    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914783    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914789    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914795    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914801    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914808    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914812    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914815    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914819    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914822    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914825    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914829    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914832    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914836    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914838    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914841    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914846    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914848    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914851    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914855    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 08:47:40.920283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914858    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914861    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914864    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914867    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914870    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914873    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914876    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914879    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914882    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914885    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914906    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914908    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914911    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914914    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914917    2573 flags.go:64] FLAG: --enable-server="true"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914922    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914927    2573 flags.go:64] FLAG: --event-burst="100"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914930    2573 flags.go:64] FLAG: --event-qps="50"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914933    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914936    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914939    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914943    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914946    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914949    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914953    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 29 08:47:40.920880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914956    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914959    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914962    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914965    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914968    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914971    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914974    2573 flags.go:64] FLAG: --feature-gates=""
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914978    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914981    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914984    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914987    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914990    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914993    2573 flags.go:64] FLAG: --help="false"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914996    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-133-190.ec2.internal"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.914999    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915002    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915005    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915008    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915011    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915014    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915017    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915020    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915024    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 08:47:40.921503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915028    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915031    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915033    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915036    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915039    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915042    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915045    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915048    2573 flags.go:64] FLAG: --lock-file=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915051    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915055    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915058    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915064    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915067    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915070    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915072    2573 flags.go:64] FLAG: --logging-format="text"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915075    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915078    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915081    2573 flags.go:64] FLAG: --manifest-url=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915084    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915088    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915091    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915095    2573 flags.go:64] FLAG: --max-pods="110"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915098    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915102    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915104    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 08:47:40.922114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915107    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915110    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915113    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915116    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915123    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915126    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915130    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915133    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915136    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915141    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915144    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915147    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915150    2573 flags.go:64] FLAG: --port="10250"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915153    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915156    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f12d52bed375435"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915159    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915162    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915166    2573 flags.go:64] FLAG: --register-node="true"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915169    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915172    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915175    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915178    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915181    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915184    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915187    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 08:47:40.922744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915190    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915193    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915196    2573 flags.go:64] FLAG: --runonce="false"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915199    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915202    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915204    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915207    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915210    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915213    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915216    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915219    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915221    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915224    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915229    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915233    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915236    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915239    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915242    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915247    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915250    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915253    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915257    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915260    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915263    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915266    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 08:47:40.923404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915270    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915273    2573 flags.go:64] FLAG: --v="2"
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915276    2573 flags.go:64] FLAG: --version="false"
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915280    2573 flags.go:64] FLAG: --vmodule=""
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915284    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.915287    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915415    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915419    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915422    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915425    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915428    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915431    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915433    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915438    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915441    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915444    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915447    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915450    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915452    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915455    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.924012 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915458    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915462    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915465    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915467    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915471    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915474    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915476    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915479    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915482    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915484    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915487    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915490    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915492    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915495    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915498    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915502    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915506    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915509    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915512    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.924511 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915514    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915517    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915520    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915522    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915525    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915527    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915530    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915533    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915535    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915538    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915540    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915543    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915545    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915548    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915553    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915557    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915560    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915563    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915565    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915568    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.925005 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915571    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915574    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915576    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915579    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915581    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915584    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915586    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915589    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915592    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915595    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915598    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915601    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915603    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915606    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915619    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915623    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915626    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915628    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915631    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915634    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.925503 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915637    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915640    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915643    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915645    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915648    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915651    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915655    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915658    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915660    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915663    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915666    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915668    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915671    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915674    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915676    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915679    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915681    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915684    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915686    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915689    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.925982 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915692    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915695    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915697    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915700    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915703    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.915705    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.916475    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.923785    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.923802    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.924649    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.924657    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924726    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924732    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924735    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924738    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.926490 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924740    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924743    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924746    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924749    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924751    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924754    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924757    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924759    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924762    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924764    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924767    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924770    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924772    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924775    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924777    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924780    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924783    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924791    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924794    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924796    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.926858 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924799    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924802    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924804    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924807    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924809    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924814    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924818    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924821    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924824    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924827    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924830    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924833    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924835    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924840    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924844    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924846    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924849    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924852    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924855    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.927362 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924858    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924861    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924863    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924866    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924870    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924880    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924883    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924886    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924888    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924891    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924894    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924902    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924905    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924908    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924911    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924914    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924916    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924919    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924922    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924924    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.927829 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924927    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924930    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924932    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924935    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924937    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924940    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924942    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924945    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924947    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924950    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924953    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924955    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924958    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924960    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924963    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924965    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924967    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924970    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924973    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924975    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.928354 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924978    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924980    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924983    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924986    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.924994    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925000    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925003    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925006    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925009    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925011    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925015    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925018    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925021    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925024    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925026    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.928920 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925029    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.925034    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925180    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925185    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925188    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925191    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925194    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925197    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925200    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925202    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925205    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925208    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925210    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925213    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925216    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:40.929293 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925219    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925221    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925223    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925226    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925228    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925231    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925233    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925242    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925245    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925248    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925250    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925253    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925256    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925259    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925261    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925264    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925268    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925271    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925274    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:40.929675 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925277    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925280    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925284    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925287    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925289    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925292    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925295    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925297    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925315    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925318    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925321    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925323    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925326    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925329    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925331    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925334    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925336    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925339    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925341    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925344    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:40.930152 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925347    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925356    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925359    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925367    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925370    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925373    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925376    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925378    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925381    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925384    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925386    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925388    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925391    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925393    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925396    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925398    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925400    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925403    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925405    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925408    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:40.930653 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925410    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925413    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925416    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925418    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925421    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925423    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925426    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925428    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925431    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925434    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925436    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925438    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925441    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925443    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925453    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925456    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925458    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925461    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925464    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:40.931139 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925466    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925470    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925473    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925476    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925479    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925481    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925484    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:40.925486    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.925491    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.925610    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.928031    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.929745    2573 server.go:1019] "Starting client certificate rotation"
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.929850    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 08:47:40.931628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.930820    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 08:47:40.932670 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.932655    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 08:47:40.934215 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.934189    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 08:47:40.951226 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.951203    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 29 08:47:40.953769 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.953750    2573 log.go:25] "Validated CRI v1 image API"
Jul 29 08:47:40.954689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.954672    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 08:47:40.958965 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.958942    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b952e727-ace1-4b11-93eb-ae1d809300d1:/dev/nvme0n1p4 c4b7f302-d70a-41b1-9ee1-f607cf43f2da:/dev/nvme0n1p3]
Jul 29 08:47:40.959039 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.958963    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 08:47:40.961142 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.961126    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 08:47:40.964250 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.964140    2573 manager.go:216] Machine: {Timestamp:2026-07-29 08:47:40.963669587 +0000 UTC m=+0.378401588 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104775 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cfa9d54b2e1a05d4fd5999dbae0db SystemUUID:ec2cfa9d-54b2-e1a0-5d4f-d5999dbae0db BootID:c147e4c1-de15-4993-8def-702705e9389f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:98:b3:77:59:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:98:b3:77:59:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:9d:b5:fb:0e:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 08:47:40.964250 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.964248    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 08:47:40.964372 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.964342    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 08:47:40.967822 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.967796    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 08:47:40.967953 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.967824    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 08:47:40.968673 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.968663    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 08:47:40.968710 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.968675    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 08:47:40.968710 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.968682    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 08:47:40.968710 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.968698    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 08:47:40.970003 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.969993    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 08:47:40.972857 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.972847    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 08:47:40.972980 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.972970    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 08:47:40.973021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.972999    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 08:47:40.973021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973007    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 08:47:40.973095 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973022    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 08:47:40.973095 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973048    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 29 08:47:40.973095 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973062    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 08:47:40.973413 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973402    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 08:47:40.973445 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.973421    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 08:47:40.975828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.975804    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 08:47:40.978386 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.978372    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 08:47:40.978446 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.978403    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 08:47:40.980524 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980510    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 08:47:40.980524 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980527    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980533    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980539    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980551    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980560    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980570    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980576    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980583    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980588    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980597    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980602    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980625    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 08:47:40.980627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.980631    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 08:47:40.983938 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.983921    2573 server.go:1268] "Started kubelet"
Jul 29 08:47:40.984179 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.983988    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 08:47:40.984179 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.984068    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 08:47:40.984179 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.984163    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 08:47:40.984929 ip-10-0-133-190 systemd[1]: Started Kubernetes Kubelet.
Jul 29 08:47:40.990024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.990001    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 08:47:40.990834 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:40.990803    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 08:47:40.991056 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.990951    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 08:47:40.991056 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:40.991046    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 08:47:40.991181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.991164    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 08:47:40.992122 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:40.992102    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 08:47:40.992718 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.992697    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xd8m2"
Jul 29 08:47:40.994783 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:40.994766    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xd8m2"
Jul 29 08:47:40.997253 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:40.996129    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-190.ec2.internal.18c6b668352bc37e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-190.ec2.internal,UID:ip-10-0-133-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-190.ec2.internal,},FirstTimestamp:2026-07-29 08:47:40.98389491 +0000 UTC m=+0.398626911,LastTimestamp:2026-07-29 08:47:40.98389491 +0000 UTC m=+0.398626911,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-190.ec2.internal,}"
Jul 29 08:47:41.001265 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.001244    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 08:47:41.001265 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.001259    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 08:47:41.001418 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.001380    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.002157 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.002035    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 08:47:41.002157 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.002065    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 08:47:41.002688 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.002420    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 08:47:41.002688 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.002433    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 08:47:41.002688 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.002648    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 08:47:41.002885 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.002747    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 08:47:41.004562 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.003507    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 08:47:41.005971 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.005869    2573 factory.go:55] Registering systemd factory
Jul 29 08:47:41.005971 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.005886    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 29 08:47:41.006105 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006093    2573 factory.go:153] Registering CRI-O factory
Jul 29 08:47:41.006155 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006107    2573 factory.go:223] Registration of the crio container factory successfully
Jul 29 08:47:41.006201 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006157    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 08:47:41.006201 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006185    2573 factory.go:103] Registering Raw factory
Jul 29 08:47:41.006201 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006200    2573 manager.go:1196] Started watching for new ooms in manager
Jul 29 08:47:41.006568 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.006557    2573 manager.go:349] Starting recovery of all containers
Jul 29 08:47:41.019446 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.019429    2573 manager.go:354] Recovery completed
Jul 29 08:47:41.023465 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.023451    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.025701 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.025683    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.025798 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.025714    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.025798 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.025728    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.026261 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.026246    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 08:47:41.026261 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.026260    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 08:47:41.026405 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.026290    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.026405 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.026317    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 08:47:41.026995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.026980    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.027049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.027010    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.027049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.027023    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.029135 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.029122    2573 policy_none.go:49] "None policy: Start"
Jul 29 08:47:41.029181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.029142    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 08:47:41.029181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.029157    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 08:47:41.031193 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.031181    2573 policy_none.go:47] "Start"
Jul 29 08:47:41.066939 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.066921    2573 manager.go:337] "Starting Device Plugin manager"
Jul 29 08:47:41.067024 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.066972    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 08:47:41.067024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.066982    2573 server.go:87] "Starting device plugin registration server"
Jul 29 08:47:41.067237 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.067224    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 08:47:41.067280 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.067240    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 08:47:41.067407 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.067392    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 08:47:41.067682 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.067479    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 08:47:41.067682 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.067490    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 08:47:41.068055 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.068001    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 08:47:41.068111 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.068057    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.079593 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.079575    2573 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2603 into the system container \"/system.slice\": <nil>"
Jul 29 08:47:41.168082 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.167987    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.168997 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.168980    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.169064 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.169014    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.169064 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.169025    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.169064 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.169053    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.177278 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.177259    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.177363 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.177283    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-190.ec2.internal\": node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.193785 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.193758    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.193832    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.195070    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.195114    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.195141    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.195178    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 08:47:41.199916 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.197671    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:41.294750 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.294715    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.295850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.295815    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"]
Jul 29 08:47:41.295914 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.295905    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.296860 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.296844    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.296958 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.296878    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.296958 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.296891    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.299246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299234    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.299378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.299420 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299398    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.299971 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299939    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.300050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299976    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.300050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299984    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.300050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299995    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.300050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.299996    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.300050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.300007    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.302314 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.302279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.302314 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.302317    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:41.302959 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.302941    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:41.303047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.302972    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:41.303047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.302986    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:41.321913 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.321889    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.326406 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.326389    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.395330 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.395291    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.405021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.404998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a857da9b944da3ad89aafdae7e77bc36-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"a857da9b944da3ad89aafdae7e77bc36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.405089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.405025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.405089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.405043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.496466 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.496384    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.505772 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a857da9b944da3ad89aafdae7e77bc36-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"a857da9b944da3ad89aafdae7e77bc36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.505829 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.505829 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.505901 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505851    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.505901 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a857da9b944da3ad89aafdae7e77bc36-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"a857da9b944da3ad89aafdae7e77bc36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.505901 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.505864    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21fd67da4cbf261d6058db2ed51af476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"21fd67da4cbf261d6058db2ed51af476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.596971 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.596928    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.625532 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.625512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.630899 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:41.630776    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:41.697534 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.697498    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:41.798141 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:41.798076    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.341290 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:43.341261    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.371836 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.371809    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 08:47:43.372230 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.371997    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 08:47:43.441353 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:43.441327    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.444198 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.444144    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 08:42:42 +0000 UTC" deadline="2028-03-17 12:15:17.151148451 +0000 UTC"
Jul 29 08:47:43.444198 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.444191    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14331h27m33.706960464s"
Jul 29 08:47:43.512322 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.512246    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:43.542022 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:43.541994    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.642232 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:43.642207    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.742815 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:43.742785    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found"
Jul 29 08:47:43.748224 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.748201    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:43.792528 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.792456    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:43.809864 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:43.809835    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda857da9b944da3ad89aafdae7e77bc36.slice/crio-585d9ac1ca28f73c464b854cd253303f068d9a9eaee258e108786a3e2a3ca550 WatchSource:0}: Error finding container 585d9ac1ca28f73c464b854cd253303f068d9a9eaee258e108786a3e2a3ca550: Status 404 returned error can't find the container with id 585d9ac1ca28f73c464b854cd253303f068d9a9eaee258e108786a3e2a3ca550
Jul 29 08:47:43.810530 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:43.810503    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fd67da4cbf261d6058db2ed51af476.slice/crio-e81797ec214fb229254ece58185bffe9dabc864523119990e65c9949697af50f WatchSource:0}: Error finding container e81797ec214fb229254ece58185bffe9dabc864523119990e65c9949697af50f: Status 404 returned error can't find the container with id e81797ec214fb229254ece58185bffe9dabc864523119990e65c9949697af50f
Jul 29 08:47:43.815965 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.815948    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:47:43.844024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.844003    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:43.856167 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.856151    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 08:47:43.857182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.857168    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"
Jul 29 08:47:43.864097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:43.864083    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 08:47:44.416586 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.416558    2573 apiserver.go:52] "Watching apiserver"
Jul 29 08:47:44.432686 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.432649    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:44.435270 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.435246    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 08:47:44.435775 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.435752    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8t5kw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr","openshift-cluster-node-tuning-operator/tuned-fzlp6","openshift-dns/node-resolver-7fnsg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal","openshift-multus/multus-additional-cni-plugins-gcj42","openshift-multus/multus-bnntk","openshift-network-diagnostics/network-check-target-4q6x4","kube-system/konnectivity-agent-fdhtb","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal","openshift-image-registry/node-ca-4f49z","openshift-multus/network-metrics-daemon-js5hz","openshift-network-operator/iptables-alerter-l2js5","openshift-ovn-kubernetes/ovnkube-node-45rbx"]
Jul 29 08:47:44.438302 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.438283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.441099 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.441075    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 08:47:44.442194 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.442174    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 08:47:44.442394 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.442375    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.442735 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.442718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npfdz\""
Jul 29 08:47:44.442940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.442924    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.446045 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.446013    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 08:47:44.446133 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.446057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.446536 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.446222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.446841 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.446820    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448378    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n9xdh\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448442    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448465    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448385    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448445    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448718    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.448768    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.449104    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjsd5\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.449336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkkjz\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.449471    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.449917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.449668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.451324 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.451171    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.451654 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.451624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452146    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452210    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452414    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452514    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vx29d\""
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452590    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 08:47:44.453551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.452748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.454365    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.454552    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.454763    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdz2x\""
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.454929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d6908-3214-4cf2-b7b6-f12b5ba5a862-tmp-dir\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-cni-binary-copy\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-netns\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-multus\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhv5j\" (UniqueName: \"kubernetes.io/projected/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-kube-api-access-zhv5j\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-etc-kubernetes\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-host\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-bin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-hostroot\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-multus-certs\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-systemd\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-tuned\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/203d6908-3214-4cf2-b7b6-f12b5ba5a862-hosts-file\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.455995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.455792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8w5p\" (UniqueName: \"kubernetes.io/projected/203d6908-3214-4cf2-b7b6-f12b5ba5a862-kube-api-access-p8w5p\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.457345    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.457691    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.457905    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.457956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lhdzr\""
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-socket-dir-parent\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-serviceca\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-kubernetes\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-system-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-cnibin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-run\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.458353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-lib-modules\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-var-lib-kubelet\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7tmv\" (UniqueName: \"kubernetes.io/projected/b66f92bd-1745-42aa-b2b4-a2716a60354d-kube-api-access-g7tmv\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-conf\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.458445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-sys\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-tmp\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-os-release\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-conf-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-daemon-config\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysconfig\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-k8s-cni-cncf-io\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-kubelet\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmz4p\" (UniqueName: \"kubernetes.io/projected/b4b60916-c3a5-432d-8afa-9c49847ff44f-kube-api-access-kmz4p\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-host\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.459362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-modprobe-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.460131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.460124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.462329 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.462313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g25pz\""
Jul 29 08:47:44.464277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.462413    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.464277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.462314    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.464277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.462328    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 08:47:44.464277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.463360    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.465672 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.465300    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbht5\""
Jul 29 08:47:44.465672 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.465469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:44.465672 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.465573    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 08:47:44.470533 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.469305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 08:47:44.470533 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.469622    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:44.470533 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.469733    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 08:47:44.471816 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.471793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.471917 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.471874    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:44.474950 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.474929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.475106 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.474990    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:44.482130 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.482091    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s48q5"
Jul 29 08:47:44.489030 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.489009    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s48q5"
Jul 29 08:47:44.548090 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.548063    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-system-cni-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-registration-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-device-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-system-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-cnibin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-run\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-var-lib-kubelet\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cnibin\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hmkf\" (UniqueName: \"kubernetes.io/projected/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-kube-api-access-7hmkf\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-systemd-units\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-systemd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e74a17f5-5629-4aff-b944-3c5331584892-iptables-alerter-script\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e74a17f5-5629-4aff-b944-3c5331584892-host-slash\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-conf\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-sys\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-tmp\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.561778 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xppnf\" (UniqueName: \"kubernetes.io/projected/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kube-api-access-xppnf\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-conf-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-node-log\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-k8s-cni-cncf-io\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-modprobe-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d6908-3214-4cf2-b7b6-f12b5ba5a862-tmp-dir\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-system-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-slash\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-cnibin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhv5j\" (UniqueName: \"kubernetes.io/projected/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-kube-api-access-zhv5j\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-etc-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-host\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560803    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-run\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-bin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.562597 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/203d6908-3214-4cf2-b7b6-f12b5ba5a862-hosts-file\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-var-lib-kubelet\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-os-release\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-k8s-cni-cncf-io\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.560984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-modprobe-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-log-socket\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-conf\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-dbus\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-lib-modules\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7tmv\" (UniqueName: \"kubernetes.io/projected/b66f92bd-1745-42aa-b2b4-a2716a60354d-kube-api-access-g7tmv\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bfa28d-d370-4469-a465-08dc6325a13d-agent-certs\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-env-overrides\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-script-lib\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.563424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-socket-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bfa28d-d370-4469-a465-08dc6325a13d-konnectivity-ca\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-config\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-os-release\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-daemon-config\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysconfig\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561310    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svw7x\" (UniqueName: \"kubernetes.io/projected/0f331ed4-9dc7-4481-beea-e463af96775c-kube-api-access-svw7x\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-kubelet-config\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-netns\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-var-lib-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-kubelet\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmz4p\" (UniqueName: \"kubernetes.io/projected/b4b60916-c3a5-432d-8afa-9c49847ff44f-kube-api-access-kmz4p\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-host\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.564374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqgx\" (UniqueName: \"kubernetes.io/projected/e74a17f5-5629-4aff-b944-3c5331584892-kube-api-access-hpqgx\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-ovn\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-netd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slfsd\" (UniqueName: \"kubernetes.io/projected/7eef8893-8d63-4cff-aa85-29f78399af16-kube-api-access-slfsd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-sys-fs\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-conf-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d6908-3214-4cf2-b7b6-f12b5ba5a862-tmp-dir\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.561910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-sys\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysconfig\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-sysctl-d\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/203d6908-3214-4cf2-b7b6-f12b5ba5a862-hosts-file\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562121    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-os-release\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-kubelet\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-host\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-lib-modules\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562225    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-cni-dir\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-bin\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.565168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-host\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-cni-binary-copy\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-netns\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-multus\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-var-lib-cni-multus\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-kubelet\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-netns\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-bin\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7eef8893-8d63-4cff-aa85-29f78399af16-ovn-node-metrics-cert\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-etc-kubernetes\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-etc-kubernetes\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-hostroot\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-multus-certs\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-hostroot\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-systemd\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-tuned\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-systemd\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-host-run-multus-certs\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.562989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8w5p\" (UniqueName: \"kubernetes.io/projected/203d6908-3214-4cf2-b7b6-f12b5ba5a862-kube-api-access-p8w5p\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-cni-binary-copy\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-socket-dir-parent\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-serviceca\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-kubernetes\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-socket-dir-parent\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.563311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-kubernetes\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.564048    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-serviceca\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.564195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4b60916-c3a5-432d-8afa-9c49847ff44f-multus-daemon-config\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.565667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-tmp\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.566861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.565691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b66f92bd-1745-42aa-b2b4-a2716a60354d-etc-tuned\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.571624 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.571601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmz4p\" (UniqueName: \"kubernetes.io/projected/b4b60916-c3a5-432d-8afa-9c49847ff44f-kube-api-access-kmz4p\") pod \"multus-bnntk\" (UID: \"b4b60916-c3a5-432d-8afa-9c49847ff44f\") " pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.571751 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.571730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8w5p\" (UniqueName: \"kubernetes.io/projected/203d6908-3214-4cf2-b7b6-f12b5ba5a862-kube-api-access-p8w5p\") pod \"node-resolver-7fnsg\" (UID: \"203d6908-3214-4cf2-b7b6-f12b5ba5a862\") " pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.572382 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.572352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhv5j\" (UniqueName: \"kubernetes.io/projected/7c3a2f91-b105-4652-9681-fe85f4b7f7d7-kube-api-access-zhv5j\") pod \"node-ca-4f49z\" (UID: \"7c3a2f91-b105-4652-9681-fe85f4b7f7d7\") " pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.572728 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.572707    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7tmv\" (UniqueName: \"kubernetes.io/projected/b66f92bd-1745-42aa-b2b4-a2716a60354d-kube-api-access-g7tmv\") pod \"tuned-fzlp6\" (UID: \"b66f92bd-1745-42aa-b2b4-a2716a60354d\") " pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.651415 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.651354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"21fd67da4cbf261d6058db2ed51af476","Type":"ContainerStarted","Data":"e81797ec214fb229254ece58185bffe9dabc864523119990e65c9949697af50f"}
Jul 29 08:47:44.653487 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.653456    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"a857da9b944da3ad89aafdae7e77bc36","Type":"ContainerStarted","Data":"585d9ac1ca28f73c464b854cd253303f068d9a9eaee258e108786a3e2a3ca550"}
Jul 29 08:47:44.663791 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-node-log\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.663933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.663933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-slash\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.663933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:44.663933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.663933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-etc-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-os-release\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.663990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-log-socket\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-dbus\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.664091 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bfa28d-d370-4469-a465-08dc6325a13d-agent-certs\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-env-overrides\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-script-lib\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-socket-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bfa28d-d370-4469-a465-08dc6325a13d-konnectivity-ca\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.664319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-config\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svw7x\" (UniqueName: \"kubernetes.io/projected/0f331ed4-9dc7-4481-beea-e463af96775c-kube-api-access-svw7x\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-kubelet-config\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-netns\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-var-lib-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqgx\" (UniqueName: \"kubernetes.io/projected/e74a17f5-5629-4aff-b944-3c5331584892-kube-api-access-hpqgx\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-ovn\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-netd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slfsd\" (UniqueName: \"kubernetes.io/projected/7eef8893-8d63-4cff-aa85-29f78399af16-kube-api-access-slfsd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-sys-fs\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.664689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-kubelet\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-bin\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7eef8893-8d63-4cff-aa85-29f78399af16-ovn-node-metrics-cert\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664814    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-netns\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-node-log\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-ovn\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-log-socket\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.664956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664939    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.664994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-run-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-socket-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-system-cni-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-registration-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-device-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cnibin\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hmkf\" (UniqueName: \"kubernetes.io/projected/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-kube-api-access-7hmkf\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-systemd-units\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-systemd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-systemd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e74a17f5-5629-4aff-b944-3c5331584892-iptables-alerter-script\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e74a17f5-5629-4aff-b944-3c5331584892-host-slash\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xppnf\" (UniqueName: \"kubernetes.io/projected/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kube-api-access-xppnf\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665529    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665535    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-registration-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-env-overrides\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cnibin\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-kubelet\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-device-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-bin\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-run-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665758    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.665927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-system-cni-dir\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665807    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-dbus\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-cni-netd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-host-slash\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-sys-fs\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665976    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-script-lib\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.665971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7eef8893-8d63-4cff-aa85-29f78399af16-ovnkube-config\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-os-release\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-systemd-units\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/888bb542-8e91-474c-a2c6-9ef7f46aff79-kubelet-config\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.666190    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e74a17f5-5629-4aff-b944-3c5331584892-host-slash\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.666282    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:47:45.166243991 +0000 UTC m=+3.138386864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bfa28d-d370-4469-a465-08dc6325a13d-konnectivity-ca\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.666304    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-var-lib-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.666715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.666376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7eef8893-8d63-4cff-aa85-29f78399af16-etc-openvswitch\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.667529 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.666383    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:45.166361691 +0000 UTC m=+3.138504552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:44.667529 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.667219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e74a17f5-5629-4aff-b944-3c5331584892-iptables-alerter-script\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.668049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.668030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bfa28d-d370-4469-a465-08dc6325a13d-agent-certs\") pod \"konnectivity-agent-fdhtb\" (UID: \"02bfa28d-d370-4469-a465-08dc6325a13d\") " pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.668527 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.668498    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7eef8893-8d63-4cff-aa85-29f78399af16-ovn-node-metrics-cert\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.670305 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.670117    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:44.670305 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.670137    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:44.670305 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.670149    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:44.670305 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:44.670239    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:45.170223269 +0000 UTC m=+3.142366151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:44.676991 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.675948    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqgx\" (UniqueName: \"kubernetes.io/projected/e74a17f5-5629-4aff-b944-3c5331584892-kube-api-access-hpqgx\") pod \"iptables-alerter-l2js5\" (UID: \"e74a17f5-5629-4aff-b944-3c5331584892\") " pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.678551 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.678525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slfsd\" (UniqueName: \"kubernetes.io/projected/7eef8893-8d63-4cff-aa85-29f78399af16-kube-api-access-slfsd\") pod \"ovnkube-node-45rbx\" (UID: \"7eef8893-8d63-4cff-aa85-29f78399af16\") " pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.678952 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.678927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hmkf\" (UniqueName: \"kubernetes.io/projected/5b8f803c-5e2b-4b0a-8cbf-741fe330779c-kube-api-access-7hmkf\") pod \"multus-additional-cni-plugins-gcj42\" (UID: \"5b8f803c-5e2b-4b0a-8cbf-741fe330779c\") " pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.680034 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.679996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xppnf\" (UniqueName: \"kubernetes.io/projected/9c6ce27d-abf0-4406-88e2-7318e4fec8a8-kube-api-access-xppnf\") pod \"aws-ebs-csi-driver-node-ccppr\" (UID: \"9c6ce27d-abf0-4406-88e2-7318e4fec8a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:44.680809 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.680789    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svw7x\" (UniqueName: \"kubernetes.io/projected/0f331ed4-9dc7-4481-beea-e463af96775c-kube-api-access-svw7x\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:44.757963 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.757928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnntk"
Jul 29 08:47:44.769100 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:44.769075    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b60916_c3a5_432d_8afa_9c49847ff44f.slice/crio-acc3cbf2713dd5af7cd5c62b7bc80b26f280d73d6d70def53dd64dabb79fd9ff WatchSource:0}: Error finding container acc3cbf2713dd5af7cd5c62b7bc80b26f280d73d6d70def53dd64dabb79fd9ff: Status 404 returned error can't find the container with id acc3cbf2713dd5af7cd5c62b7bc80b26f280d73d6d70def53dd64dabb79fd9ff
Jul 29 08:47:44.769627 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.769608    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f49z"
Jul 29 08:47:44.785067 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.785044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fzlp6"
Jul 29 08:47:44.788850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.788825    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7fnsg"
Jul 29 08:47:44.797679 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.797659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:47:44.804501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.804481    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcj42"
Jul 29 08:47:44.813207 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.813187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:47:44.821015 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.820994    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2js5"
Jul 29 08:47:44.827689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:44.827671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr"
Jul 29 08:47:45.168544 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.168517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:45.168723 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.168568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:45.168723 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.168676    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:45.168723 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.168680    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:45.168855 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.168733    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:46.168716196 +0000 UTC m=+4.140859071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:45.168855 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.168748    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:47:46.168741443 +0000 UTC m=+4.140884296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:45.269647 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.269609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:45.269810 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.269791    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:45.269876 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.269822    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:45.269876 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.269834    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:45.269979 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.269888    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:46.269869988 +0000 UTC m=+4.242012841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:45.492639 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.492550    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 08:42:44 +0000 UTC" deadline="2028-01-30 23:31:32.61778049 +0000 UTC"
Jul 29 08:47:45.492639 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.492583    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13214h43m47.125202595s"
Jul 29 08:47:45.638298 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.638267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:45.638474 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:45.638394    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:45.656853 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:45.656819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnntk" event={"ID":"b4b60916-c3a5-432d-8afa-9c49847ff44f","Type":"ContainerStarted","Data":"acc3cbf2713dd5af7cd5c62b7bc80b26f280d73d6d70def53dd64dabb79fd9ff"}
Jul 29 08:47:45.812305 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.812229    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eef8893_8d63_4cff_aa85_29f78399af16.slice/crio-accff81a9deb51374b4418b3f6553ff91c7875525aaa36ce8ba8a8184e48840a WatchSource:0}: Error finding container accff81a9deb51374b4418b3f6553ff91c7875525aaa36ce8ba8a8184e48840a: Status 404 returned error can't find the container with id accff81a9deb51374b4418b3f6553ff91c7875525aaa36ce8ba8a8184e48840a
Jul 29 08:47:45.817529 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.817492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6ce27d_abf0_4406_88e2_7318e4fec8a8.slice/crio-9c0dfb46617c88b686385d8c7dd5678df664ae569f1149a6d8199d9ac6021329 WatchSource:0}: Error finding container 9c0dfb46617c88b686385d8c7dd5678df664ae569f1149a6d8199d9ac6021329: Status 404 returned error can't find the container with id 9c0dfb46617c88b686385d8c7dd5678df664ae569f1149a6d8199d9ac6021329
Jul 29 08:47:45.818247 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.818224    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bfa28d_d370_4469_a465_08dc6325a13d.slice/crio-37f52fcebe4e87f8efc148817edc5cd087e5dc53db323ada9bee7fdc9252d19e WatchSource:0}: Error finding container 37f52fcebe4e87f8efc148817edc5cd087e5dc53db323ada9bee7fdc9252d19e: Status 404 returned error can't find the container with id 37f52fcebe4e87f8efc148817edc5cd087e5dc53db323ada9bee7fdc9252d19e
Jul 29 08:47:45.825504 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.825480    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74a17f5_5629_4aff_b944_3c5331584892.slice/crio-e9736b38abc268d8b60da28f0ff3e19e2ad06c4b6763f4a75d221a28ff81e783 WatchSource:0}: Error finding container e9736b38abc268d8b60da28f0ff3e19e2ad06c4b6763f4a75d221a28ff81e783: Status 404 returned error can't find the container with id e9736b38abc268d8b60da28f0ff3e19e2ad06c4b6763f4a75d221a28ff81e783
Jul 29 08:47:45.826862 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.826843    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8f803c_5e2b_4b0a_8cbf_741fe330779c.slice/crio-022046e52ba9095f2d6017c216169b3773e6427bd379fd33c94cca57ae6ad25d WatchSource:0}: Error finding container 022046e52ba9095f2d6017c216169b3773e6427bd379fd33c94cca57ae6ad25d: Status 404 returned error can't find the container with id 022046e52ba9095f2d6017c216169b3773e6427bd379fd33c94cca57ae6ad25d
Jul 29 08:47:45.849638 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.849610    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66f92bd_1745_42aa_b2b4_a2716a60354d.slice/crio-a67c9eafbf01520f5a6cf4563fddd77cb7087a1dadb7abe32b0575c97e59f953 WatchSource:0}: Error finding container a67c9eafbf01520f5a6cf4563fddd77cb7087a1dadb7abe32b0575c97e59f953: Status 404 returned error can't find the container with id a67c9eafbf01520f5a6cf4563fddd77cb7087a1dadb7abe32b0575c97e59f953
Jul 29 08:47:45.850951 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.849939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3a2f91_b105_4652_9681_fe85f4b7f7d7.slice/crio-de8a4332044e433aaf6e56f43983f190b9f3d6b099b92d0d8a9e48f6f4a3ef1f WatchSource:0}: Error finding container de8a4332044e433aaf6e56f43983f190b9f3d6b099b92d0d8a9e48f6f4a3ef1f: Status 404 returned error can't find the container with id de8a4332044e433aaf6e56f43983f190b9f3d6b099b92d0d8a9e48f6f4a3ef1f
Jul 29 08:47:45.850951 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:47:45.850755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203d6908_3214_4cf2_b7b6_f12b5ba5a862.slice/crio-98dd1346c686790f154a0e3d5a8079796a7c4022b3ca98e5139e5b3ee496410b WatchSource:0}: Error finding container 98dd1346c686790f154a0e3d5a8079796a7c4022b3ca98e5139e5b3ee496410b: Status 404 returned error can't find the container with id 98dd1346c686790f154a0e3d5a8079796a7c4022b3ca98e5139e5b3ee496410b
Jul 29 08:47:46.176541 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.176348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:46.176541 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.176533    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:46.176769 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.176571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:46.176769 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.176612    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:47:48.176591262 +0000 UTC m=+6.148734117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:46.176769 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.176670    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:46.176769 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.176718    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:48.176703219 +0000 UTC m=+6.148846092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:46.277200 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.277161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:46.277396 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.277331    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:46.277396 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.277352    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:46.277396 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.277367    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:46.277549 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.277427    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:48.277409253 +0000 UTC m=+6.249552109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:46.493603 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.493442    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 08:42:44 +0000 UTC" deadline="2028-03-04 18:35:51.26695741 +0000 UTC"
Jul 29 08:47:46.493603 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.493498    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14025h48m4.773463833s"
Jul 29 08:47:46.643324 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.643294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:46.643477 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.643430    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:46.643848 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.643826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:46.644404 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:46.644379    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:46.666928 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.666843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f49z" event={"ID":"7c3a2f91-b105-4652-9681-fe85f4b7f7d7","Type":"ContainerStarted","Data":"de8a4332044e433aaf6e56f43983f190b9f3d6b099b92d0d8a9e48f6f4a3ef1f"}
Jul 29 08:47:46.682007 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.681962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fdhtb" event={"ID":"02bfa28d-d370-4469-a465-08dc6325a13d","Type":"ContainerStarted","Data":"37f52fcebe4e87f8efc148817edc5cd087e5dc53db323ada9bee7fdc9252d19e"}
Jul 29 08:47:46.691165 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.691061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr" event={"ID":"9c6ce27d-abf0-4406-88e2-7318e4fec8a8","Type":"ContainerStarted","Data":"9c0dfb46617c88b686385d8c7dd5678df664ae569f1149a6d8199d9ac6021329"}
Jul 29 08:47:46.699306 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.699269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"accff81a9deb51374b4418b3f6553ff91c7875525aaa36ce8ba8a8184e48840a"}
Jul 29 08:47:46.704060 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.703987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"a857da9b944da3ad89aafdae7e77bc36","Type":"ContainerStarted","Data":"c028118fc22f9d4efc86fc096e13e4af5aa94dd2952e1e067a99c56d641afad1"}
Jul 29 08:47:46.715658 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.715613    2573 generic.go:356] "Generic (PLEG): container finished" podID="21fd67da4cbf261d6058db2ed51af476" containerID="c151771372f22f4570660779011c168ad5da709a06192d59399fbc70eec7c2c0" exitCode=0
Jul 29 08:47:46.715834 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.715714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"21fd67da4cbf261d6058db2ed51af476","Type":"ContainerDied","Data":"c151771372f22f4570660779011c168ad5da709a06192d59399fbc70eec7c2c0"}
Jul 29 08:47:46.719277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.719201    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" podStartSLOduration=3.719183011 podStartE2EDuration="3.719183011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:46.719097497 +0000 UTC m=+4.691240373" watchObservedRunningTime="2026-07-29 08:47:46.719183011 +0000 UTC m=+4.691325887"
Jul 29 08:47:46.729501 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.729413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fzlp6" event={"ID":"b66f92bd-1745-42aa-b2b4-a2716a60354d","Type":"ContainerStarted","Data":"a67c9eafbf01520f5a6cf4563fddd77cb7087a1dadb7abe32b0575c97e59f953"}
Jul 29 08:47:46.747147 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.747008    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerStarted","Data":"022046e52ba9095f2d6017c216169b3773e6427bd379fd33c94cca57ae6ad25d"}
Jul 29 08:47:46.754971 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.754862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2js5" event={"ID":"e74a17f5-5629-4aff-b944-3c5331584892","Type":"ContainerStarted","Data":"e9736b38abc268d8b60da28f0ff3e19e2ad06c4b6763f4a75d221a28ff81e783"}
Jul 29 08:47:46.775176 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:46.775135    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7fnsg" event={"ID":"203d6908-3214-4cf2-b7b6-f12b5ba5a862","Type":"ContainerStarted","Data":"98dd1346c686790f154a0e3d5a8079796a7c4022b3ca98e5139e5b3ee496410b"}
Jul 29 08:47:47.638138 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:47.638055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:47.638583 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:47.638205    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:47.800826 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:47.800739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"21fd67da4cbf261d6058db2ed51af476","Type":"ContainerStarted","Data":"27fb40205cc01bc31f77caf35f94e5ff1f0cba8af6773413d81aa94e02529bae"}
Jul 29 08:47:48.195100 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:48.195056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:48.195276 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:48.195134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:48.195276 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.195269    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:48.195388 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.195334    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:52.195312982 +0000 UTC m=+10.167455836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:48.195756 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.195738    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:48.195864 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.195789    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:47:52.195773579 +0000 UTC m=+10.167916447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:48.295718 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:48.295668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:48.295966 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.295911    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:48.295966 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.295956    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:48.295966 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.295968    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:48.296147 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.296040    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:52.296019407 +0000 UTC m=+10.268162282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:48.640816 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:48.640737    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:48.641304 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.640837    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:48.641304 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:48.641186    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:48.641304 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:48.641259    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:49.639394 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:49.638872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:49.639394 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:49.639037    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:50.638798 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:50.638766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:50.639242 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:50.638909    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:50.639242 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:50.638949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:50.639242 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:50.639053    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:51.638315 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:51.638282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:51.638499 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:51.638396    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:52.228836 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:52.228800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:52.229267 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:52.228859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:52.229267 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.228988    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:52.229267 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.229049    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:00.229031523 +0000 UTC m=+18.201174382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:52.229438 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.229430    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:52.229493 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.229476    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:48:00.229460456 +0000 UTC m=+18.201603314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:52.329656 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:52.329540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:52.329845 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.329749    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:52.329845 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.329779    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:52.329845 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.329793    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:52.330015 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.329860    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:00.329840089 +0000 UTC m=+18.301982949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:52.639308 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:52.639226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:52.639475 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.639342    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:52.639738 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:52.639715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:52.639833 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:52.639813    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:53.638997 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:53.638918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:53.639480 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:53.639063    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:54.638603 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:54.638568    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:54.638794 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:54.638697    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:54.638794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:54.638764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:54.638926 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:54.638906    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:55.639270 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:55.639232    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:55.639689 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:55.639348    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:56.638467 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:56.638391    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:56.638615 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:56.638505    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:56.638615 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:56.638567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:56.638732 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:56.638685    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:57.638137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:57.638095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:57.638595 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:57.638227    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:47:58.638052 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:58.638014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:47:58.638233 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:58.638029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:47:58.638233 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:58.638134    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:47:58.638233 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:58.638189    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:47:59.638808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:47:59.638772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:47:59.639249 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:47:59.638927    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:00.294689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:00.294574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:00.294689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:00.294640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:00.294975 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.294741    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:00.294975 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.294746    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:00.294975 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.294796    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:16.294778636 +0000 UTC m=+34.266921503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:00.294975 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.294815    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:48:16.294806124 +0000 UTC m=+34.266948980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:00.395585 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:00.395549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:00.395762 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.395702    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:48:00.395762 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.395722    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:48:00.395762 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.395734    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:00.395923 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.395795    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:16.395777234 +0000 UTC m=+34.367920096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:00.639460 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:00.638916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:00.639460 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.639059    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:00.639460 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:00.639112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:00.639460 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:00.639241    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:01.638317 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:01.638284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:01.638559 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:01.638411    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:02.639023 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:02.638992    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:02.639478 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:02.639104    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:02.639478 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:02.639150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:02.639478 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:02.639248    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:03.638456 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:03.638412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:03.638631 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:03.638552    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:04.640187 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.639985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:04.640995 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:04.640293    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:04.640995 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.640760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:04.640995 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:04.640870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:04.833618 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.833582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr" event={"ID":"9c6ce27d-abf0-4406-88e2-7318e4fec8a8","Type":"ContainerStarted","Data":"66c6048ecad00884d421c9bf47f04194d0e8c91f1110efb6f3590a02dabc7b5e"}
Jul 29 08:48:04.835792 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.835769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"92a930245b133bf72add171247ee89af6cba52c6812ca4acf5a0b6b9bd414acc"}
Jul 29 08:48:04.835888 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.835835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"f60765e20e944f388c595ec4def01f9f81fc9ef1ce2bb96075a4eb896b161803"}
Jul 29 08:48:04.835888 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.835872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"610872ad581945a9bf05b05e589f8855976ca270d73cc2399a1f82a4e52b7f4a"}
Jul 29 08:48:04.835998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.835916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"841de2394aeabe8c28abc836b0b990a315c58eadc0500ed8c47dd66b022a32db"}
Jul 29 08:48:04.837082 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.837062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnntk" event={"ID":"b4b60916-c3a5-432d-8afa-9c49847ff44f","Type":"ContainerStarted","Data":"f77c7066a30c10aa0a03b94334579b4f9b63a08f06a8fee875dd1c7d4dbf918a"}
Jul 29 08:48:04.840410 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.840381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fzlp6" event={"ID":"b66f92bd-1745-42aa-b2b4-a2716a60354d","Type":"ContainerStarted","Data":"011aab4bc0f99fadbf0ec46ded933a1bd32112a41c9b7fd6f7349f5647c7b2bd"}
Jul 29 08:48:04.841725 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.841704    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="7a6721f57c8afc38180ea36b22aa122d07c32d4ecd8d6fd40287d8e38bfaeb7f" exitCode=0
Jul 29 08:48:04.841818 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.841770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"7a6721f57c8afc38180ea36b22aa122d07c32d4ecd8d6fd40287d8e38bfaeb7f"}
Jul 29 08:48:04.843927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.843880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7fnsg" event={"ID":"203d6908-3214-4cf2-b7b6-f12b5ba5a862","Type":"ContainerStarted","Data":"44d5d7b1d1e31a228dc32b9352460712fe8e03fccb24bea14893e7440abc33f4"}
Jul 29 08:48:04.846831 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.846806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f49z" event={"ID":"7c3a2f91-b105-4652-9681-fe85f4b7f7d7","Type":"ContainerStarted","Data":"6f75d876e85e4ff1143fb049e806d91852d567869a0502b4f771b63a5336d563"}
Jul 29 08:48:04.848285 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.848263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fdhtb" event={"ID":"02bfa28d-d370-4469-a465-08dc6325a13d","Type":"ContainerStarted","Data":"11b22f9435079ded855b7b6ec73f6dad73a7d10e576584fdfa2bdd3b8928a5de"}
Jul 29 08:48:04.854859 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.854824    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" podStartSLOduration=21.854812879 podStartE2EDuration="21.854812879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:47.816611694 +0000 UTC m=+5.788754570" watchObservedRunningTime="2026-07-29 08:48:04.854812879 +0000 UTC m=+22.826955754"
Jul 29 08:48:04.854982 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.854963    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bnntk" podStartSLOduration=3.21742796 podStartE2EDuration="22.854958314s" totalImagesPullingTime="19.637530354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:04.854017239 +0000 UTC m=+22.826160113" watchObservedRunningTime="2026-07-29 08:48:04.854958314 +0000 UTC m=+22.827101189"
Jul 29 08:48:04.890525 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.890485    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fzlp6" podStartSLOduration=4.380757385 podStartE2EDuration="22.890469444s" totalImagesPullingTime="18.509712059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:04.890368789 +0000 UTC m=+22.862511665" watchObservedRunningTime="2026-07-29 08:48:04.890469444 +0000 UTC m=+22.862612322"
Jul 29 08:48:04.907199 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.907162    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7fnsg" podStartSLOduration=4.4203949399999996 podStartE2EDuration="22.907149326s" totalImagesPullingTime="18.486754386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:04.906856458 +0000 UTC m=+22.878999332" watchObservedRunningTime="2026-07-29 08:48:04.907149326 +0000 UTC m=+22.879292203"
Jul 29 08:48:04.973384 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.973343    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fdhtb" podStartSLOduration=8.879729218 podStartE2EDuration="22.973327187s" totalImagesPullingTime="14.093597969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:04.954048516 +0000 UTC m=+22.926191392" watchObservedRunningTime="2026-07-29 08:48:04.973327187 +0000 UTC m=+22.945470062"
Jul 29 08:48:04.973491 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:04.973438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4f49z" podStartSLOduration=4.486342718 podStartE2EDuration="22.973432459s" totalImagesPullingTime="18.487089741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:04.973240299 +0000 UTC m=+22.945383191" watchObservedRunningTime="2026-07-29 08:48:04.973432459 +0000 UTC m=+22.945575333"
Jul 29 08:48:05.638589 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.638521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:05.638741 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:05.638630    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:05.851393 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.851358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2js5" event={"ID":"e74a17f5-5629-4aff-b944-3c5331584892","Type":"ContainerStarted","Data":"67ebf7ce6ea5270cd2f69b5aa81992621cc4ad9b7c31278e91f229c8b586eb24"}
Jul 29 08:48:05.854042 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.854018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"49dfd2b689c1d83564dc6233baec06bb18abfcc558da299764e440ed3dae12fb"}
Jul 29 08:48:05.854140 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.854098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"2f0f321558e59bec8144b5957737cfa892db8bed5dc97374b32cda7f0162f7d3"}
Jul 29 08:48:05.867760 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.867718    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l2js5" podStartSLOduration=5.368386969 podStartE2EDuration="23.867702922s" totalImagesPullingTime="18.499315953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:05.867486137 +0000 UTC m=+23.839629012" watchObservedRunningTime="2026-07-29 08:48:05.867702922 +0000 UTC m=+23.839845796"
Jul 29 08:48:05.907391 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:05.907365    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 08:48:06.526881 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.526026    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T08:48:05.907386456Z","UUID":"b3edbb23-256b-4943-b8a1-e9c1abb6b20b","Handler":null,"Name":"","Endpoint":""}
Jul 29 08:48:06.529793 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.529756    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 08:48:06.529949 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.529811    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 08:48:06.638089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.638038    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:06.638276 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.638048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:06.638276 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:06.638252    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:06.638276 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:06.638263    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:06.858683 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:06.858602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr" event={"ID":"9c6ce27d-abf0-4406-88e2-7318e4fec8a8","Type":"ContainerStarted","Data":"2f47b1845bbf417e8220f560693c52068c8859296d191ca22536e97a53e1b7b7"}
Jul 29 08:48:07.638805 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:07.638773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:07.638977 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:07.638936    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:07.863116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:07.862826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr" event={"ID":"9c6ce27d-abf0-4406-88e2-7318e4fec8a8","Type":"ContainerStarted","Data":"ad1af087a02126fe30818e238cb17b8b16d04b2c84f3b27038ea651335dac054"}
Jul 29 08:48:07.866781 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:07.866747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"f67c0153910ad63396b84e1b8e6b1d8744c2a2d3d50cf44d4d20cbc20fd97785"}
Jul 29 08:48:07.884920 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:07.884852    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccppr" podStartSLOduration=5.051096996 podStartE2EDuration="25.88483503s" totalImagesPullingTime="20.833738034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:07.881084078 +0000 UTC m=+25.853226964" watchObservedRunningTime="2026-07-29 08:48:07.88483503 +0000 UTC m=+25.856977904"
Jul 29 08:48:08.639197 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:08.638961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:08.639364 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:08.638967    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:08.639364 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:08.639313    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:08.639457 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:08.639360    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:09.159974 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:09.159945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:48:09.160581 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:09.160559    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:48:09.638869 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:09.638834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:09.639084 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:09.638969    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:09.871026 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:09.870996    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:48:09.871589 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:09.871572    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fdhtb"
Jul 29 08:48:10.638953 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.638471    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:10.638953 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.638486    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:10.638953 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:10.638591    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:10.638953 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:10.638710    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:10.877155 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.877126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" event={"ID":"7eef8893-8d63-4cff-aa85-29f78399af16","Type":"ContainerStarted","Data":"1d35762e5d947d4491994452d616743746f90b7326dca92d0b4f04ac22bba768"}
Jul 29 08:48:10.877639 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.877620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:10.877738 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.877676    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:10.898635 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.898612    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:10.921196 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:10.921151    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx" podStartSLOduration=10.329425951 podStartE2EDuration="28.92113664s" totalImagesPullingTime="18.591710689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:10.920424515 +0000 UTC m=+28.892567389" watchObservedRunningTime="2026-07-29 08:48:10.92113664 +0000 UTC m=+28.893279515"
Jul 29 08:48:11.638230 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:11.638051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:11.638479 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:11.638300    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:11.882249 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:11.882210    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="7de12082b81bb77c4474da986e5a851d5a1c7501aefcb40425c5bb14fbb3d396" exitCode=0
Jul 29 08:48:11.882790 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:11.882395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"7de12082b81bb77c4474da986e5a851d5a1c7501aefcb40425c5bb14fbb3d396"}
Jul 29 08:48:11.883512 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:11.883492    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:11.906875 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:11.906621    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:12.639171 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.639142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:12.639341 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:12.639241    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:12.639341 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.639288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:12.639414 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:12.639373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:12.837803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.837773    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t5kw"]
Jul 29 08:48:12.838012 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.837923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:12.838076 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:12.838045    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:12.846261 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.846183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4q6x4"]
Jul 29 08:48:12.846821 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.846797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-js5hz"]
Jul 29 08:48:12.885047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.885020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:12.885565 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:12.885028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:12.885565 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:12.885136    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:12.885565 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:12.885554    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:13.889244 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:13.889211    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="950bead1e901cc78ca97f71c03ed190cfb9f73983c711665c420bc30075b1004" exitCode=0
Jul 29 08:48:13.889602 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:13.889294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"950bead1e901cc78ca97f71c03ed190cfb9f73983c711665c420bc30075b1004"}
Jul 29 08:48:14.638218 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:14.638189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:14.638376 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:14.638191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:14.638376 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:14.638318    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:14.638376 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:14.638191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:14.638541 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:14.638364    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:14.638541 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:14.638437    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:15.896813 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:15.896612    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="d25e1d53a701eacd951e507fafbc539cf026078c1da2f56c4a1572914fd5626a" exitCode=0
Jul 29 08:48:15.896813 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:15.896689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"d25e1d53a701eacd951e507fafbc539cf026078c1da2f56c4a1572914fd5626a"}
Jul 29 08:48:16.312877 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.312772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:16.312877 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.312833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:16.313102 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.312943    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:16.313102 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.312945    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:16.313102 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.312996    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret podName:888bb542-8e91-474c-a2c6-9ef7f46aff79 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:48.312983445 +0000 UTC m=+66.285126303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret") pod "global-pull-secret-syncer-8t5kw" (UID: "888bb542-8e91-474c-a2c6-9ef7f46aff79") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:16.313102 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.313012    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:48:48.313004954 +0000 UTC m=+66.285147810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:16.414246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.414210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:16.414424 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.414365    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:48:16.414424 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.414384    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:48:16.414424 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.414395    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jwzkn for pod openshift-network-diagnostics/network-check-target-4q6x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:16.414581 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.414460    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn podName:279be192-0ab2-4804-86d7-0c7abb990291 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:48.41444173 +0000 UTC m=+66.386584584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jwzkn" (UniqueName: "kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn") pod "network-check-target-4q6x4" (UID: "279be192-0ab2-4804-86d7-0c7abb990291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:16.638704 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.638670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:16.638704 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.638689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:16.638977 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:16.638670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:16.638977 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.638811    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5kw" podUID="888bb542-8e91-474c-a2c6-9ef7f46aff79"
Jul 29 08:48:16.638977 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.638929    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-js5hz" podUID="0f331ed4-9dc7-4481-beea-e463af96775c"
Jul 29 08:48:16.639138 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:16.639025    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4q6x4" podUID="279be192-0ab2-4804-86d7-0c7abb990291"
Jul 29 08:48:17.354782 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.354749    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeReady"
Jul 29 08:48:17.355226 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.354921    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 08:48:17.501796 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.501765    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sg6gw"]
Jul 29 08:48:17.506076 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.506053    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zcdl7"]
Jul 29 08:48:17.506227 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.506198    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.509875 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.509858    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.510360 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.510341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 08:48:17.510462 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.510367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68zl6\""
Jul 29 08:48:17.510462 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.510380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 08:48:17.514246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.514225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 08:48:17.514526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.514513    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 08:48:17.514810 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.514797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 08:48:17.515879 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.515866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb7dl\""
Jul 29 08:48:17.526520 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.526496    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcdl7"]
Jul 29 08:48:17.549880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.549851    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sg6gw"]
Jul 29 08:48:17.625357 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4z2\" (UniqueName: \"kubernetes.io/projected/4e13d41b-8be4-437a-9629-443e1e5cf2eb-kube-api-access-fq4z2\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.625357 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44283aff-2b70-482c-ab25-f91bd9e7713c-cert\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.625557 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e13d41b-8be4-437a-9629-443e1e5cf2eb-config-volume\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.625557 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e13d41b-8be4-437a-9629-443e1e5cf2eb-tmp-dir\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.625645 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskvv\" (UniqueName: \"kubernetes.io/projected/44283aff-2b70-482c-ab25-f91bd9e7713c-kube-api-access-cskvv\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.625645 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.625605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.726935 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.726885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e13d41b-8be4-437a-9629-443e1e5cf2eb-config-volume\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.727097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.726956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e13d41b-8be4-437a-9629-443e1e5cf2eb-tmp-dir\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.727097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskvv\" (UniqueName: \"kubernetes.io/projected/44283aff-2b70-482c-ab25-f91bd9e7713c-kube-api-access-cskvv\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.727097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.727097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4z2\" (UniqueName: \"kubernetes.io/projected/4e13d41b-8be4-437a-9629-443e1e5cf2eb-kube-api-access-fq4z2\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.727097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44283aff-2b70-482c-ab25-f91bd9e7713c-cert\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.727342 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:17.727181    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:17.727342 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:17.727259    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:18.227238755 +0000 UTC m=+36.199381621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:17.727342 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e13d41b-8be4-437a-9629-443e1e5cf2eb-tmp-dir\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.727593 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.727572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e13d41b-8be4-437a-9629-443e1e5cf2eb-config-volume\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.732106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.732076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44283aff-2b70-482c-ab25-f91bd9e7713c-cert\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.742185 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.742154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4z2\" (UniqueName: \"kubernetes.io/projected/4e13d41b-8be4-437a-9629-443e1e5cf2eb-kube-api-access-fq4z2\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:17.743042 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.743013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskvv\" (UniqueName: \"kubernetes.io/projected/44283aff-2b70-482c-ab25-f91bd9e7713c-kube-api-access-cskvv\") pod \"ingress-canary-zcdl7\" (UID: \"44283aff-2b70-482c-ab25-f91bd9e7713c\") " pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:17.821545 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:17.821513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcdl7"
Jul 29 08:48:18.000703 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.000669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcdl7"]
Jul 29 08:48:18.005197 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:18.005167    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44283aff_2b70_482c_ab25_f91bd9e7713c.slice/crio-b308d26ace8521d424f8d7c273c8433a18fe6f9321d80692e731e2bb80cf55f9 WatchSource:0}: Error finding container b308d26ace8521d424f8d7c273c8433a18fe6f9321d80692e731e2bb80cf55f9: Status 404 returned error can't find the container with id b308d26ace8521d424f8d7c273c8433a18fe6f9321d80692e731e2bb80cf55f9
Jul 29 08:48:18.232870 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.232789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:18.233026 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:18.232931    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:18.233026 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:18.232992    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:19.23297256 +0000 UTC m=+37.205115414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:18.638092 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.638053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:18.638775 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.638502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:18.638775 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.638678    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:18.642569 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.642546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 08:48:18.645217 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.645194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 08:48:18.645387 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.645374    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmmnd\""
Jul 29 08:48:18.645516 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.645501    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 08:48:18.645771 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.645753    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hkhb\""
Jul 29 08:48:18.645856 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.645777    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 08:48:18.905749 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:18.905635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcdl7" event={"ID":"44283aff-2b70-482c-ab25-f91bd9e7713c","Type":"ContainerStarted","Data":"b308d26ace8521d424f8d7c273c8433a18fe6f9321d80692e731e2bb80cf55f9"}
Jul 29 08:48:19.239338 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:19.239253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:19.239494 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:19.239417    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:19.239541 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:19.239501    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:21.239483013 +0000 UTC m=+39.211625884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:20.913672 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:20.913634    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="194348bd4b992165bd1d4e72042f94b79566a00b032c5d179e6f1a5ccdc3e88e" exitCode=0
Jul 29 08:48:20.914126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:20.913686    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"194348bd4b992165bd1d4e72042f94b79566a00b032c5d179e6f1a5ccdc3e88e"}
Jul 29 08:48:21.256294 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:21.256216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:21.256422 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:21.256361    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:21.256422 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:21.256419    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:25.256404993 +0000 UTC m=+43.228547851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:21.920983 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:21.920930    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b8f803c-5e2b-4b0a-8cbf-741fe330779c" containerID="676a012b70b0c07ed76677f49e952a4a2c4f4ec81924d0c3fb5c8f15847bfece" exitCode=0
Jul 29 08:48:21.921493 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:21.921006    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerDied","Data":"676a012b70b0c07ed76677f49e952a4a2c4f4ec81924d0c3fb5c8f15847bfece"}
Jul 29 08:48:22.926356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:22.926153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcj42" event={"ID":"5b8f803c-5e2b-4b0a-8cbf-741fe330779c","Type":"ContainerStarted","Data":"6c19699da721ecce3a3baa2fbe6e856cf7e1e33ca5b7582200214004571cf0bb"}
Jul 29 08:48:22.927601 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:22.927580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcdl7" event={"ID":"44283aff-2b70-482c-ab25-f91bd9e7713c","Type":"ContainerStarted","Data":"6c65551348b572bcd219737201e2ae1e9fa1f97e8123d3d828d590bf9ec1d305"}
Jul 29 08:48:22.949213 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:22.949161    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gcj42" podStartSLOduration=9.910331925 podStartE2EDuration="40.949146012s" totalImagesPullingTime="31.038814087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:22.948630967 +0000 UTC m=+40.920773842" watchObservedRunningTime="2026-07-29 08:48:22.949146012 +0000 UTC m=+40.921288887"
Jul 29 08:48:22.964213 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:22.964162    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zcdl7" podStartSLOduration=1.5378655810000001 podStartE2EDuration="5.964148335s" totalImagesPullingTime="4.426282754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:22.963799996 +0000 UTC m=+40.935942872" watchObservedRunningTime="2026-07-29 08:48:22.964148335 +0000 UTC m=+40.936291209"
Jul 29 08:48:25.284166 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:25.284124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:25.284580 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:25.284278    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:25.284580 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:25.284342    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:33.284326054 +0000 UTC m=+51.256468906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:33.344509 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:33.344464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:33.345020 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:33.344618    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:33.345020 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:33.344701    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:48:49.344684656 +0000 UTC m=+67.316827510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:43.899828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:43.899801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45rbx"
Jul 29 08:48:48.341992 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.341945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:48:48.341992 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.342001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:48.344177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.344149    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 08:48:48.344309 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.344293    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 08:48:48.352708 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:48.352685    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 08:48:48.352809 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:48.352757    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs podName:0f331ed4-9dc7-4481-beea-e463af96775c nodeName:}" failed. No retries permitted until 2026-07-29 08:49:52.352735708 +0000 UTC m=+130.324878577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs") pod "network-metrics-daemon-js5hz" (UID: "0f331ed4-9dc7-4481-beea-e463af96775c") : secret "metrics-daemon-secret" not found
Jul 29 08:48:48.356311 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.356290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/888bb542-8e91-474c-a2c6-9ef7f46aff79-original-pull-secret\") pod \"global-pull-secret-syncer-8t5kw\" (UID: \"888bb542-8e91-474c-a2c6-9ef7f46aff79\") " pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:48.442599 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.442544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:48.444866 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.444845    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 08:48:48.455025 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.455007    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 08:48:48.465598 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.465569    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzkn\" (UniqueName: \"kubernetes.io/projected/279be192-0ab2-4804-86d7-0c7abb990291-kube-api-access-jwzkn\") pod \"network-check-target-4q6x4\" (UID: \"279be192-0ab2-4804-86d7-0c7abb990291\") " pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:48.651386 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.651296    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5kw"
Jul 29 08:48:48.667055 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.667023    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hkhb\""
Jul 29 08:48:48.675003 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.674970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:48.785749 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.785718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t5kw"]
Jul 29 08:48:48.789365 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:48.789337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888bb542_8e91_474c_a2c6_9ef7f46aff79.slice/crio-70f968c50fa3f0d4e73fae6421015f71e5fdcb89dea2261cf5e43fb5e0fcbb01 WatchSource:0}: Error finding container 70f968c50fa3f0d4e73fae6421015f71e5fdcb89dea2261cf5e43fb5e0fcbb01: Status 404 returned error can't find the container with id 70f968c50fa3f0d4e73fae6421015f71e5fdcb89dea2261cf5e43fb5e0fcbb01
Jul 29 08:48:48.806155 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.806127    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4q6x4"]
Jul 29 08:48:48.810331 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:48.810307    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279be192_0ab2_4804_86d7_0c7abb990291.slice/crio-3496ec6b1e698b5fb4309a5cbd2aef5eb8b9b9f0655d6e190c092aa49ea580c6 WatchSource:0}: Error finding container 3496ec6b1e698b5fb4309a5cbd2aef5eb8b9b9f0655d6e190c092aa49ea580c6: Status 404 returned error can't find the container with id 3496ec6b1e698b5fb4309a5cbd2aef5eb8b9b9f0655d6e190c092aa49ea580c6
Jul 29 08:48:48.989212 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.989119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4q6x4" event={"ID":"279be192-0ab2-4804-86d7-0c7abb990291","Type":"ContainerStarted","Data":"3496ec6b1e698b5fb4309a5cbd2aef5eb8b9b9f0655d6e190c092aa49ea580c6"}
Jul 29 08:48:48.990038 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:48.990016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t5kw" event={"ID":"888bb542-8e91-474c-a2c6-9ef7f46aff79","Type":"ContainerStarted","Data":"70f968c50fa3f0d4e73fae6421015f71e5fdcb89dea2261cf5e43fb5e0fcbb01"}
Jul 29 08:48:49.350135 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:49.350097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:48:49.350557 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:49.350262    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:49.350557 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:49.350344    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls podName:4e13d41b-8be4-437a-9629-443e1e5cf2eb nodeName:}" failed. No retries permitted until 2026-07-29 08:49:21.350322664 +0000 UTC m=+99.322465525 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls") pod "dns-default-sg6gw" (UID: "4e13d41b-8be4-437a-9629-443e1e5cf2eb") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:50.009636 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.009604    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-wdbhh"]
Jul 29 08:48:50.032752 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.032721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-wdbhh"]
Jul 29 08:48:50.032945 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.032863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.035402 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.035205    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 08:48:50.035402 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.035322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zphwq\""
Jul 29 08:48:50.035993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.035869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.035993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.035923    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.036158 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.035995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 08:48:50.040817 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.040792    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 08:48:50.055662 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.055638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a9ee01-32e8-4005-8e26-205b1afcdde0-serving-cert\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.055786 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.055678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfz2h\" (UniqueName: \"kubernetes.io/projected/b5a9ee01-32e8-4005-8e26-205b1afcdde0-kube-api-access-pfz2h\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.055786 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.055717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-config\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.055786 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.055778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-trusted-ca\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.112807 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.112769    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"]
Jul 29 08:48:50.134948 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.134256    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68555bcf85-tdf9s"]
Jul 29 08:48:50.134948 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.134945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"
Jul 29 08:48:50.146548 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.138806    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-clfrt\""
Jul 29 08:48:50.146548 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.139107    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.146548 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.139213    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.150407 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.150380    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zqcq6"]
Jul 29 08:48:50.151097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.150664    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.153507 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 08:48:50.153683 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153657    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 08:48:50.153762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153706    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8xj2c\""
Jul 29 08:48:50.153762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153719    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.153762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 08:48:50.153762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153754    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.153996 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.153780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 08:48:50.157021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.156998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a9ee01-32e8-4005-8e26-205b1afcdde0-serving-cert\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.157126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.157126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-default-certificate\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.157126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxrc\" (UniqueName: \"kubernetes.io/projected/a4982339-3ff4-407a-80ae-922cfa8cdcbd-kube-api-access-gbxrc\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.157126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfz2h\" (UniqueName: \"kubernetes.io/projected/b5a9ee01-32e8-4005-8e26-205b1afcdde0-kube-api-access-pfz2h\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.157336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-config\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.157336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-trusted-ca\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.157336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc6sb\" (UniqueName: \"kubernetes.io/projected/38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0-kube-api-access-kc6sb\") pod \"volume-data-source-validator-549c6d54cf-w7c9q\" (UID: \"38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"
Jul 29 08:48:50.157336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.157336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.157244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-stats-auth\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.158290 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.158265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-config\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.159017 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.158930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5a9ee01-32e8-4005-8e26-205b1afcdde0-trusted-ca\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.160574 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.160555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a9ee01-32e8-4005-8e26-205b1afcdde0-serving-cert\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.166750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.166643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"]
Jul 29 08:48:50.166750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.166682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zqcq6"]
Jul 29 08:48:50.167711 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.166927    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68555bcf85-tdf9s"]
Jul 29 08:48:50.167711 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.166988    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.167711 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.167028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfz2h\" (UniqueName: \"kubernetes.io/projected/b5a9ee01-32e8-4005-8e26-205b1afcdde0-kube-api-access-pfz2h\") pod \"console-operator-584dcb6b54-wdbhh\" (UID: \"b5a9ee01-32e8-4005-8e26-205b1afcdde0\") " pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.169057 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.169037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.169913 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.169171    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jjc25\""
Jul 29 08:48:50.169913 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.169284    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 08:48:50.169913 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.169403    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 08:48:50.169913 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.169544    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.177329 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.177305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 08:48:50.257747 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.257747 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-tmp\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.257747 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553627-ff60-4db8-8abf-a093140c17e7-serving-cert\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc6sb\" (UniqueName: \"kubernetes.io/projected/38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0-kube-api-access-kc6sb\") pod \"volume-data-source-validator-549c6d54cf-w7c9q\" (UID: \"38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-stats-auth\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.257979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.258007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-default-certificate\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.258031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxrc\" (UniqueName: \"kubernetes.io/projected/a4982339-3ff4-407a-80ae-922cfa8cdcbd-kube-api-access-gbxrc\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.258071 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.258056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-snapshots\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.258467 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.258084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lq6l\" (UniqueName: \"kubernetes.io/projected/d3553627-ff60-4db8-8abf-a093140c17e7-kube-api-access-8lq6l\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.258545 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.258528    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:50.758507221 +0000 UTC m=+68.730650081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:48:50.258955 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.258927    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 08:48:50.259078 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.259007    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:50.758989029 +0000 UTC m=+68.731131905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : secret "router-metrics-certs-default" not found
Jul 29 08:48:50.261834 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.261752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-default-certificate\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.262961 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.262939    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-stats-auth\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.267128 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.267103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc6sb\" (UniqueName: \"kubernetes.io/projected/38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0-kube-api-access-kc6sb\") pod \"volume-data-source-validator-549c6d54cf-w7c9q\" (UID: \"38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"
Jul 29 08:48:50.267974 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.267932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxrc\" (UniqueName: \"kubernetes.io/projected/a4982339-3ff4-407a-80ae-922cfa8cdcbd-kube-api-access-gbxrc\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.344783 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.344748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:48:50.358444 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553627-ff60-4db8-8abf-a093140c17e7-serving-cert\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-snapshots\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lq6l\" (UniqueName: \"kubernetes.io/projected/d3553627-ff60-4db8-8abf-a093140c17e7-kube-api-access-8lq6l\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.358626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-tmp\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.359194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-tmp\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.359257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3553627-ff60-4db8-8abf-a093140c17e7-snapshots\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.359330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-service-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.359993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.359970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553627-ff60-4db8-8abf-a093140c17e7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.361886 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.361863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553627-ff60-4db8-8abf-a093140c17e7-serving-cert\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.368014 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.367981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lq6l\" (UniqueName: \"kubernetes.io/projected/d3553627-ff60-4db8-8abf-a093140c17e7-kube-api-access-8lq6l\") pod \"insights-operator-5885fdb759-zqcq6\" (UID: \"d3553627-ff60-4db8-8abf-a093140c17e7\") " pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.456624 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.456579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"
Jul 29 08:48:50.487720 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.487667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-zqcq6"
Jul 29 08:48:50.522223 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.522080    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-wdbhh"]
Jul 29 08:48:50.527259 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:50.527224    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a9ee01_32e8_4005_8e26_205b1afcdde0.slice/crio-de94bfdba10fe427d7967cd5898a763dee160973aff369aeb1c9864720779cb3 WatchSource:0}: Error finding container de94bfdba10fe427d7967cd5898a763dee160973aff369aeb1c9864720779cb3: Status 404 returned error can't find the container with id de94bfdba10fe427d7967cd5898a763dee160973aff369aeb1c9864720779cb3
Jul 29 08:48:50.647505 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.647480    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q"]
Jul 29 08:48:50.650305 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:50.650273    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b05c3d_d2a4_4361_90e1_37d0ccbfbfe0.slice/crio-778107c06a19a3247fdcdd81c6e9a8b4c45d87dbdd19bc15f35667c8cfde5e76 WatchSource:0}: Error finding container 778107c06a19a3247fdcdd81c6e9a8b4c45d87dbdd19bc15f35667c8cfde5e76: Status 404 returned error can't find the container with id 778107c06a19a3247fdcdd81c6e9a8b4c45d87dbdd19bc15f35667c8cfde5e76
Jul 29 08:48:50.664392 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.664365    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zqcq6"]
Jul 29 08:48:50.762248 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.762204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.762248 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.762269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:50.762550 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.762430    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 08:48:50.762550 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.762493    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:51.762473049 +0000 UTC m=+69.734615908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : secret "router-metrics-certs-default" not found
Jul 29 08:48:50.762935 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:50.762911    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:51.762875073 +0000 UTC m=+69.735017928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:48:50.998038 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.997994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q" event={"ID":"38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0","Type":"ContainerStarted","Data":"778107c06a19a3247fdcdd81c6e9a8b4c45d87dbdd19bc15f35667c8cfde5e76"}
Jul 29 08:48:50.999415 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:50.999380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zqcq6" event={"ID":"d3553627-ff60-4db8-8abf-a093140c17e7","Type":"ContainerStarted","Data":"bca7b68e1e89f67e6b0cf40893ad457ec8e695cc254a807846a552bba613d468"}
Jul 29 08:48:51.000592 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:51.000534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" event={"ID":"b5a9ee01-32e8-4005-8e26-205b1afcdde0","Type":"ContainerStarted","Data":"de94bfdba10fe427d7967cd5898a763dee160973aff369aeb1c9864720779cb3"}
Jul 29 08:48:51.770649 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:51.770605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:51.771126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:51.770680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:51.771126 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:51.770778    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:53.770757806 +0000 UTC m=+71.742900678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:48:51.771126 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:51.770842    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 08:48:51.771126 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:51.770918    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:53.770887538 +0000 UTC m=+71.743030394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : secret "router-metrics-certs-default" not found
Jul 29 08:48:53.790169 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:53.790131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:53.790724 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:53.790195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:53.796053 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:53.792419    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.792394467 +0000 UTC m=+75.764537387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:48:53.796053 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:53.792558    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 08:48:53.796053 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:53.792630    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.792613351 +0000 UTC m=+75.764756219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : secret "router-metrics-certs-default" not found
Jul 29 08:48:54.751313 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.751270    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"]
Jul 29 08:48:54.754556 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.754531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"
Jul 29 08:48:54.757553 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.757525    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-grtml\""
Jul 29 08:48:54.757553 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.757539    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 08:48:54.757758 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.757539    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 08:48:54.763626 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.763279    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"]
Jul 29 08:48:54.799025 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.798979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zl5\" (UniqueName: \"kubernetes.io/projected/9e29c609-61bf-42f5-b49f-eaddd8d7c7a5-kube-api-access-z6zl5\") pod \"migrator-6865c9967-t2chp\" (UID: \"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"
Jul 29 08:48:54.900112 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.900069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zl5\" (UniqueName: \"kubernetes.io/projected/9e29c609-61bf-42f5-b49f-eaddd8d7c7a5-kube-api-access-z6zl5\") pod \"migrator-6865c9967-t2chp\" (UID: \"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"
Jul 29 08:48:54.909962 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:54.909915    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zl5\" (UniqueName: \"kubernetes.io/projected/9e29c609-61bf-42f5-b49f-eaddd8d7c7a5-kube-api-access-z6zl5\") pod \"migrator-6865c9967-t2chp\" (UID: \"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"
Jul 29 08:48:55.066178 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:55.066154    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"
Jul 29 08:48:55.234705 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:55.234671    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp"]
Jul 29 08:48:55.267873 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:48:55.267791    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e29c609_61bf_42f5_b49f_eaddd8d7c7a5.slice/crio-bc6b4e75ec00f0d22dbc679d8355fba885ae4d1e10372f4d92ee2732d1869954 WatchSource:0}: Error finding container bc6b4e75ec00f0d22dbc679d8355fba885ae4d1e10372f4d92ee2732d1869954: Status 404 returned error can't find the container with id bc6b4e75ec00f0d22dbc679d8355fba885ae4d1e10372f4d92ee2732d1869954
Jul 29 08:48:56.016465 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.016424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t5kw" event={"ID":"888bb542-8e91-474c-a2c6-9ef7f46aff79","Type":"ContainerStarted","Data":"9f50a7015f7e942b4a0752fd1072dc83bfd63e18fda5c939868ec1e7852f42ea"}
Jul 29 08:48:56.017879 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.017856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4q6x4" event={"ID":"279be192-0ab2-4804-86d7-0c7abb990291","Type":"ContainerStarted","Data":"a8d148fce9d7c58d2733b975cf50a4a1b9660d6bc9341825d2deac99ffb26eda"}
Jul 29 08:48:56.018020 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.017976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:48:56.019377 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.019358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q" event={"ID":"38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0","Type":"ContainerStarted","Data":"4f0d7af13388140d6814916f372a61a6a68b944ee44a7b648945271f143995d4"}
Jul 29 08:48:56.020545 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.020525    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp" event={"ID":"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5","Type":"ContainerStarted","Data":"bc6b4e75ec00f0d22dbc679d8355fba885ae4d1e10372f4d92ee2732d1869954"}
Jul 29 08:48:56.021968 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.021946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zqcq6" event={"ID":"d3553627-ff60-4db8-8abf-a093140c17e7","Type":"ContainerStarted","Data":"a26b0e086a0860a04d5c99e3884ebd3421bb5719733d25afcf015de1664df2e7"}
Jul 29 08:48:56.023498 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.023473    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/0.log"
Jul 29 08:48:56.023562 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.023518    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5a9ee01-32e8-4005-8e26-205b1afcdde0" containerID="94a96bea54b841e5cd3ac01018c716fbfe45398f0083ffab4321b80f0ed6cd3c" exitCode=255
Jul 29 08:48:56.023562 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.023547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" event={"ID":"b5a9ee01-32e8-4005-8e26-205b1afcdde0","Type":"ContainerDied","Data":"94a96bea54b841e5cd3ac01018c716fbfe45398f0083ffab4321b80f0ed6cd3c"}
Jul 29 08:48:56.023728 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.023715    2573 scope.go:117] "RemoveContainer" containerID="94a96bea54b841e5cd3ac01018c716fbfe45398f0083ffab4321b80f0ed6cd3c"
Jul 29 08:48:56.031696 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.031658    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8t5kw" podStartSLOduration=67.820445416 podStartE2EDuration="1m14.031640669s" totalImagesPullingTime="6.211195253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:56.030808399 +0000 UTC m=+74.002951273" watchObservedRunningTime="2026-07-29 08:48:56.031640669 +0000 UTC m=+74.003783543"
Jul 29 08:48:56.047999 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.047954    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-w7c9q" podStartSLOduration=1.699339246 podStartE2EDuration="6.047938893s" totalImagesPullingTime="4.348599647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:56.046659469 +0000 UTC m=+74.018802353" watchObservedRunningTime="2026-07-29 08:48:56.047938893 +0000 UTC m=+74.020081769"
Jul 29 08:48:56.066581 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.066524    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-zqcq6" podStartSLOduration=1.722483178 podStartE2EDuration="6.066503896s" totalImagesPullingTime="4.344020718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:56.065228172 +0000 UTC m=+74.037371046" watchObservedRunningTime="2026-07-29 08:48:56.066503896 +0000 UTC m=+74.038646772"
Jul 29 08:48:56.088101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.088052    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4q6x4" podStartSLOduration=67.897893913 podStartE2EDuration="1m14.088035311s" totalImagesPullingTime="6.190141398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:56.08708926 +0000 UTC m=+74.059232161" watchObservedRunningTime="2026-07-29 08:48:56.088035311 +0000 UTC m=+74.060178191"
Jul 29 08:48:56.167936 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.167783    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j6zx6"]
Jul 29 08:48:56.175605 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.175582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.177523 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.177500    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 08:48:56.177637 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.177546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 08:48:56.177819 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.177793    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jw2tp\""
Jul 29 08:48:56.180457 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.180436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j6zx6"]
Jul 29 08:48:56.214870 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.214756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4f881-b42e-4d37-ad44-1707cc060151-crio-socket\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.214870 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.214809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.215106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.214876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.215106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.215020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzvc\" (UniqueName: \"kubernetes.io/projected/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-api-access-2gzvc\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.215106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.215085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8f4f881-b42e-4d37-ad44-1707cc060151-data-volume\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316236 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4f881-b42e-4d37-ad44-1707cc060151-crio-socket\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316236 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316479 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316479 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzvc\" (UniqueName: \"kubernetes.io/projected/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-api-access-2gzvc\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316479 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8f4f881-b42e-4d37-ad44-1707cc060151-data-volume\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316479 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.316385    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.316479 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.316436    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.316683 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.316485    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:56.816462132 +0000 UTC m=+74.788604990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.316683 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.316508    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:56.816495497 +0000 UTC m=+74.788638350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.316756 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8f4f881-b42e-4d37-ad44-1707cc060151-crio-socket\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.316756 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.316710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8f4f881-b42e-4d37-ad44-1707cc060151-data-volume\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.324735 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.324709    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzvc\" (UniqueName: \"kubernetes.io/projected/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-api-access-2gzvc\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.821057 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.820958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.821057 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:56.821014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:56.821256 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.821124    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.821256 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.821185    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.821170681 +0000 UTC m=+75.793313537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.821256 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.821183    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.821256 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:56.821237    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.821223882 +0000 UTC m=+75.793366736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:57.029021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.028982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp" event={"ID":"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5","Type":"ContainerStarted","Data":"819ce1d59cd1f5fa78bb0ac0a63c48a715108111a135c8bd76362c27834d1b8b"}
Jul 29 08:48:57.029451 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.029044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp" event={"ID":"9e29c609-61bf-42f5-b49f-eaddd8d7c7a5","Type":"ContainerStarted","Data":"89de5581c05b0105719950a13a38c2d31a6d71b0a6da27a9f290495ca2f6f782"}
Jul 29 08:48:57.030419 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.030401    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:48:57.030757 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.030742    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/0.log"
Jul 29 08:48:57.030813 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.030775    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5a9ee01-32e8-4005-8e26-205b1afcdde0" containerID="af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478" exitCode=255
Jul 29 08:48:57.030855 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.030839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" event={"ID":"b5a9ee01-32e8-4005-8e26-205b1afcdde0","Type":"ContainerDied","Data":"af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478"}
Jul 29 08:48:57.030927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.030883    2573 scope.go:117] "RemoveContainer" containerID="94a96bea54b841e5cd3ac01018c716fbfe45398f0083ffab4321b80f0ed6cd3c"
Jul 29 08:48:57.031118 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.031085    2573 scope.go:117] "RemoveContainer" containerID="af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478"
Jul 29 08:48:57.031294 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.031261    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-wdbhh_openshift-console-operator(b5a9ee01-32e8-4005-8e26-205b1afcdde0)\"" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" podUID="b5a9ee01-32e8-4005-8e26-205b1afcdde0"
Jul 29 08:48:57.044509 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.044471    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-t2chp" podStartSLOduration=1.845918175 podStartE2EDuration="3.044456355s" totalImagesPullingTime="1.19853818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:57.043526416 +0000 UTC m=+75.015669291" watchObservedRunningTime="2026-07-29 08:48:57.044456355 +0000 UTC m=+75.016599230"
Jul 29 08:48:57.829889 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.829846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:57.830075 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.829999    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 08:48:57.830075 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.830036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:48:57.830075 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830062    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:49:05.830046429 +0000 UTC m=+83.802189282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : secret "router-metrics-certs-default" not found
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.830102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830134    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:49:05.83012225 +0000 UTC m=+83.802265104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:57.830150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830169    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830196    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:59.830186 +0000 UTC m=+77.802328853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:57.830210 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830208    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:57.830415 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:57.830236    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:59.830228874 +0000 UTC m=+77.802371727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:58.035563 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:58.035538    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:48:58.035980 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:58.035844    2573 scope.go:117] "RemoveContainer" containerID="af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478"
Jul 29 08:48:58.036045 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:58.036025    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-wdbhh_openshift-console-operator(b5a9ee01-32e8-4005-8e26-205b1afcdde0)\"" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" podUID="b5a9ee01-32e8-4005-8e26-205b1afcdde0"
Jul 29 08:48:58.748532 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:58.748506    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7fnsg_203d6908-3214-4cf2-b7b6-f12b5ba5a862/dns-node-resolver/0.log"
Jul 29 08:48:59.748527 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:59.748500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f49z_7c3a2f91-b105-4652-9681-fe85f4b7f7d7/node-ca/0.log"
Jul 29 08:48:59.847195 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:59.847159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:59.847385 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:59.847286    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:59.847385 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:48:59.847296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:48:59.847385 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:59.847359    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:03.847343965 +0000 UTC m=+81.819486818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:59.847557 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:59.847419    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:59.847557 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:48:59.847478    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:03.847461775 +0000 UTC m=+81.819604643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:00.345750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:00.345715    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:49:00.345942 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:00.345776    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:49:00.346144 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:00.346130    2573 scope.go:117] "RemoveContainer" containerID="af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478"
Jul 29 08:49:00.346292 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:00.346275    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-wdbhh_openshift-console-operator(b5a9ee01-32e8-4005-8e26-205b1afcdde0)\"" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" podUID="b5a9ee01-32e8-4005-8e26-205b1afcdde0"
Jul 29 08:49:00.948107 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:00.948077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcdl7_44283aff-2b70-482c-ab25-f91bd9e7713c/serve-healthcheck-canary/0.log"
Jul 29 08:49:01.150669 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:01.150634    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-t2chp_9e29c609-61bf-42f5-b49f-eaddd8d7c7a5/migrator/0.log"
Jul 29 08:49:01.347592 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:01.347562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-t2chp_9e29c609-61bf-42f5-b49f-eaddd8d7c7a5/graceful-termination/0.log"
Jul 29 08:49:03.880600 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:03.880557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:03.881054 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:03.880685    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:49:03.881054 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:03.880684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:03.881054 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:03.880759    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:11.880741967 +0000 UTC m=+89.852884831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : configmap "kube-rbac-proxy" not found
Jul 29 08:49:03.881054 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:03.880775    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:03.881054 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:03.880821    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls podName:e8f4f881-b42e-4d37-ad44-1707cc060151 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:11.880808409 +0000 UTC m=+89.852951262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j6zx6" (UID: "e8f4f881-b42e-4d37-ad44-1707cc060151") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:05.898277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:05.898158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:05.898277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:05.898227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:05.898727 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:49:05.898369    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle podName:a4982339-3ff4-407a-80ae-922cfa8cdcbd nodeName:}" failed. No retries permitted until 2026-07-29 08:49:21.898345166 +0000 UTC m=+99.870488022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle") pod "router-default-68555bcf85-tdf9s" (UID: "a4982339-3ff4-407a-80ae-922cfa8cdcbd") : configmap references non-existent config key: service-ca.crt
Jul 29 08:49:05.900493 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:05.900476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4982339-3ff4-407a-80ae-922cfa8cdcbd-metrics-certs\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:11.949623 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:11.949580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:11.949623 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:11.949629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:11.950188 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:11.950170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8f4f881-b42e-4d37-ad44-1707cc060151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:11.951787 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:11.951770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8f4f881-b42e-4d37-ad44-1707cc060151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j6zx6\" (UID: \"e8f4f881-b42e-4d37-ad44-1707cc060151\") " pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:12.127904 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:12.127854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j6zx6"
Jul 29 08:49:12.252696 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:12.252664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j6zx6"]
Jul 29 08:49:12.255435 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:12.255410    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f4f881_b42e_4d37_ad44_1707cc060151.slice/crio-70cf75e1f455b37300a26ff9bb6e4d26abe0b682fb0038cf2858419776bfe202 WatchSource:0}: Error finding container 70cf75e1f455b37300a26ff9bb6e4d26abe0b682fb0038cf2858419776bfe202: Status 404 returned error can't find the container with id 70cf75e1f455b37300a26ff9bb6e4d26abe0b682fb0038cf2858419776bfe202
Jul 29 08:49:13.085049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:13.084969    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j6zx6" event={"ID":"e8f4f881-b42e-4d37-ad44-1707cc060151","Type":"ContainerStarted","Data":"70cf75e1f455b37300a26ff9bb6e4d26abe0b682fb0038cf2858419776bfe202"}
Jul 29 08:49:14.638780 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:14.638745    2573 scope.go:117] "RemoveContainer" containerID="af4f1f20279ad4a92abee095db559f55a0dd39533a85ed514404bed6facb0478"
Jul 29 08:49:17.864146 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.863349    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"]
Jul 29 08:49:17.866629 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.866592    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:17.870643 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.870621    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-j56d8\""
Jul 29 08:49:17.871412 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.871199    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 08:49:17.871412 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.871262    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 08:49:17.871412 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.871208    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 08:49:17.872775 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.872118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 08:49:17.881707 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:17.881588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"]
Jul 29 08:49:18.006160 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.006124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47be8c64-d928-4341-91b7-c08f6107153e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.006342 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.006188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppx5\" (UniqueName: \"kubernetes.io/projected/47be8c64-d928-4341-91b7-c08f6107153e-kube-api-access-5ppx5\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.029750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.029516    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74db7d5bf-7zwv5"]
Jul 29 08:49:18.032882 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.032841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.051210 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.051179    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 08:49:18.055865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.055404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 08:49:18.055865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.055459    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 08:49:18.055865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.055714    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t2qgg\""
Jul 29 08:49:18.066768 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.066730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db7d5bf-7zwv5"]
Jul 29 08:49:18.068858 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.068831    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 08:49:18.106909 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.106869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47be8c64-d928-4341-91b7-c08f6107153e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.107092 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.106935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppx5\" (UniqueName: \"kubernetes.io/projected/47be8c64-d928-4341-91b7-c08f6107153e-kube-api-access-5ppx5\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.107542 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.107515    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:49:18.107643 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.107625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" event={"ID":"b5a9ee01-32e8-4005-8e26-205b1afcdde0","Type":"ContainerStarted","Data":"94bda6d55cd94b33016c135f422bcbd7130bd0a23ace00ea0d82a9f46ed355bf"}
Jul 29 08:49:18.108378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.108358    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:49:18.110433 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.110408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47be8c64-d928-4341-91b7-c08f6107153e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.111763 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.111589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j6zx6" event={"ID":"e8f4f881-b42e-4d37-ad44-1707cc060151","Type":"ContainerStarted","Data":"a7051788ec8a4f580ac77d7a45d0bb48293b36756855035138e0e447473a0996"}
Jul 29 08:49:18.116449 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.116311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh"
Jul 29 08:49:18.135979 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.135885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppx5\" (UniqueName: \"kubernetes.io/projected/47be8c64-d928-4341-91b7-c08f6107153e-kube-api-access-5ppx5\") pod \"managed-serviceaccount-addon-agent-6c76f9c46-7262j\" (UID: \"47be8c64-d928-4341-91b7-c08f6107153e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.165173 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.165110    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-wdbhh" podStartSLOduration=24.683629576 podStartE2EDuration="29.165088234s" totalImagesPullingTime="4.481458658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:18.13783293 +0000 UTC m=+96.109975806" watchObservedRunningTime="2026-07-29 08:49:18.165088234 +0000 UTC m=+96.137231111"
Jul 29 08:49:18.188817 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.188785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"
Jul 29 08:49:18.207604 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-registry-tls\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207728 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llr8t\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-kube-api-access-llr8t\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207728 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-registry-certificates\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207728 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-bound-sa-token\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-trusted-ca\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-image-registry-private-configuration\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-installation-pull-secrets\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.207850 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.207827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01e24675-ede7-48ab-a510-dce1d5414e96-ca-trust-extracted\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308542 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-registry-certificates\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-bound-sa-token\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-trusted-ca\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-image-registry-private-configuration\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-installation-pull-secrets\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.308734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01e24675-ede7-48ab-a510-dce1d5414e96-ca-trust-extracted\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.309008 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-registry-tls\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.309008 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.308792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llr8t\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-kube-api-access-llr8t\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.309530 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.309397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01e24675-ede7-48ab-a510-dce1d5414e96-ca-trust-extracted\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.309530 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.309447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-registry-certificates\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.310283 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.310231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01e24675-ede7-48ab-a510-dce1d5414e96-trusted-ca\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.311713 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.311690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-image-registry-private-configuration\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.311844 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.311823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01e24675-ede7-48ab-a510-dce1d5414e96-installation-pull-secrets\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.311950 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.311927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-registry-tls\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.339714 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.339678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-bound-sa-token\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.339855 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.339817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llr8t\" (UniqueName: \"kubernetes.io/projected/01e24675-ede7-48ab-a510-dce1d5414e96-kube-api-access-llr8t\") pod \"image-registry-74db7d5bf-7zwv5\" (UID: \"01e24675-ede7-48ab-a510-dce1d5414e96\") " pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.344591 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.344565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:18.371606 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.371528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j"]
Jul 29 08:49:18.376868 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:18.376827    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47be8c64_d928_4341_91b7_c08f6107153e.slice/crio-2e56084c77af937764a605126c0f9c7910b1474070a482d9b7462d9210942bcc WatchSource:0}: Error finding container 2e56084c77af937764a605126c0f9c7910b1474070a482d9b7462d9210942bcc: Status 404 returned error can't find the container with id 2e56084c77af937764a605126c0f9c7910b1474070a482d9b7462d9210942bcc
Jul 29 08:49:18.498078 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:18.498040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db7d5bf-7zwv5"]
Jul 29 08:49:18.501585 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:18.501554    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e24675_ede7_48ab_a510_dce1d5414e96.slice/crio-013ea9e2605944d80517e48bfbe1493ccc70d072d11250fae5178db7e0e5f595 WatchSource:0}: Error finding container 013ea9e2605944d80517e48bfbe1493ccc70d072d11250fae5178db7e0e5f595: Status 404 returned error can't find the container with id 013ea9e2605944d80517e48bfbe1493ccc70d072d11250fae5178db7e0e5f595
Jul 29 08:49:19.116677 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:19.116638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5" event={"ID":"01e24675-ede7-48ab-a510-dce1d5414e96","Type":"ContainerStarted","Data":"8e0df38965bcbe802624137447e2d25dabdeedc89b78b3f67bdb7c4bf8b373df"}
Jul 29 08:49:19.117143 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:19.116699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5" event={"ID":"01e24675-ede7-48ab-a510-dce1d5414e96","Type":"ContainerStarted","Data":"013ea9e2605944d80517e48bfbe1493ccc70d072d11250fae5178db7e0e5f595"}
Jul 29 08:49:19.117143 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:19.116851    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:19.118119 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:19.118095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j" event={"ID":"47be8c64-d928-4341-91b7-c08f6107153e","Type":"ContainerStarted","Data":"2e56084c77af937764a605126c0f9c7910b1474070a482d9b7462d9210942bcc"}
Jul 29 08:49:19.140751 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:19.140697    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5" podStartSLOduration=2.140680436 podStartE2EDuration="2.140680436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:19.139365187 +0000 UTC m=+97.111508061" watchObservedRunningTime="2026-07-29 08:49:19.140680436 +0000 UTC m=+97.112823315"
Jul 29 08:49:21.127957 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.127919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j6zx6" event={"ID":"e8f4f881-b42e-4d37-ad44-1707cc060151","Type":"ContainerStarted","Data":"73a665c62ba7eaf0bff21b8632aacb3c8bb3b1ce7f7abc89c32cefdb5b593dad"}
Jul 29 08:49:21.437815 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.437728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:49:21.440510 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.440475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e13d41b-8be4-437a-9629-443e1e5cf2eb-metrics-tls\") pod \"dns-default-sg6gw\" (UID: \"4e13d41b-8be4-437a-9629-443e1e5cf2eb\") " pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:49:21.721750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.721680    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68zl6\""
Jul 29 08:49:21.728020 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.727991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:49:21.943651 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.943608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:21.944372 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.944347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4982339-3ff4-407a-80ae-922cfa8cdcbd-service-ca-bundle\") pod \"router-default-68555bcf85-tdf9s\" (UID: \"a4982339-3ff4-407a-80ae-922cfa8cdcbd\") " pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:21.977966 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:21.977871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:22.616125 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:22.616094    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sg6gw"]
Jul 29 08:49:22.619048 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:22.618991    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e13d41b_8be4_437a_9629_443e1e5cf2eb.slice/crio-5c80acb763f43a6871884dc2e70300c84aa784be0f04f462bb567b3bf79efd97 WatchSource:0}: Error finding container 5c80acb763f43a6871884dc2e70300c84aa784be0f04f462bb567b3bf79efd97: Status 404 returned error can't find the container with id 5c80acb763f43a6871884dc2e70300c84aa784be0f04f462bb567b3bf79efd97
Jul 29 08:49:22.634516 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:22.634471    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68555bcf85-tdf9s"]
Jul 29 08:49:22.637371 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:22.637345    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4982339_3ff4_407a_80ae_922cfa8cdcbd.slice/crio-f0852b1f09847c32462029c69e2c8cccb90c3610acf457d4bd21f1e69083b92e WatchSource:0}: Error finding container f0852b1f09847c32462029c69e2c8cccb90c3610acf457d4bd21f1e69083b92e: Status 404 returned error can't find the container with id f0852b1f09847c32462029c69e2c8cccb90c3610acf457d4bd21f1e69083b92e
Jul 29 08:49:23.137830 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.137775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j" event={"ID":"47be8c64-d928-4341-91b7-c08f6107153e","Type":"ContainerStarted","Data":"3b141805a3a0ea97fc9c822c6d8ecf75619470ffdfdcc8a01852effb07d1799a"}
Jul 29 08:49:23.139170 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.139137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6gw" event={"ID":"4e13d41b-8be4-437a-9629-443e1e5cf2eb","Type":"ContainerStarted","Data":"5c80acb763f43a6871884dc2e70300c84aa784be0f04f462bb567b3bf79efd97"}
Jul 29 08:49:23.140753 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.140727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68555bcf85-tdf9s" event={"ID":"a4982339-3ff4-407a-80ae-922cfa8cdcbd","Type":"ContainerStarted","Data":"e739c69b1190afdc97bb6297b004ae68eb1adbf349c2174f54524488d2f4b0e4"}
Jul 29 08:49:23.140860 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.140771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68555bcf85-tdf9s" event={"ID":"a4982339-3ff4-407a-80ae-922cfa8cdcbd","Type":"ContainerStarted","Data":"f0852b1f09847c32462029c69e2c8cccb90c3610acf457d4bd21f1e69083b92e"}
Jul 29 08:49:23.157650 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.157555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c76f9c46-7262j" podStartSLOduration=1.624997963 podStartE2EDuration="6.157541098s" totalImagesPullingTime="4.532543135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:23.156994507 +0000 UTC m=+101.129137382" watchObservedRunningTime="2026-07-29 08:49:23.157541098 +0000 UTC m=+101.129683973"
Jul 29 08:49:23.186338 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.186236    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68555bcf85-tdf9s" podStartSLOduration=33.186213279 podStartE2EDuration="33.186213279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:23.183630913 +0000 UTC m=+101.155773789" watchObservedRunningTime="2026-07-29 08:49:23.186213279 +0000 UTC m=+101.158356153"
Jul 29 08:49:23.978116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.978074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:23.980961 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:23.980937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:24.145470 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:24.145426    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:24.146827 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:24.146762    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68555bcf85-tdf9s"
Jul 29 08:49:26.152628 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:26.152588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j6zx6" event={"ID":"e8f4f881-b42e-4d37-ad44-1707cc060151","Type":"ContainerStarted","Data":"f17458f64f33f91e4f3c84386ce4505d207f98c7d6b90503e7f4d13b447a933d"}
Jul 29 08:49:26.169863 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:26.169731    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j6zx6" podStartSLOduration=16.631967916 podStartE2EDuration="30.169711176s" totalImagesPullingTime="13.53774326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:48:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:26.169513755 +0000 UTC m=+104.141656630" watchObservedRunningTime="2026-07-29 08:49:26.169711176 +0000 UTC m=+104.141854052"
Jul 29 08:49:27.033472 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:27.033434    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4q6x4"
Jul 29 08:49:27.157968 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:27.157923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6gw" event={"ID":"4e13d41b-8be4-437a-9629-443e1e5cf2eb","Type":"ContainerStarted","Data":"f0c6e6ec6abe9b7c166cb195cb8f143e9b13f3f555832e62bf697da235873f66"}
Jul 29 08:49:27.158438 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:27.157989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sg6gw" event={"ID":"4e13d41b-8be4-437a-9629-443e1e5cf2eb","Type":"ContainerStarted","Data":"380816abe9843ae7fb2ab69462b009581582514aa6f1c001be7adad45bbead1d"}
Jul 29 08:49:27.158438 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:27.158161    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:49:27.176983 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:27.176934    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sg6gw" podStartSLOduration=66.632755016 podStartE2EDuration="1m10.176917807s" totalImagesPullingTime="3.544162791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:27.1755946 +0000 UTC m=+105.147737480" watchObservedRunningTime="2026-07-29 08:49:27.176917807 +0000 UTC m=+105.149060676"
Jul 29 08:49:37.164003 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:37.163972    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sg6gw"
Jul 29 08:49:40.126726 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:40.126699    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74db7d5bf-7zwv5"
Jul 29 08:49:46.396727 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.396688    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"]
Jul 29 08:49:46.400090 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.400071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.403372 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.403349    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 08:49:46.403769 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.403753    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 08:49:46.404110 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.404095    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 08:49:46.404177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.404115    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lvzjf\""
Jul 29 08:49:46.404374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.404353    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 08:49:46.404464 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.404376    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 08:49:46.433116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.433084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"]
Jul 29 08:49:46.439081 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.439056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205cb49-9d3c-4ef0-ba43-3331fea2175d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.439213 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.439101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.439213 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.439126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.439213 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.439194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkfkv\" (UniqueName: \"kubernetes.io/projected/5205cb49-9d3c-4ef0-ba43-3331fea2175d-kube-api-access-fkfkv\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.503338 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.503303    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4d2dl"]
Jul 29 08:49:46.506355 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.506339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.511343 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.511321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 08:49:46.511464 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.511324    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 08:49:46.511998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.511975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 08:49:46.512126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.512111    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b8lr8\""
Jul 29 08:49:46.540084 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.540049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.540246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.540089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.540246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.540128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkfkv\" (UniqueName: \"kubernetes.io/projected/5205cb49-9d3c-4ef0-ba43-3331fea2175d-kube-api-access-fkfkv\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.540246 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.540158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205cb49-9d3c-4ef0-ba43-3331fea2175d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.540798 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.540770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5205cb49-9d3c-4ef0-ba43-3331fea2175d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.542565 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.542537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.542659 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.542612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5205cb49-9d3c-4ef0-ba43-3331fea2175d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.556149 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.556125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkfkv\" (UniqueName: \"kubernetes.io/projected/5205cb49-9d3c-4ef0-ba43-3331fea2175d-kube-api-access-fkfkv\") pod \"openshift-state-metrics-b8f49f5c6-xfvdk\" (UID: \"5205cb49-9d3c-4ef0-ba43-3331fea2175d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.640602 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-textfile\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-metrics-client-ca\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-accelerators-collector-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkcc\" (UniqueName: \"kubernetes.io/projected/4adb981c-2cd5-4d85-a780-9f4dc7017455-kube-api-access-prkcc\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-root\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-tls\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-wtmp\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.640998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.640852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-sys\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.708999 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.708908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"
Jul 29 08:49:46.741862 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-root\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.741862 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-tls\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-root\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741938    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-wtmp\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.741997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-sys\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-textfile\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-metrics-client-ca\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-accelerators-collector-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkcc\" (UniqueName: \"kubernetes.io/projected/4adb981c-2cd5-4d85-a780-9f4dc7017455-kube-api-access-prkcc\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742560 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-sys\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.742560 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-wtmp\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.743111 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.742993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-textfile\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.743111 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.743032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-metrics-client-ca\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.743111 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.743088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-accelerators-collector-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.744792 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.744773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-tls\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.745141 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.745123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adb981c-2cd5-4d85-a780-9f4dc7017455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.763836 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.763802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkcc\" (UniqueName: \"kubernetes.io/projected/4adb981c-2cd5-4d85-a780-9f4dc7017455-kube-api-access-prkcc\") pod \"node-exporter-4d2dl\" (UID: \"4adb981c-2cd5-4d85-a780-9f4dc7017455\") " pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.815273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.815241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4d2dl"
Jul 29 08:49:46.826567 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:46.826535    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adb981c_2cd5_4d85_a780_9f4dc7017455.slice/crio-7345e24c9ed73c51b92b349e9ef63fbf23dd4ff024591e0bf8646fa1b4a12c57 WatchSource:0}: Error finding container 7345e24c9ed73c51b92b349e9ef63fbf23dd4ff024591e0bf8646fa1b4a12c57: Status 404 returned error can't find the container with id 7345e24c9ed73c51b92b349e9ef63fbf23dd4ff024591e0bf8646fa1b4a12c57
Jul 29 08:49:46.844127 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:46.844104    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk"]
Jul 29 08:49:46.845845 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:46.845822    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5205cb49_9d3c_4ef0_ba43_3331fea2175d.slice/crio-8d8b62177c491157c0781988882cbe735aa4dc597a57c87aacd68c99db0fd8ad WatchSource:0}: Error finding container 8d8b62177c491157c0781988882cbe735aa4dc597a57c87aacd68c99db0fd8ad: Status 404 returned error can't find the container with id 8d8b62177c491157c0781988882cbe735aa4dc597a57c87aacd68c99db0fd8ad
Jul 29 08:49:47.220957 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:47.220851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4d2dl" event={"ID":"4adb981c-2cd5-4d85-a780-9f4dc7017455","Type":"ContainerStarted","Data":"7345e24c9ed73c51b92b349e9ef63fbf23dd4ff024591e0bf8646fa1b4a12c57"}
Jul 29 08:49:47.222434 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:47.222408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk" event={"ID":"5205cb49-9d3c-4ef0-ba43-3331fea2175d","Type":"ContainerStarted","Data":"8c61be4f4486e0d7b1e33d032460c1584d9a469f97945d9abd26b4ed95888cf3"}
Jul 29 08:49:47.222544 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:47.222457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk" event={"ID":"5205cb49-9d3c-4ef0-ba43-3331fea2175d","Type":"ContainerStarted","Data":"c6d9943b7fde9a44a351d193c2fbd77cce7e0b8e8b6e279211efba23eaa96303"}
Jul 29 08:49:47.222544 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:47.222475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk" event={"ID":"5205cb49-9d3c-4ef0-ba43-3331fea2175d","Type":"ContainerStarted","Data":"8d8b62177c491157c0781988882cbe735aa4dc597a57c87aacd68c99db0fd8ad"}
Jul 29 08:49:48.228717 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.228687    2573 generic.go:356] "Generic (PLEG): container finished" podID="4adb981c-2cd5-4d85-a780-9f4dc7017455" containerID="8e834ddc7b68b826292fab33e29b0f85f36e11fd64a30b505754a8db3d7914c9" exitCode=0
Jul 29 08:49:48.229166 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.228757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4d2dl" event={"ID":"4adb981c-2cd5-4d85-a780-9f4dc7017455","Type":"ContainerDied","Data":"8e834ddc7b68b826292fab33e29b0f85f36e11fd64a30b505754a8db3d7914c9"}
Jul 29 08:49:48.459540 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.459518    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"]
Jul 29 08:49:48.463860 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.463839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.465768 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.465745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 08:49:48.466968 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.466874    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-g5n54rqpbm29\""
Jul 29 08:49:48.467411 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.467390    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bz8q7\""
Jul 29 08:49:48.467838 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.467789    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 08:49:48.468523 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.468504    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 08:49:48.468610 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.468529    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 08:49:48.468926 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.468908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 08:49:48.482386 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.480213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"]
Jul 29 08:49:48.557906 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.557859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558039 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.557912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e674a05-4820-45f2-822d-74dbc96f8d3e-metrics-client-ca\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558039 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.557979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558039 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.558001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6j4v\" (UniqueName: \"kubernetes.io/projected/6e674a05-4820-45f2-822d-74dbc96f8d3e-kube-api-access-c6j4v\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558039 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.558024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.558042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.558066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.558177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.558100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-grpc-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658633 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6j4v\" (UniqueName: \"kubernetes.io/projected/6e674a05-4820-45f2-822d-74dbc96f8d3e-kube-api-access-c6j4v\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658633 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658922 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658922 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658922 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-grpc-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.658922 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.659133 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e674a05-4820-45f2-822d-74dbc96f8d3e-metrics-client-ca\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.659133 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.658993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.659769 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.659743    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e674a05-4820-45f2-822d-74dbc96f8d3e-metrics-client-ca\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.661833 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.661808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.661976 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.661908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.662038 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.661970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.662092 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.662072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.662167 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.662148    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.662202 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.662186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e674a05-4820-45f2-822d-74dbc96f8d3e-secret-grpc-tls\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.672466 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.672428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6j4v\" (UniqueName: \"kubernetes.io/projected/6e674a05-4820-45f2-822d-74dbc96f8d3e-kube-api-access-c6j4v\") pod \"thanos-querier-5cbf85d6fc-mj4jj\" (UID: \"6e674a05-4820-45f2-822d-74dbc96f8d3e\") " pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.783692 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.783601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:48.931975 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:48.931941    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"]
Jul 29 08:49:48.935243 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:48.935203    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e674a05_4820_45f2_822d_74dbc96f8d3e.slice/crio-931c4fbe2c83c4af70367f77ab5ba58108e37793f5115ee9ff20c14f879752bf WatchSource:0}: Error finding container 931c4fbe2c83c4af70367f77ab5ba58108e37793f5115ee9ff20c14f879752bf: Status 404 returned error can't find the container with id 931c4fbe2c83c4af70367f77ab5ba58108e37793f5115ee9ff20c14f879752bf
Jul 29 08:49:49.233874 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.233832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"931c4fbe2c83c4af70367f77ab5ba58108e37793f5115ee9ff20c14f879752bf"}
Jul 29 08:49:49.235869 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.235846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4d2dl" event={"ID":"4adb981c-2cd5-4d85-a780-9f4dc7017455","Type":"ContainerStarted","Data":"6d6d8ed01dfbe7ed9233af818c84374f08e1fbc86dbf1ba0b68a323b88aec175"}
Jul 29 08:49:49.236027 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.235917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4d2dl" event={"ID":"4adb981c-2cd5-4d85-a780-9f4dc7017455","Type":"ContainerStarted","Data":"d3794446e2cb8dda6d34e1e7379aa52a80d44441b004f111881747f9483f7edb"}
Jul 29 08:49:49.237840 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.237819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk" event={"ID":"5205cb49-9d3c-4ef0-ba43-3331fea2175d","Type":"ContainerStarted","Data":"141ad87acd5f262125b677dcc236a90d0fc1d8989f74090df1c91cc5ef2e13ad"}
Jul 29 08:49:49.366124 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.366078    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4d2dl" podStartSLOduration=2.319964308 podStartE2EDuration="3.366061412s" totalImagesPullingTime="979.651156ms" totalInitContainerRuntime="66.445948ms" isStatefulPod=true podCreationTimestamp="2026-07-29 08:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:49.364972437 +0000 UTC m=+127.337115312" watchObservedRunningTime="2026-07-29 08:49:49.366061412 +0000 UTC m=+127.338204288"
Jul 29 08:49:49.406466 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:49.406418    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xfvdk" podStartSLOduration=1.920818508 podStartE2EDuration="3.406401061s" totalImagesPullingTime="1.485582553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:49.405966702 +0000 UTC m=+127.378109577" watchObservedRunningTime="2026-07-29 08:49:49.406401061 +0000 UTC m=+127.378543935"
Jul 29 08:49:51.726727 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.726692    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"]
Jul 29 08:49:51.759140 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.759072    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"]
Jul 29 08:49:51.759295 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.759214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.763867 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.763843    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 08:49:51.764062 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.763846    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 08:49:51.764062 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.763914    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 08:49:51.764207 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.764063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v7kzm\""
Jul 29 08:49:51.765522 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.765502    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 08:49:51.765522 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.765519    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 08:49:51.771609 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.771578    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 08:49:51.886803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n878v\" (UniqueName: \"kubernetes.io/projected/6ec93548-a381-4c12-ae5c-a5e6657dc499-kube-api-access-n878v\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-metrics-client-ca\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-serving-certs-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.886993 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.886974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-federate-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.887313 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.887061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987668 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-federate-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n878v\" (UniqueName: \"kubernetes.io/projected/6ec93548-a381-4c12-ae5c-a5e6657dc499-kube-api-access-n878v\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.987823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.988055 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-metrics-client-ca\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.988055 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.987864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-serving-certs-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.988686 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.988630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-serving-certs-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.988686 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.988666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-metrics-client-ca\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.989011 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.988987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.990490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.990464    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-federate-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.990613 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.990504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-telemeter-client-tls\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.990681 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.990645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.990781 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.990755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ec93548-a381-4c12-ae5c-a5e6657dc499-secret-telemeter-client\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:51.999450 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:51.999430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n878v\" (UniqueName: \"kubernetes.io/projected/6ec93548-a381-4c12-ae5c-a5e6657dc499-kube-api-access-n878v\") pod \"telemeter-client-6948fc4d76-jsx9p\" (UID: \"6ec93548-a381-4c12-ae5c-a5e6657dc499\") " pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:52.069477 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.069400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"
Jul 29 08:49:52.230719 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.230690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6948fc4d76-jsx9p"]
Jul 29 08:49:52.233407 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:52.233378    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec93548_a381_4c12_ae5c_a5e6657dc499.slice/crio-7ed1514f42ce0072f6274cd48eef5583b23a0c4d455653572cd0e658f7895323 WatchSource:0}: Error finding container 7ed1514f42ce0072f6274cd48eef5583b23a0c4d455653572cd0e658f7895323: Status 404 returned error can't find the container with id 7ed1514f42ce0072f6274cd48eef5583b23a0c4d455653572cd0e658f7895323
Jul 29 08:49:52.251575 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.251542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"6d011e071e426ac45bc96e3ddfb26fa7b7068ec3cb767fa64d03476688dd34a3"}
Jul 29 08:49:52.251685 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.251616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"6c60b234ea079900efa855f71e6d9a5f418c20e8d7adaead779386abffe9520e"}
Jul 29 08:49:52.251685 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.251648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"eec6f8c012bb42c325fac742196a90d983e8dd8bd0db7a225b1457018d994f20"}
Jul 29 08:49:52.252694 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.252667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p" event={"ID":"6ec93548-a381-4c12-ae5c-a5e6657dc499","Type":"ContainerStarted","Data":"7ed1514f42ce0072f6274cd48eef5583b23a0c4d455653572cd0e658f7895323"}
Jul 29 08:49:52.391181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.391142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:49:52.393933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.393882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f331ed4-9dc7-4481-beea-e463af96775c-metrics-certs\") pod \"network-metrics-daemon-js5hz\" (UID: \"0f331ed4-9dc7-4481-beea-e463af96775c\") " pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:49:52.561311 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.561283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmmnd\""
Jul 29 08:49:52.570017 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.569993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-js5hz"
Jul 29 08:49:52.711237 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:52.711213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-js5hz"]
Jul 29 08:49:52.741864 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:49:52.741828    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f331ed4_9dc7_4481_beea_e463af96775c.slice/crio-b6e08b981b0aea3d59693387f45a260ebff11333174eebb59656bcbac1805047 WatchSource:0}: Error finding container b6e08b981b0aea3d59693387f45a260ebff11333174eebb59656bcbac1805047: Status 404 returned error can't find the container with id b6e08b981b0aea3d59693387f45a260ebff11333174eebb59656bcbac1805047
Jul 29 08:49:53.258265 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.258180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-js5hz" event={"ID":"0f331ed4-9dc7-4481-beea-e463af96775c","Type":"ContainerStarted","Data":"b6e08b981b0aea3d59693387f45a260ebff11333174eebb59656bcbac1805047"}
Jul 29 08:49:53.261713 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.261682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"ec513868f2ee137a8f3bd08194890d4ae90d67b162851dd3e8c12f2bd562af12"}
Jul 29 08:49:53.261835 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.261750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"cb8a6538c9778a9a0b1fa75f53511d514934fb813176919453c37c7c64d53949"}
Jul 29 08:49:53.261835 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.261795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" event={"ID":"6e674a05-4820-45f2-822d-74dbc96f8d3e","Type":"ContainerStarted","Data":"64ec2ee4d435f3517f7273e2a10bec8315e2c8cc2ccc90ae187affabbe14cbbc"}
Jul 29 08:49:53.262003 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.261936    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:53.301199 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:53.301125    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj" podStartSLOduration=1.776222003 podStartE2EDuration="5.301102055s" totalImagesPullingTime="3.524880052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:53.299134856 +0000 UTC m=+131.271277751" watchObservedRunningTime="2026-07-29 08:49:53.301102055 +0000 UTC m=+131.273244931"
Jul 29 08:49:55.270513 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:55.270415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p" event={"ID":"6ec93548-a381-4c12-ae5c-a5e6657dc499","Type":"ContainerStarted","Data":"457c7c94ce5c469c216985921f8c698232c19052c256f21be2b8d63b44cb38f9"}
Jul 29 08:49:55.272198 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:55.272170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-js5hz" event={"ID":"0f331ed4-9dc7-4481-beea-e463af96775c","Type":"ContainerStarted","Data":"6bbfe369b74e06b1a0c99fcc1d1b4c31afc655a937bb6e4bc0ba56b1169b3d3b"}
Jul 29 08:49:55.272302 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:55.272243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-js5hz" event={"ID":"0f331ed4-9dc7-4481-beea-e463af96775c","Type":"ContainerStarted","Data":"078fd53c9f6d32d0b16bd3d5b084337f7efb14a2bfe36ed2a4dfd0c6d9d268ce"}
Jul 29 08:49:55.290525 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:55.290475    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-js5hz" podStartSLOduration=131.201893116 podStartE2EDuration="2m13.290460113s" totalImagesPullingTime="2.088566997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:55.288703794 +0000 UTC m=+133.260846681" watchObservedRunningTime="2026-07-29 08:49:55.290460113 +0000 UTC m=+133.262602988"
Jul 29 08:49:57.286148 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:57.286099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p" event={"ID":"6ec93548-a381-4c12-ae5c-a5e6657dc499","Type":"ContainerStarted","Data":"4cae73ef238fc87844b06e1bfae023190307eba5b7685880dfe068891d8a6563"}
Jul 29 08:49:57.286525 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:57.286169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p" event={"ID":"6ec93548-a381-4c12-ae5c-a5e6657dc499","Type":"ContainerStarted","Data":"0741f5c6d8cb99423fea4444519dde84a6bd9ead0dd651c1b45990ec59eaf0fd"}
Jul 29 08:49:57.312294 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:57.312226    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6948fc4d76-jsx9p" podStartSLOduration=2.299405311 podStartE2EDuration="6.312210817s" totalImagesPullingTime="4.012805506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:57.311452329 +0000 UTC m=+135.283595194" watchObservedRunningTime="2026-07-29 08:49:57.312210817 +0000 UTC m=+135.284353732"
Jul 29 08:49:58.228715 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.228683    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:49:58.236046 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.236021    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.238323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.238296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 08:49:58.238457 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.238356    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 08:49:58.238457 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.238360    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 08:49:58.238457 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.238362    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 08:49:58.239141 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.239120    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fpl6s\""
Jul 29 08:49:58.239241 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.239220    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 08:49:58.239300 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.239262    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 08:49:58.239349 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.239325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 08:49:58.244172 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.244153    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 08:49:58.254329 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.252728    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:49:58.345982 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.345946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.346396 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.346275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447457 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447666 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447666 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447666 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447831 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447831 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.447831 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.447804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.448580 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.448370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.448580 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.448380    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.448580 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.448375    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.449394 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.449372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.450103 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.450077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.450325 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.450308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.456123 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.456105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m\") pod \"console-5f5b7fdfff-f29rs\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") " pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.546827 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.546739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:49:58.684956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:58.679664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:49:59.273256 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:59.273223    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cbf85d6fc-mj4jj"
Jul 29 08:49:59.297067 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:49:59.297013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5b7fdfff-f29rs" event={"ID":"d565af70-d80f-4cf1-9eca-5126f15fb65c","Type":"ContainerStarted","Data":"740214da8c1295ff7b0122a0242e7b0939e86149d93055b23c87ddfe9c8cad98"}
Jul 29 08:50:02.310233 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:02.310199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5b7fdfff-f29rs" event={"ID":"d565af70-d80f-4cf1-9eca-5126f15fb65c","Type":"ContainerStarted","Data":"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"}
Jul 29 08:50:02.330909 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:02.330834    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5b7fdfff-f29rs" podStartSLOduration=1.317897268 podStartE2EDuration="4.330817677s" totalImagesPullingTime="3.012920409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:50:02.329815914 +0000 UTC m=+140.301958812" watchObservedRunningTime="2026-07-29 08:50:02.330817677 +0000 UTC m=+140.302960552"
Jul 29 08:50:08.547865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:08.547824    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:50:08.548481 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:08.547914    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:50:08.552872 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:08.552850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:50:09.341085 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:09.341056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:50:21.383712 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:21.383674    2573 generic.go:356] "Generic (PLEG): container finished" podID="d3553627-ff60-4db8-8abf-a093140c17e7" containerID="a26b0e086a0860a04d5c99e3884ebd3421bb5719733d25afcf015de1664df2e7" exitCode=0
Jul 29 08:50:21.384144 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:21.383725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zqcq6" event={"ID":"d3553627-ff60-4db8-8abf-a093140c17e7","Type":"ContainerDied","Data":"a26b0e086a0860a04d5c99e3884ebd3421bb5719733d25afcf015de1664df2e7"}
Jul 29 08:50:21.384144 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:21.384097    2573 scope.go:117] "RemoveContainer" containerID="a26b0e086a0860a04d5c99e3884ebd3421bb5719733d25afcf015de1664df2e7"
Jul 29 08:50:22.389045 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:50:22.389011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zqcq6" event={"ID":"d3553627-ff60-4db8-8abf-a093140c17e7","Type":"ContainerStarted","Data":"3d36ccc200cbd319873adfd13acc498679d47052ffe17f2a7048db7d5581d92d"}
Jul 29 08:51:27.331537 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:27.331499    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:51:52.351767 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.351690    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f5b7fdfff-f29rs" podUID="d565af70-d80f-4cf1-9eca-5126f15fb65c" containerName="console" containerID="cri-o://2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd" gracePeriod=15
Jul 29 08:51:52.605671 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.605611    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:51:52.705037 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.704999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705037 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705289 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705073    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705289 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705289 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705122    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705289 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705169    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705289 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle\") pod \"d565af70-d80f-4cf1-9eca-5126f15fb65c\" (UID: \"d565af70-d80f-4cf1-9eca-5126f15fb65c\") "
Jul 29 08:51:52.705607 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705577    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config" (OuterVolumeSpecName: "console-config") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:51:52.705689 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705623    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:51:52.705757 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705697    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:51:52.705814 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.705768    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:51:52.707413 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.707386    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m" (OuterVolumeSpecName: "kube-api-access-bdr5m") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "kube-api-access-bdr5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:51:52.707695 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.707673    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:51:52.707773 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.707693    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d565af70-d80f-4cf1-9eca-5126f15fb65c" (UID: "d565af70-d80f-4cf1-9eca-5126f15fb65c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:51:52.730965 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.730934    2573 generic.go:356] "Generic (PLEG): container finished" podID="d565af70-d80f-4cf1-9eca-5126f15fb65c" containerID="2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd" exitCode=0
Jul 29 08:51:52.731089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.730988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5b7fdfff-f29rs" event={"ID":"d565af70-d80f-4cf1-9eca-5126f15fb65c","Type":"ContainerDied","Data":"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"}
Jul 29 08:51:52.731089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.731026    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5b7fdfff-f29rs" event={"ID":"d565af70-d80f-4cf1-9eca-5126f15fb65c","Type":"ContainerDied","Data":"740214da8c1295ff7b0122a0242e7b0939e86149d93055b23c87ddfe9c8cad98"}
Jul 29 08:51:52.731089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.731046    2573 scope.go:117] "RemoveContainer" containerID="2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"
Jul 29 08:51:52.731089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.730990    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5b7fdfff-f29rs"
Jul 29 08:51:52.739118 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.739103    2573 scope.go:117] "RemoveContainer" containerID="2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"
Jul 29 08:51:52.739358 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:51:52.739337    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd\": container with ID starting with 2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd not found: ID does not exist" containerID="2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"
Jul 29 08:51:52.739413 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.739369    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd"} err="failed to get container status \"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd\": rpc error: code = NotFound desc = could not find container \"2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd\": container with ID starting with 2585c018a73829160a1c26fdf4497f982758575b1c68d92aa63cd8fe50c3f3bd not found: ID does not exist"
Jul 29 08:51:52.751834 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.751811    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:51:52.755909 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.755878    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5b7fdfff-f29rs"]
Jul 29 08:51:52.805967 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.805932    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.805967 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.805964    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-trusted-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.806137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.805979    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-oauth-serving-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.806137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.805993    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-oauth-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.806137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.806005    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdr5m\" (UniqueName: \"kubernetes.io/projected/d565af70-d80f-4cf1-9eca-5126f15fb65c-kube-api-access-bdr5m\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.806137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.806017    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d565af70-d80f-4cf1-9eca-5126f15fb65c-console-serving-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:52.806137 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:52.806029    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d565af70-d80f-4cf1-9eca-5126f15fb65c-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:51:54.643716 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:51:54.643686    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d565af70-d80f-4cf1-9eca-5126f15fb65c" path="/var/lib/kubelet/pods/d565af70-d80f-4cf1-9eca-5126f15fb65c/volumes"
Jul 29 08:52:33.371430 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.371394    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"]
Jul 29 08:52:33.371957 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.371717    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d565af70-d80f-4cf1-9eca-5126f15fb65c" containerName="console"
Jul 29 08:52:33.371957 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.371729    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d565af70-d80f-4cf1-9eca-5126f15fb65c" containerName="console"
Jul 29 08:52:33.371957 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.371786    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d565af70-d80f-4cf1-9eca-5126f15fb65c" containerName="console"
Jul 29 08:52:33.374743 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.374726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.376744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.376718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-z9wpw\""
Jul 29 08:52:33.377210 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.377191    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 08:52:33.377270 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.377233    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:52:33.391233 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.391213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"]
Jul 29 08:52:33.416602 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.416572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f50c11d9-9031-4669-a45c-2d7aa52c078c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.416713 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.416614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzlpc\" (UniqueName: \"kubernetes.io/projected/f50c11d9-9031-4669-a45c-2d7aa52c078c-kube-api-access-lzlpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.517972 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.517933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f50c11d9-9031-4669-a45c-2d7aa52c078c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.517972 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.517974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzlpc\" (UniqueName: \"kubernetes.io/projected/f50c11d9-9031-4669-a45c-2d7aa52c078c-kube-api-access-lzlpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.518336 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.518317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f50c11d9-9031-4669-a45c-2d7aa52c078c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.526985 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.526956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzlpc\" (UniqueName: \"kubernetes.io/projected/f50c11d9-9031-4669-a45c-2d7aa52c078c-kube-api-access-lzlpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-zsdms\" (UID: \"f50c11d9-9031-4669-a45c-2d7aa52c078c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.683676 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.683588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"
Jul 29 08:52:33.811168 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.811120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms"]
Jul 29 08:52:33.814238 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:52:33.814211    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50c11d9_9031_4669_a45c_2d7aa52c078c.slice/crio-467f40a96c2728eb47e2e0642c45b07070676c084594cf36ffdfd461d26dcf23 WatchSource:0}: Error finding container 467f40a96c2728eb47e2e0642c45b07070676c084594cf36ffdfd461d26dcf23: Status 404 returned error can't find the container with id 467f40a96c2728eb47e2e0642c45b07070676c084594cf36ffdfd461d26dcf23
Jul 29 08:52:33.883950 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:33.883917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms" event={"ID":"f50c11d9-9031-4669-a45c-2d7aa52c078c","Type":"ContainerStarted","Data":"467f40a96c2728eb47e2e0642c45b07070676c084594cf36ffdfd461d26dcf23"}
Jul 29 08:52:36.900886 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:36.900848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms" event={"ID":"f50c11d9-9031-4669-a45c-2d7aa52c078c","Type":"ContainerStarted","Data":"8de4e6940b84e5ac9b138e355febdc0c64bd27ec2d569f4dd27230225032f701"}
Jul 29 08:52:36.935740 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:36.935681    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zsdms" podStartSLOduration=1.485327749 podStartE2EDuration="3.935664557s" totalImagesPullingTime="2.450336808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:52:36.928529437 +0000 UTC m=+294.900672312" watchObservedRunningTime="2026-07-29 08:52:36.935664557 +0000 UTC m=+294.907807431"
Jul 29 08:52:38.223206 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.223171    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"]
Jul 29 08:52:38.226615 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.226595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.228880 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.228861    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 08:52:38.229648 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.229627    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n4jml\""
Jul 29 08:52:38.229784 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.229627    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 08:52:38.237564 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.237542    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"]
Jul 29 08:52:38.260474 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.260441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbbbk\" (UniqueName: \"kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.260596 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.260504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.260596 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.260535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.361215 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.361185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.361358 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.361251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbbbk\" (UniqueName: \"kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.361358 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.361286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.361638 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.361619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.361638 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.361631    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.373696 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.373666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbbbk\" (UniqueName: \"kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.535488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.535410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:38.663410 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.663381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"]
Jul 29 08:52:38.665802 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:52:38.665775    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55bc552_568d_4f6b_ad2b_b2a74ff15a6b.slice/crio-a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f WatchSource:0}: Error finding container a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f: Status 404 returned error can't find the container with id a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f
Jul 29 08:52:38.910676 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:38.910640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx" event={"ID":"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b","Type":"ContainerStarted","Data":"a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f"}
Jul 29 08:52:42.454260 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:42.454229    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:52:42.467317 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:42.467291    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 08:52:42.468395 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:42.468371    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:52:45.944424 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:45.944388    2573 generic.go:356] "Generic (PLEG): container finished" podID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerID="62125f7d4f414f4b7de228c76445a880cf430208a1d987d8a2f829f6f843e615" exitCode=0
Jul 29 08:52:45.944964 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:45.944458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx" event={"ID":"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b","Type":"ContainerDied","Data":"62125f7d4f414f4b7de228c76445a880cf430208a1d987d8a2f829f6f843e615"}
Jul 29 08:52:45.945615 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:45.945590    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:52:48.959710 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:48.959672    2573 generic.go:356] "Generic (PLEG): container finished" podID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerID="75cf2eee2bc268b805df90968752acc713e0d890a48120b162f0eda0de422e1f" exitCode=0
Jul 29 08:52:48.959710 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:48.959712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx" event={"ID":"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b","Type":"ContainerDied","Data":"75cf2eee2bc268b805df90968752acc713e0d890a48120b162f0eda0de422e1f"}
Jul 29 08:52:55.992391 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:55.992352    2573 generic.go:356] "Generic (PLEG): container finished" podID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerID="7fa922b6721f373cdc0ae155b193c30fd07f73c9f112ddd37d07e68287be12bc" exitCode=0
Jul 29 08:52:55.992758 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:55.992428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx" event={"ID":"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b","Type":"ContainerDied","Data":"7fa922b6721f373cdc0ae155b193c30fd07f73c9f112ddd37d07e68287be12bc"}
Jul 29 08:52:57.120743 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.120719    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:57.218752 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.218719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbbbk\" (UniqueName: \"kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk\") pod \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") "
Jul 29 08:52:57.218972 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.218796    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle\") pod \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") "
Jul 29 08:52:57.218972 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.218850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util\") pod \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\" (UID: \"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b\") "
Jul 29 08:52:57.219201 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.219174    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle" (OuterVolumeSpecName: "bundle") pod "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" (UID: "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:52:57.221139 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.221108    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk" (OuterVolumeSpecName: "kube-api-access-zbbbk") pod "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" (UID: "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b"). InnerVolumeSpecName "kube-api-access-zbbbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:52:57.222967 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.222945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util" (OuterVolumeSpecName: "util") pod "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" (UID: "f55bc552-568d-4f6b-ad2b-b2a74ff15a6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:52:57.320188 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.320109    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbbbk\" (UniqueName: \"kubernetes.io/projected/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-kube-api-access-zbbbk\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:52:57.320188 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.320138    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:52:57.320188 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:57.320147    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f55bc552-568d-4f6b-ad2b-b2a74ff15a6b-util\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:52:58.002293 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:58.002267    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx"
Jul 29 08:52:58.002456 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:58.002259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6qllx" event={"ID":"f55bc552-568d-4f6b-ad2b-b2a74ff15a6b","Type":"ContainerDied","Data":"a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f"}
Jul 29 08:52:58.002456 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:52:58.002388    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4a269796b58be948b5d5d175adc80fe3d10f99bfb0b210b9d7a0f2889e67b0f"
Jul 29 08:53:02.827943 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.827911    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"]
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828219    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="extract"
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828231    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="extract"
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828249    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="util"
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828254    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="util"
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828273    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="pull"
Jul 29 08:53:02.828323 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828279    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="pull"
Jul 29 08:53:02.828504 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.828327    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f55bc552-568d-4f6b-ad2b-b2a74ff15a6b" containerName="extract"
Jul 29 08:53:02.888488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.888453    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"]
Jul 29 08:53:02.888668 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.888556    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:02.891330 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.891309    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 08:53:02.891488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.891468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:53:02.891531 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.891500    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5l9m7\""
Jul 29 08:53:02.968490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.968457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhpw\" (UniqueName: \"kubernetes.io/projected/24542b07-ca74-41bc-a364-bf9801a2cfc0-kube-api-access-5fhpw\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:02.968676 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:02.968516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24542b07-ca74-41bc-a364-bf9801a2cfc0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.069401 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.069357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fhpw\" (UniqueName: \"kubernetes.io/projected/24542b07-ca74-41bc-a364-bf9801a2cfc0-kube-api-access-5fhpw\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.069573 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.069421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24542b07-ca74-41bc-a364-bf9801a2cfc0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.069808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.069781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24542b07-ca74-41bc-a364-bf9801a2cfc0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.076853 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.076821    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fhpw\" (UniqueName: \"kubernetes.io/projected/24542b07-ca74-41bc-a364-bf9801a2cfc0-kube-api-access-5fhpw\") pod \"openshift-lws-operator-fd8ccff4c-zs26x\" (UID: \"24542b07-ca74-41bc-a364-bf9801a2cfc0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.198177 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.198132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"
Jul 29 08:53:03.347626 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:03.347601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x"]
Jul 29 08:53:03.350145 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:53:03.350111    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24542b07_ca74_41bc_a364_bf9801a2cfc0.slice/crio-cc3b13a10ecd4491a8eb5f8bd12b091a8810a81d69934f9c3a7e63d9ba3c4840 WatchSource:0}: Error finding container cc3b13a10ecd4491a8eb5f8bd12b091a8810a81d69934f9c3a7e63d9ba3c4840: Status 404 returned error can't find the container with id cc3b13a10ecd4491a8eb5f8bd12b091a8810a81d69934f9c3a7e63d9ba3c4840
Jul 29 08:53:04.029356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:04.029321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x" event={"ID":"24542b07-ca74-41bc-a364-bf9801a2cfc0","Type":"ContainerStarted","Data":"cc3b13a10ecd4491a8eb5f8bd12b091a8810a81d69934f9c3a7e63d9ba3c4840"}
Jul 29 08:53:06.043198 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:06.043160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x" event={"ID":"24542b07-ca74-41bc-a364-bf9801a2cfc0","Type":"ContainerStarted","Data":"cb94478ac76581aaca913f82465be0c1e827f40f094b7d486c576dca41fb4e7d"}
Jul 29 08:53:06.059754 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:06.059695    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zs26x" podStartSLOduration=2.032152909 podStartE2EDuration="4.059676457s" totalImagesPullingTime="2.027523548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:06.059296063 +0000 UTC m=+324.031438938" watchObservedRunningTime="2026-07-29 08:53:06.059676457 +0000 UTC m=+324.031819334"
Jul 29 08:53:22.012674 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.012641    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"]
Jul 29 08:53:22.015764 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.015748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.018032 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.018006    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 08:53:22.018183 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.018162    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7dtxx\""
Jul 29 08:53:22.018233 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.018162    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 08:53:22.018718 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.018705    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 08:53:22.019024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.019011    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 08:53:22.038822 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.038801    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"]
Jul 29 08:53:22.125625 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.125591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.125794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.125644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.125794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.125687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.125794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.125705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.125794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.125724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4djvk\" (UniqueName: \"kubernetes.io/projected/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-kube-api-access-4djvk\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226373 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226373 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226373 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226549 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4djvk\" (UniqueName: \"kubernetes.io/projected/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-kube-api-access-4djvk\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.226605 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.226572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.228554 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.228521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.228660 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.228638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.228734 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.228672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.237785 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.237763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4djvk\" (UniqueName: \"kubernetes.io/projected/7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c-kube-api-access-4djvk\") pod \"opendatahub-operator-controller-manager-67764bc7cd-758ck\" (UID: \"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.325790 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.325694    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:22.473566 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:22.473533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"]
Jul 29 08:53:22.478204 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:53:22.478177    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8581a4_ccd3_4939_8fd1_69e72cfa7d9c.slice/crio-3be094877fb54f42c30faef7ac838e187ede363b285cb803d8fe32f79a165cf8 WatchSource:0}: Error finding container 3be094877fb54f42c30faef7ac838e187ede363b285cb803d8fe32f79a165cf8: Status 404 returned error can't find the container with id 3be094877fb54f42c30faef7ac838e187ede363b285cb803d8fe32f79a165cf8
Jul 29 08:53:23.123959 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:23.123868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck" event={"ID":"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c","Type":"ContainerStarted","Data":"3be094877fb54f42c30faef7ac838e187ede363b285cb803d8fe32f79a165cf8"}
Jul 29 08:53:26.142863 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:26.142824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck" event={"ID":"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c","Type":"ContainerStarted","Data":"f3815a900e774fa846c38961dcebd0cb09719b4e45480a8db7b40f43a205b439"}
Jul 29 08:53:27.148429 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:27.148396    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c" containerID="f3815a900e774fa846c38961dcebd0cb09719b4e45480a8db7b40f43a205b439" exitCode=0
Jul 29 08:53:27.148842 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:27.148465    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck" event={"ID":"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c","Type":"ContainerDied","Data":"f3815a900e774fa846c38961dcebd0cb09719b4e45480a8db7b40f43a205b439"}
Jul 29 08:53:28.154268 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:28.154235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck" event={"ID":"7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c","Type":"ContainerStarted","Data":"5682e7323b17421cd739c147e1ef49963c6b685d3fe36bef06e7be1e07dcc79c"}
Jul 29 08:53:28.154670 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:28.154352    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:28.180339 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:28.180290    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck" podStartSLOduration=2.6582194059999997 podStartE2EDuration="7.180274905s" totalImagesPullingTime="3.430157878s" totalInitContainerRuntime="1.091897621s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:28.179745685 +0000 UTC m=+346.151888561" watchObservedRunningTime="2026-07-29 08:53:28.180274905 +0000 UTC m=+346.152417780"
Jul 29 08:53:39.160841 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:39.160759    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-758ck"
Jul 29 08:53:47.333614 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.331510    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"]
Jul 29 08:53:47.337310 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.337285    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.339520 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.339495    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 08:53:47.339667 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.339498    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 08:53:47.346867 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.346844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"]
Jul 29 08:53:47.435479 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.435447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.435640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.435495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gh8p\" (UniqueName: \"kubernetes.io/projected/92ff798b-d1cc-4b66-b0bc-17a925537801-kube-api-access-7gh8p\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.435640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.435515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ff798b-d1cc-4b66-b0bc-17a925537801-tmp\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.536279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.536243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.536463 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.536296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gh8p\" (UniqueName: \"kubernetes.io/projected/92ff798b-d1cc-4b66-b0bc-17a925537801-kube-api-access-7gh8p\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.536463 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.536325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ff798b-d1cc-4b66-b0bc-17a925537801-tmp\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.536463 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:53:47.536386    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 29 08:53:47.536620 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:53:47.536475    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs podName:92ff798b-d1cc-4b66-b0bc-17a925537801 nodeName:}" failed. No retries permitted until 2026-07-29 08:53:48.036455585 +0000 UTC m=+366.008598448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs") pod "kube-auth-proxy-7d544f58d6-7sgdg" (UID: "92ff798b-d1cc-4b66-b0bc-17a925537801") : secret "kube-auth-proxy-tls" not found
Jul 29 08:53:47.538674 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.538650    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92ff798b-d1cc-4b66-b0bc-17a925537801-tmp\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.557440 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.557405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gh8p\" (UniqueName: \"kubernetes.io/projected/92ff798b-d1cc-4b66-b0bc-17a925537801-kube-api-access-7gh8p\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:47.615395 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.615360    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4qdqs"]
Jul 29 08:53:47.618677 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.618660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:47.620495 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.620467    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 08:53:47.620619 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.620599    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7vqv7\""
Jul 29 08:53:47.630459 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.630436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4qdqs"]
Jul 29 08:53:47.738572 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.738533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:47.738756 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.738687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcns\" (UniqueName: \"kubernetes.io/projected/02fc77ac-50ff-4ab4-9b01-501c1770d014-kube-api-access-fkcns\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:47.839835 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.839803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcns\" (UniqueName: \"kubernetes.io/projected/02fc77ac-50ff-4ab4-9b01-501c1770d014-kube-api-access-fkcns\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:47.840044 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.839872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:47.840044 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:53:47.840021    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 08:53:47.840129 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:53:47.840078    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert podName:02fc77ac-50ff-4ab4-9b01-501c1770d014 nodeName:}" failed. No retries permitted until 2026-07-29 08:53:48.340062212 +0000 UTC m=+366.312205068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert") pod "odh-model-controller-7998c67dc4-4qdqs" (UID: "02fc77ac-50ff-4ab4-9b01-501c1770d014") : secret "odh-model-controller-webhook-cert" not found
Jul 29 08:53:47.850573 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:47.850549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcns\" (UniqueName: \"kubernetes.io/projected/02fc77ac-50ff-4ab4-9b01-501c1770d014-kube-api-access-fkcns\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:48.042482 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.042397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:48.044979 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.044950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92ff798b-d1cc-4b66-b0bc-17a925537801-tls-certs\") pod \"kube-auth-proxy-7d544f58d6-7sgdg\" (UID: \"92ff798b-d1cc-4b66-b0bc-17a925537801\") " pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:48.145190 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.145153    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hjgz9"]
Jul 29 08:53:48.148690 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.148671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.151886 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.151861    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 08:53:48.152023 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.151977    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qrq7r\""
Jul 29 08:53:48.164463 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.164441    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hjgz9"]
Jul 29 08:53:48.244976 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.244939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jrkj\" (UniqueName: \"kubernetes.io/projected/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-kube-api-access-5jrkj\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.245154 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.245036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.248815 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.248787    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"
Jul 29 08:53:48.345591 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.345556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.346032 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.345670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jrkj\" (UniqueName: \"kubernetes.io/projected/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-kube-api-access-5jrkj\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.346032 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.345729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:48.348576 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.348437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.349117 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.348982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02fc77ac-50ff-4ab4-9b01-501c1770d014-cert\") pod \"odh-model-controller-7998c67dc4-4qdqs\" (UID: \"02fc77ac-50ff-4ab4-9b01-501c1770d014\") " pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:48.359984 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.359962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jrkj\" (UniqueName: \"kubernetes.io/projected/3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7-kube-api-access-5jrkj\") pod \"model-serving-api-54d89bd5fc-hjgz9\" (UID: \"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.380945 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.380918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg"]
Jul 29 08:53:48.383651 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:53:48.383617    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ff798b_d1cc_4b66_b0bc_17a925537801.slice/crio-153a129a33210fd9b9b40187b4a3226fedb82118ca9bb7df7c876da48b482649 WatchSource:0}: Error finding container 153a129a33210fd9b9b40187b4a3226fedb82118ca9bb7df7c876da48b482649: Status 404 returned error can't find the container with id 153a129a33210fd9b9b40187b4a3226fedb82118ca9bb7df7c876da48b482649
Jul 29 08:53:48.459858 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.459829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:48.533302 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.533050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:48.617802 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.617753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hjgz9"]
Jul 29 08:53:48.698423 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.698386    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4qdqs"]
Jul 29 08:53:48.701681 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:53:48.701642    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fc77ac_50ff_4ab4_9b01_501c1770d014.slice/crio-6196e8f1c85a86df1b6d467aa55beaf951f0140e3654a3aeaf4495763a01efea WatchSource:0}: Error finding container 6196e8f1c85a86df1b6d467aa55beaf951f0140e3654a3aeaf4495763a01efea: Status 404 returned error can't find the container with id 6196e8f1c85a86df1b6d467aa55beaf951f0140e3654a3aeaf4495763a01efea
Jul 29 08:53:48.873917 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.873873    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:53:48.878454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.878434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.880977 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.880956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 08:53:48.880977 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.880972    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 08:53:48.881161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.881146    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 08:53:48.881319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.881273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v7ktc\""
Jul 29 08:53:48.881416 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.881334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 08:53:48.902227 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.902198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:53:48.952825 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.952792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.952834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfg7\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.952910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.952955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.952975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.953010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:48.953194 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:48.953037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054252 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054431 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054431 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfg7\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054431 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054431 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054431 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.054700 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.054476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.055344 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.055273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.057190 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.057161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.057406 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.057381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.057647 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.057603    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.057825 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.057797    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.063603 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.063581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.064089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.064067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfg7\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7\") pod \"istiod-openshift-gateway-7b7995d5cd-wpdr4\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.188443 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.188136    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:49.257295 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.257220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg" event={"ID":"92ff798b-d1cc-4b66-b0bc-17a925537801","Type":"ContainerStarted","Data":"153a129a33210fd9b9b40187b4a3226fedb82118ca9bb7df7c876da48b482649"}
Jul 29 08:53:49.258963 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.258868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9" event={"ID":"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7","Type":"ContainerStarted","Data":"106e4a74ae99f9996d5e92b70f09b9201e1085965654bca9d69906046b7e8278"}
Jul 29 08:53:49.262325 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.262243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs" event={"ID":"02fc77ac-50ff-4ab4-9b01-501c1770d014","Type":"ContainerStarted","Data":"6196e8f1c85a86df1b6d467aa55beaf951f0140e3654a3aeaf4495763a01efea"}
Jul 29 08:53:49.361188 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:49.361148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:53:49.369948 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:53:49.369915    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a1ed3b_46f4_44e8_8188_af458a096599.slice/crio-ed3080ffce4f2667f8db53ff2c1746a75e15e8f823f3cfa756d8ee019f191e98 WatchSource:0}: Error finding container ed3080ffce4f2667f8db53ff2c1746a75e15e8f823f3cfa756d8ee019f191e98: Status 404 returned error can't find the container with id ed3080ffce4f2667f8db53ff2c1746a75e15e8f823f3cfa756d8ee019f191e98
Jul 29 08:53:50.274043 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:50.274001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" event={"ID":"18a1ed3b-46f4-44e8-8188-af458a096599","Type":"ContainerStarted","Data":"ed3080ffce4f2667f8db53ff2c1746a75e15e8f823f3cfa756d8ee019f191e98"}
Jul 29 08:53:53.983636 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:53.983591    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:53:53.984050 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:53.983681    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:53:54.307273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.307165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg" event={"ID":"92ff798b-d1cc-4b66-b0bc-17a925537801","Type":"ContainerStarted","Data":"1a90f7c7c6c47e86524eda8c3debc851860dd59c4c5e4f0e72a614e71fc50393"}
Jul 29 08:53:54.308786 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.308755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9" event={"ID":"3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7","Type":"ContainerStarted","Data":"db9fc409cc84b5ec58bf23949f6bdda72f55f7485e14d08d8ec8bb5775db85a1"}
Jul 29 08:53:54.308936 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.308849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:53:54.310284 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.310262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs" event={"ID":"02fc77ac-50ff-4ab4-9b01-501c1770d014","Type":"ContainerStarted","Data":"82bfe8d158d6019405e4d3dc4439625540a87a72877dedc1ae8feb7f01b86dd6"}
Jul 29 08:53:54.310389 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.310310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:53:54.311790 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.311770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" event={"ID":"18a1ed3b-46f4-44e8-8188-af458a096599","Type":"ContainerStarted","Data":"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"}
Jul 29 08:53:54.311915 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.311883    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:53:54.323973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.323923    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg" podStartSLOduration=1.736473246 podStartE2EDuration="7.323880267s" totalImagesPullingTime="5.587407021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:54.322575781 +0000 UTC m=+372.294718656" watchObservedRunningTime="2026-07-29 08:53:54.323880267 +0000 UTC m=+372.296023142"
Jul 29 08:53:54.338635 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.338579    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9" podStartSLOduration=0.994002174 podStartE2EDuration="6.338561665s" totalImagesPullingTime="5.344559491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:54.33710148 +0000 UTC m=+372.309244357" watchObservedRunningTime="2026-07-29 08:53:54.338561665 +0000 UTC m=+372.310704539"
Jul 29 08:53:54.361721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.361656    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" podStartSLOduration=1.751258473 podStartE2EDuration="6.361633456s" totalImagesPullingTime="4.610374983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:54.359991364 +0000 UTC m=+372.332134243" watchObservedRunningTime="2026-07-29 08:53:54.361633456 +0000 UTC m=+372.333776332"
Jul 29 08:53:54.376490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:54.376441    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs" podStartSLOduration=2.101665418 podStartE2EDuration="7.376423915s" totalImagesPullingTime="5.274758497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:54.37579768 +0000 UTC m=+372.347940553" watchObservedRunningTime="2026-07-29 08:53:54.376423915 +0000 UTC m=+372.348566789"
Jul 29 08:53:55.318166 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:55.318129    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-wpdr4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 08:53:55.318530 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:55.318207    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 08:53:58.317383 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:53:58.317354    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:54:00.006272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.006235    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"]
Jul 29 08:54:00.016578 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.016554    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.020510 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.020485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 08:54:00.021024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.021010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8q6pr\""
Jul 29 08:54:00.043869 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.043838    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"]
Jul 29 08:54:00.060813 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.060782    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"]
Jul 29 08:54:00.064730 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.064702    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.070780 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.070754    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4tv66\""
Jul 29 08:54:00.070903 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.070755    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 08:54:00.084593 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.084567    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"]
Jul 29 08:54:00.160865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.160831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxj6\" (UniqueName: \"kubernetes.io/projected/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-kube-api-access-llxj6\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.161068 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.160877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.161068 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.160984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2qfj\" (UniqueName: \"kubernetes.io/projected/b47d770a-97bc-40e5-b878-bc2fcb787077-kube-api-access-l2qfj\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.161068 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.161009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b47d770a-97bc-40e5-b878-bc2fcb787077-cert\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.261828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.261744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2qfj\" (UniqueName: \"kubernetes.io/projected/b47d770a-97bc-40e5-b878-bc2fcb787077-kube-api-access-l2qfj\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.261828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.261782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b47d770a-97bc-40e5-b878-bc2fcb787077-cert\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.261828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.261823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxj6\" (UniqueName: \"kubernetes.io/projected/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-kube-api-access-llxj6\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.262108 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.261845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.262108 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:54:00.261984    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 29 08:54:00.262108 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:54:00.262058    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert podName:43eb1f99-cf03-4f6b-8bdd-9dd771a302f4 nodeName:}" failed. No retries permitted until 2026-07-29 08:54:00.762035164 +0000 UTC m=+378.734178033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert") pod "llmisvc-controller-manager-777c6bd7d5-s8t5r" (UID: "43eb1f99-cf03-4f6b-8bdd-9dd771a302f4") : secret "llmisvc-webhook-server-cert" not found
Jul 29 08:54:00.264518 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.264488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b47d770a-97bc-40e5-b878-bc2fcb787077-cert\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.277939 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.277913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxj6\" (UniqueName: \"kubernetes.io/projected/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-kube-api-access-llxj6\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.278060 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.278035    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2qfj\" (UniqueName: \"kubernetes.io/projected/b47d770a-97bc-40e5-b878-bc2fcb787077-kube-api-access-l2qfj\") pod \"kserve-controller-manager-d6f4b65b8-r9fsr\" (UID: \"b47d770a-97bc-40e5-b878-bc2fcb787077\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.326901 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.326868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:00.467847 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.467824    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"]
Jul 29 08:54:00.469317 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:00.469285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47d770a_97bc_40e5_b878_bc2fcb787077.slice/crio-3b409aefd426ba71e6e95f8c67ea58acf3cccb73715db30523d060d6f6463e7f WatchSource:0}: Error finding container 3b409aefd426ba71e6e95f8c67ea58acf3cccb73715db30523d060d6f6463e7f: Status 404 returned error can't find the container with id 3b409aefd426ba71e6e95f8c67ea58acf3cccb73715db30523d060d6f6463e7f
Jul 29 08:54:00.765514 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.765478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.767990 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.767972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43eb1f99-cf03-4f6b-8bdd-9dd771a302f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s8t5r\" (UID: \"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:00.974515 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:00.974479    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:01.111926 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:01.111876    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"]
Jul 29 08:54:01.113586 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:01.113555    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43eb1f99_cf03_4f6b_8bdd_9dd771a302f4.slice/crio-912e9f311f6e59010b61445e6573505b735274823d8e9d5d29aae7ee6c3921a5 WatchSource:0}: Error finding container 912e9f311f6e59010b61445e6573505b735274823d8e9d5d29aae7ee6c3921a5: Status 404 returned error can't find the container with id 912e9f311f6e59010b61445e6573505b735274823d8e9d5d29aae7ee6c3921a5
Jul 29 08:54:01.344742 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:01.344705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr" event={"ID":"b47d770a-97bc-40e5-b878-bc2fcb787077","Type":"ContainerStarted","Data":"3b409aefd426ba71e6e95f8c67ea58acf3cccb73715db30523d060d6f6463e7f"}
Jul 29 08:54:01.346219 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:01.346189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r" event={"ID":"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4","Type":"ContainerStarted","Data":"912e9f311f6e59010b61445e6573505b735274823d8e9d5d29aae7ee6c3921a5"}
Jul 29 08:54:02.270771 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:02.270733    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:54:02.271190 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:02.270949    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" containerName="discovery" containerID="cri-o://3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783" gracePeriod=30
Jul 29 08:54:03.137996 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.137971    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:54:03.289803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.289803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289876    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.289977    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.290011    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjfg7\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7\") pod \"18a1ed3b-46f4-44e8-8188-af458a096599\" (UID: \"18a1ed3b-46f4-44e8-8188-af458a096599\") "
Jul 29 08:54:03.290320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.290229    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:54:03.290625 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.290342    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-ca-configmap\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.292888 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.292807    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs" (OuterVolumeSpecName: "local-certs") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:54:03.292888 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.292838    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token" (OuterVolumeSpecName: "istio-token") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:54:03.293106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.292943    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:54:03.293161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.293117    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7" (OuterVolumeSpecName: "kube-api-access-pjfg7") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "kube-api-access-pjfg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:54:03.293476 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.293454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts" (OuterVolumeSpecName: "cacerts") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:54:03.293814 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.293778    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "18a1ed3b-46f4-44e8-8188-af458a096599" (UID: "18a1ed3b-46f4-44e8-8188-af458a096599"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:54:03.366619 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.366575    2573 generic.go:356] "Generic (PLEG): container finished" podID="18a1ed3b-46f4-44e8-8188-af458a096599" containerID="3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783" exitCode=0
Jul 29 08:54:03.366808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.366651    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"
Jul 29 08:54:03.366808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.366677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" event={"ID":"18a1ed3b-46f4-44e8-8188-af458a096599","Type":"ContainerDied","Data":"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"}
Jul 29 08:54:03.366808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.366771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4" event={"ID":"18a1ed3b-46f4-44e8-8188-af458a096599","Type":"ContainerDied","Data":"ed3080ffce4f2667f8db53ff2c1746a75e15e8f823f3cfa756d8ee019f191e98"}
Jul 29 08:54:03.366808 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.366801    2573 scope.go:117] "RemoveContainer" containerID="3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"
Jul 29 08:54:03.368610 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.368584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr" event={"ID":"b47d770a-97bc-40e5-b878-bc2fcb787077","Type":"ContainerStarted","Data":"83cd7e109930fd42078318040f6d68f24f96fa4432e5b0ebc2578d5277fb1f3a"}
Jul 29 08:54:03.368828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.368807    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:03.388491 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.388425    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr" podStartSLOduration=1.745498375 podStartE2EDuration="4.38840233s" totalImagesPullingTime="2.642903955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:54:03.386759153 +0000 UTC m=+381.358902041" watchObservedRunningTime="2026-07-29 08:54:03.38840233 +0000 UTC m=+381.360545202"
Jul 29 08:54:03.391231 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391206    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-istio-token\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.391231 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391232    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-csr-dns-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.391374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391244    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-cacerts\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.391374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391254    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18a1ed3b-46f4-44e8-8188-af458a096599-istio-kubeconfig\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.391374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391263    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a1ed3b-46f4-44e8-8188-af458a096599-local-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.391374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.391274    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjfg7\" (UniqueName: \"kubernetes.io/projected/18a1ed3b-46f4-44e8-8188-af458a096599-kube-api-access-pjfg7\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:03.401549 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.401520    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:54:03.408686 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.408649    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4"]
Jul 29 08:54:03.741408 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.741382    2573 scope.go:117] "RemoveContainer" containerID="3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"
Jul 29 08:54:03.741789 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:54:03.741764    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783\": container with ID starting with 3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783 not found: ID does not exist" containerID="3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"
Jul 29 08:54:03.741879 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:03.741802    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783"} err="failed to get container status \"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783\": rpc error: code = NotFound desc = could not find container \"3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783\": container with ID starting with 3474fab465cf397d4f20adb30de03521cf6d2ac456269009a762636d5f57d783 not found: ID does not exist"
Jul 29 08:54:04.375823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:04.375783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r" event={"ID":"43eb1f99-cf03-4f6b-8bdd-9dd771a302f4","Type":"ContainerStarted","Data":"2e362baf6fb2d066b1e51e1c589b4b379768e8f2feaa7d89995564906d5d7440"}
Jul 29 08:54:04.376282 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:04.376055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:04.414357 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:04.414298    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r" podStartSLOduration=1.736836935 podStartE2EDuration="4.414282197s" totalImagesPullingTime="2.677445262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:54:04.412697372 +0000 UTC m=+382.384840246" watchObservedRunningTime="2026-07-29 08:54:04.414282197 +0000 UTC m=+382.386425072"
Jul 29 08:54:04.644411 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:04.644333    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" path="/var/lib/kubelet/pods/18a1ed3b-46f4-44e8-8188-af458a096599/volumes"
Jul 29 08:54:05.318360 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:05.318323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4qdqs"
Jul 29 08:54:05.321329 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:05.321310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hjgz9"
Jul 29 08:54:34.381143 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:34.381108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r9fsr"
Jul 29 08:54:35.383380 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:35.383348    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s8t5r"
Jul 29 08:54:43.187861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.187825    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:43.188272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.188179    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" containerName="discovery"
Jul 29 08:54:43.188272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.188191    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" containerName="discovery"
Jul 29 08:54:43.188272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.188250    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a1ed3b-46f4-44e8-8188-af458a096599" containerName="discovery"
Jul 29 08:54:43.192322 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.192296    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:43.195106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.195075    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 08:54:43.195106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.195098    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 08:54:43.195312 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.195141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d744b\""
Jul 29 08:54:43.201915 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.201866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:43.330070 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.330037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp8bb\" (UniqueName: \"kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb\") pod \"kuadrant-operator-catalog-cqvpv\" (UID: \"999e1bd3-4993-4e4e-ba82-49e920693b9b\") " pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:43.430650 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.430609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp8bb\" (UniqueName: \"kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb\") pod \"kuadrant-operator-catalog-cqvpv\" (UID: \"999e1bd3-4993-4e4e-ba82-49e920693b9b\") " pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:43.439043 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.438978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp8bb\" (UniqueName: \"kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb\") pod \"kuadrant-operator-catalog-cqvpv\" (UID: \"999e1bd3-4993-4e4e-ba82-49e920693b9b\") " pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:43.504064 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.504031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:43.547404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.547364    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:43.635356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.635322    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:43.639163 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:43.639134    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999e1bd3_4993_4e4e_ba82_49e920693b9b.slice/crio-a0cd1abf05468fb22e6637d940bcc02ff534bdaf16c81d8633e64a84a63c98cd WatchSource:0}: Error finding container a0cd1abf05468fb22e6637d940bcc02ff534bdaf16c81d8633e64a84a63c98cd: Status 404 returned error can't find the container with id a0cd1abf05468fb22e6637d940bcc02ff534bdaf16c81d8633e64a84a63c98cd
Jul 29 08:54:43.756846 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.756768    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr8qp"]
Jul 29 08:54:43.760660 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.760643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:43.767273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.767249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr8qp"]
Jul 29 08:54:43.834190 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.834157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g4hr\" (UniqueName: \"kubernetes.io/projected/9277a86e-6ace-49d0-a241-c33f168367f2-kube-api-access-6g4hr\") pod \"kuadrant-operator-catalog-cr8qp\" (UID: \"9277a86e-6ace-49d0-a241-c33f168367f2\") " pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:43.935284 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.935246    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g4hr\" (UniqueName: \"kubernetes.io/projected/9277a86e-6ace-49d0-a241-c33f168367f2-kube-api-access-6g4hr\") pod \"kuadrant-operator-catalog-cr8qp\" (UID: \"9277a86e-6ace-49d0-a241-c33f168367f2\") " pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:43.944554 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:43.944518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g4hr\" (UniqueName: \"kubernetes.io/projected/9277a86e-6ace-49d0-a241-c33f168367f2-kube-api-access-6g4hr\") pod \"kuadrant-operator-catalog-cr8qp\" (UID: \"9277a86e-6ace-49d0-a241-c33f168367f2\") " pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:44.071568 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:44.071460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:44.208823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:44.208765    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr8qp"]
Jul 29 08:54:44.210883 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:44.210854    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9277a86e_6ace_49d0_a241_c33f168367f2.slice/crio-1c318f5d0ad6c4601c85a436b162b5db51a3071ab59df17858b4bbba427639bd WatchSource:0}: Error finding container 1c318f5d0ad6c4601c85a436b162b5db51a3071ab59df17858b4bbba427639bd: Status 404 returned error can't find the container with id 1c318f5d0ad6c4601c85a436b162b5db51a3071ab59df17858b4bbba427639bd
Jul 29 08:54:44.560845 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:44.560807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp" event={"ID":"9277a86e-6ace-49d0-a241-c33f168367f2","Type":"ContainerStarted","Data":"1c318f5d0ad6c4601c85a436b162b5db51a3071ab59df17858b4bbba427639bd"}
Jul 29 08:54:44.561948 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:44.561914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" event={"ID":"999e1bd3-4993-4e4e-ba82-49e920693b9b","Type":"ContainerStarted","Data":"a0cd1abf05468fb22e6637d940bcc02ff534bdaf16c81d8633e64a84a63c98cd"}
Jul 29 08:54:46.575369 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.575336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp" event={"ID":"9277a86e-6ace-49d0-a241-c33f168367f2","Type":"ContainerStarted","Data":"553c45b8178a950ff3f95771bbe7c4742c7bce6ff3cb31c710b7a92451335598"}
Jul 29 08:54:46.577041 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.577012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" event={"ID":"999e1bd3-4993-4e4e-ba82-49e920693b9b","Type":"ContainerStarted","Data":"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"}
Jul 29 08:54:46.577191 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.577098    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" podUID="999e1bd3-4993-4e4e-ba82-49e920693b9b" containerName="registry-server" containerID="cri-o://3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad" gracePeriod=2
Jul 29 08:54:46.591398 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.591342    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp" podStartSLOduration=1.824985112 podStartE2EDuration="3.591325736s" totalImagesPullingTime="1.766340624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:54:46.590215145 +0000 UTC m=+424.562358020" watchObservedRunningTime="2026-07-29 08:54:46.591325736 +0000 UTC m=+424.563468611"
Jul 29 08:54:46.607979 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.607933    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" podStartSLOduration=1.273291897 podStartE2EDuration="3.607916827s" totalImagesPullingTime="2.33462493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:54:46.606873055 +0000 UTC m=+424.579015935" watchObservedRunningTime="2026-07-29 08:54:46.607916827 +0000 UTC m=+424.580059825"
Jul 29 08:54:46.820653 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.820627    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:46.962182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.962145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp8bb\" (UniqueName: \"kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb\") pod \"999e1bd3-4993-4e4e-ba82-49e920693b9b\" (UID: \"999e1bd3-4993-4e4e-ba82-49e920693b9b\") "
Jul 29 08:54:46.964321 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:46.964293    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb" (OuterVolumeSpecName: "kube-api-access-pp8bb") pod "999e1bd3-4993-4e4e-ba82-49e920693b9b" (UID: "999e1bd3-4993-4e4e-ba82-49e920693b9b"). InnerVolumeSpecName "kube-api-access-pp8bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:54:47.063513 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.063481    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp8bb\" (UniqueName: \"kubernetes.io/projected/999e1bd3-4993-4e4e-ba82-49e920693b9b-kube-api-access-pp8bb\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:54:47.582667 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.582635    2573 generic.go:356] "Generic (PLEG): container finished" podID="999e1bd3-4993-4e4e-ba82-49e920693b9b" containerID="3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad" exitCode=0
Jul 29 08:54:47.583099 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.582691    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv"
Jul 29 08:54:47.583099 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.582726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" event={"ID":"999e1bd3-4993-4e4e-ba82-49e920693b9b","Type":"ContainerDied","Data":"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"}
Jul 29 08:54:47.583099 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.582812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cqvpv" event={"ID":"999e1bd3-4993-4e4e-ba82-49e920693b9b","Type":"ContainerDied","Data":"a0cd1abf05468fb22e6637d940bcc02ff534bdaf16c81d8633e64a84a63c98cd"}
Jul 29 08:54:47.583099 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.582837    2573 scope.go:117] "RemoveContainer" containerID="3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"
Jul 29 08:54:47.592112 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.592091    2573 scope.go:117] "RemoveContainer" containerID="3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"
Jul 29 08:54:47.592355 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:54:47.592337    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad\": container with ID starting with 3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad not found: ID does not exist" containerID="3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"
Jul 29 08:54:47.592434 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.592361    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad"} err="failed to get container status \"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad\": rpc error: code = NotFound desc = could not find container \"3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad\": container with ID starting with 3a4cfe8bf5f0fd5055a98168941a1de080101efa30ed69e9cbd2a5f5acb9d1ad not found: ID does not exist"
Jul 29 08:54:47.602987 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.602964    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:47.606410 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:47.606391    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cqvpv"]
Jul 29 08:54:48.643415 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:48.643384    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="999e1bd3-4993-4e4e-ba82-49e920693b9b" path="/var/lib/kubelet/pods/999e1bd3-4993-4e4e-ba82-49e920693b9b/volumes"
Jul 29 08:54:54.072594 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:54.072552    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:54.073134 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:54.072636    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:54.094475 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:54.094449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:54.635794 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:54.635767    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cr8qp"
Jul 29 08:54:58.792216 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.792181    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"]
Jul 29 08:54:58.792587 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.792521    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999e1bd3-4993-4e4e-ba82-49e920693b9b" containerName="registry-server"
Jul 29 08:54:58.792587 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.792531    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="999e1bd3-4993-4e4e-ba82-49e920693b9b" containerName="registry-server"
Jul 29 08:54:58.792655 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.792606    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="999e1bd3-4993-4e4e-ba82-49e920693b9b" containerName="registry-server"
Jul 29 08:54:58.797113 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.797090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.799863 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.799844    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pcrnr\""
Jul 29 08:54:58.816936 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.816913    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"]
Jul 29 08:54:58.871100 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.871070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.871250 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.871126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.871250 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.871161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wxz\" (UniqueName: \"kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.977739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.972823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wxz\" (UniqueName: \"kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.977739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.972990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.977739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.973052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.977739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.973500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.977739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.974193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:58.981655 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:58.981630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wxz\" (UniqueName: \"kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:59.105861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.105826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:54:59.205998 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.205964    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"]
Jul 29 08:54:59.211112 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.211085    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.218618 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.218556    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"]
Jul 29 08:54:59.238942 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.238918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"]
Jul 29 08:54:59.241382 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:59.241357    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d73bbc1_fedc_4bc9_bf95_c5c8d6d13b6b.slice/crio-42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a WatchSource:0}: Error finding container 42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a: Status 404 returned error can't find the container with id 42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a
Jul 29 08:54:59.274972 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.274942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.275079 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.275001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d82lg\" (UniqueName: \"kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.275079 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.275021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.375987 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.375866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.376154 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.376002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d82lg\" (UniqueName: \"kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.376154 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.376035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.376304 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.376279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.376382 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.376367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.384529 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.384499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d82lg\" (UniqueName: \"kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.523321 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.523287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:54:59.598730 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.598692    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"]
Jul 29 08:54:59.604061 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.604039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.611663 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.611588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"]
Jul 29 08:54:59.638356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.638268    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerID="a78750ddd77d6dbe03b0ade27f97bddaea4e362cf096e71e1eaab15a6e3c0cff" exitCode=0
Jul 29 08:54:59.638356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.638309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx" event={"ID":"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b","Type":"ContainerDied","Data":"a78750ddd77d6dbe03b0ade27f97bddaea4e362cf096e71e1eaab15a6e3c0cff"}
Jul 29 08:54:59.638356 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.638344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx" event={"ID":"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b","Type":"ContainerStarted","Data":"42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a"}
Jul 29 08:54:59.657358 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.657318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"]
Jul 29 08:54:59.660134 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:54:59.660113    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1dd62a_eea5_4cbe_9a6a_dad207e0b559.slice/crio-5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a WatchSource:0}: Error finding container 5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a: Status 404 returned error can't find the container with id 5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a
Jul 29 08:54:59.678856 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.678833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.678966 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.678882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntdf\" (UniqueName: \"kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.679128 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.679108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.780225 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.780188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.780359 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.780247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.780359 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.780277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntdf\" (UniqueName: \"kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.780545 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.780526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.780580 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.780561    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.789479 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.789457    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntdf\" (UniqueName: \"kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:54:59.915366 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:54:59.915282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:55:00.011089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.000658    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"]
Jul 29 08:55:00.011089 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.010975    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.065404 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.065364    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"]
Jul 29 08:55:00.075392 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:00.075362    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e04cf2_881f_42dc_b632_0d4f8313b704.slice/crio-28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194 WatchSource:0}: Error finding container 28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194: Status 404 returned error can't find the container with id 28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194
Jul 29 08:55:00.082209 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.082136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd5nk\" (UniqueName: \"kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.082209 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.082194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.082320 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.082293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.083339 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.083321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"]
Jul 29 08:55:00.183374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.183344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.183506 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.183411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.183506 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.183461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd5nk\" (UniqueName: \"kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.183720 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.183694    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.183782 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.183727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.191856 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.191837    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd5nk\" (UniqueName: \"kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.328048 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.328014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:00.470723 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.470699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"]
Jul 29 08:55:00.481649 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:00.481622    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb3b2dd_187f_419d_b933_bfaf616e2875.slice/crio-a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d WatchSource:0}: Error finding container a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d: Status 404 returned error can't find the container with id a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d
Jul 29 08:55:00.644946 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.644915    2573 generic.go:356] "Generic (PLEG): container finished" podID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerID="431772f5ca3198eeeed47bca2d7783a0292a2d67e6ce9c5bc078c3a6ec7c1358" exitCode=0
Jul 29 08:55:00.645106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.644993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m" event={"ID":"b7e04cf2-881f-42dc-b632-0d4f8313b704","Type":"ContainerDied","Data":"431772f5ca3198eeeed47bca2d7783a0292a2d67e6ce9c5bc078c3a6ec7c1358"}
Jul 29 08:55:00.645106 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.645045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m" event={"ID":"b7e04cf2-881f-42dc-b632-0d4f8313b704","Type":"ContainerStarted","Data":"28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194"}
Jul 29 08:55:00.646505 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.646482    2573 generic.go:356] "Generic (PLEG): container finished" podID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerID="d10bda3e4dae223b90a3b9e7c62a94ee098177792e394ff60498962d71793e6a" exitCode=0
Jul 29 08:55:00.646603 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.646552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt" event={"ID":"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559","Type":"ContainerDied","Data":"d10bda3e4dae223b90a3b9e7c62a94ee098177792e394ff60498962d71793e6a"}
Jul 29 08:55:00.646664 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.646602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt" event={"ID":"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559","Type":"ContainerStarted","Data":"5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a"}
Jul 29 08:55:00.648455 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.648435    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerID="39000323ad99fb64987d81aeb1a1c69a3268153b76e4ec05d1811c51855bb51a" exitCode=0
Jul 29 08:55:00.648547 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.648477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx" event={"ID":"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b","Type":"ContainerDied","Data":"39000323ad99fb64987d81aeb1a1c69a3268153b76e4ec05d1811c51855bb51a"}
Jul 29 08:55:00.650070 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.650052    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerID="60c4dbce202af2d96e66d80c45605eebb8e3ed8a3bebe61090cbb9a0c0c3da87" exitCode=0
Jul 29 08:55:00.650205 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.650102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw" event={"ID":"1cb3b2dd-187f-419d-b933-bfaf616e2875","Type":"ContainerDied","Data":"60c4dbce202af2d96e66d80c45605eebb8e3ed8a3bebe61090cbb9a0c0c3da87"}
Jul 29 08:55:00.650205 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:00.650142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw" event={"ID":"1cb3b2dd-187f-419d-b933-bfaf616e2875","Type":"ContainerStarted","Data":"a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d"}
Jul 29 08:55:01.341454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.341422    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65db55cc87-b7thh"]
Jul 29 08:55:01.345019 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.344991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.349182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.349144    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 08:55:01.349663 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.349641    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 08:55:01.349789 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.349687    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 08:55:01.350033 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.350008    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 08:55:01.350656 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.350331    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 08:55:01.350656 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.350319    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 08:55:01.350656 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.350456    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fpl6s\""
Jul 29 08:55:01.350656 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.350457    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 08:55:01.357077 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.357054    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 08:55:01.364915 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.364868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65db55cc87-b7thh"]
Jul 29 08:55:01.393341 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-oauth-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb8tt\" (UniqueName: \"kubernetes.io/projected/3d4af3b4-68d4-444f-8a0a-c34935696b23-kube-api-access-lb8tt\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-service-ca\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393488 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-oauth-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393702 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.393702 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.393601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-trusted-ca-bundle\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495080 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb8tt\" (UniqueName: \"kubernetes.io/projected/3d4af3b4-68d4-444f-8a0a-c34935696b23-kube-api-access-lb8tt\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-service-ca\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-oauth-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495182 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495398 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-trusted-ca-bundle\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.495398 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.495269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-oauth-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.496136 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.496075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-oauth-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.496136 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.496102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-service-ca\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.496267 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.496135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.496319 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.496297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d4af3b4-68d4-444f-8a0a-c34935696b23-trusted-ca-bundle\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.497784 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.497761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-oauth-config\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.497853 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.497797    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d4af3b4-68d4-444f-8a0a-c34935696b23-console-serving-cert\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.502525 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.502504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb8tt\" (UniqueName: \"kubernetes.io/projected/3d4af3b4-68d4-444f-8a0a-c34935696b23-kube-api-access-lb8tt\") pod \"console-65db55cc87-b7thh\" (UID: \"3d4af3b4-68d4-444f-8a0a-c34935696b23\") " pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.656968 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.656871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:01.660692 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.660480    2573 generic.go:356] "Generic (PLEG): container finished" podID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerID="9e698eff9fc1ea9b82596462b744de982d1ee7a49577a7e344019f2d7c63451e" exitCode=0
Jul 29 08:55:01.660692 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.660547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx" event={"ID":"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b","Type":"ContainerDied","Data":"9e698eff9fc1ea9b82596462b744de982d1ee7a49577a7e344019f2d7c63451e"}
Jul 29 08:55:01.662325 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.662301    2573 generic.go:356] "Generic (PLEG): container finished" podID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerID="0e3166616d224823fe9ba2432e95276ae861001b4760f6aea972a8f94d525ef6" exitCode=0
Jul 29 08:55:01.662476 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.662385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m" event={"ID":"b7e04cf2-881f-42dc-b632-0d4f8313b704","Type":"ContainerDied","Data":"0e3166616d224823fe9ba2432e95276ae861001b4760f6aea972a8f94d525ef6"}
Jul 29 08:55:01.813111 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:01.813063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65db55cc87-b7thh"]
Jul 29 08:55:01.871339 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:01.871304    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4af3b4_68d4_444f_8a0a_c34935696b23.slice/crio-6689b82b364dde2bdbf8c982d7ffbd695eb5b115feebb1204509fb0d61b27a10 WatchSource:0}: Error finding container 6689b82b364dde2bdbf8c982d7ffbd695eb5b115feebb1204509fb0d61b27a10: Status 404 returned error can't find the container with id 6689b82b364dde2bdbf8c982d7ffbd695eb5b115feebb1204509fb0d61b27a10
Jul 29 08:55:02.668767 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.668728    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerID="b138b9a982f376aa98c7d4a3f3052927365ef98613093b7b7e94872544204a41" exitCode=0
Jul 29 08:55:02.669256 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.668779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw" event={"ID":"1cb3b2dd-187f-419d-b933-bfaf616e2875","Type":"ContainerDied","Data":"b138b9a982f376aa98c7d4a3f3052927365ef98613093b7b7e94872544204a41"}
Jul 29 08:55:02.670977 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.670955    2573 generic.go:356] "Generic (PLEG): container finished" podID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerID="cfb7be74ad2ac68c845270e0bc725432f427140e1efd6d6c16b371bbc698ddba" exitCode=0
Jul 29 08:55:02.671115 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.671021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m" event={"ID":"b7e04cf2-881f-42dc-b632-0d4f8313b704","Type":"ContainerDied","Data":"cfb7be74ad2ac68c845270e0bc725432f427140e1efd6d6c16b371bbc698ddba"}
Jul 29 08:55:02.672608 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.672584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65db55cc87-b7thh" event={"ID":"3d4af3b4-68d4-444f-8a0a-c34935696b23","Type":"ContainerStarted","Data":"bd9e9e900fc4846c93c8d855a1f7e2119fcc5ea28d24e22017e50549881fb3a8"}
Jul 29 08:55:02.672708 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.672627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65db55cc87-b7thh" event={"ID":"3d4af3b4-68d4-444f-8a0a-c34935696b23","Type":"ContainerStarted","Data":"6689b82b364dde2bdbf8c982d7ffbd695eb5b115feebb1204509fb0d61b27a10"}
Jul 29 08:55:02.674305 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.674286    2573 generic.go:356] "Generic (PLEG): container finished" podID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerID="9f9cef883e4eb50d8c06b99fed8256cd5f79ed6fdda6f12e0ea8136e52989b08" exitCode=0
Jul 29 08:55:02.674378 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.674354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt" event={"ID":"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559","Type":"ContainerDied","Data":"9f9cef883e4eb50d8c06b99fed8256cd5f79ed6fdda6f12e0ea8136e52989b08"}
Jul 29 08:55:02.740468 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.737113    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65db55cc87-b7thh" podStartSLOduration=1.737092635 podStartE2EDuration="1.737092635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:02.733790571 +0000 UTC m=+440.705933457" watchObservedRunningTime="2026-07-29 08:55:02.737092635 +0000 UTC m=+440.709235511"
Jul 29 08:55:02.814951 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.814921    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:55:02.906259 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.906216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util\") pod \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") "
Jul 29 08:55:02.906420 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.906274    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27wxz\" (UniqueName: \"kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz\") pod \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") "
Jul 29 08:55:02.906420 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.906345    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle\") pod \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\" (UID: \"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b\") "
Jul 29 08:55:02.906835 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.906807    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle" (OuterVolumeSpecName: "bundle") pod "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" (UID: "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:02.908505 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.908478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz" (OuterVolumeSpecName: "kube-api-access-27wxz") pod "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" (UID: "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b"). InnerVolumeSpecName "kube-api-access-27wxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:02.911840 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:02.911817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util" (OuterVolumeSpecName: "util") pod "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" (UID: "1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:03.007423 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.007393    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:03.007423 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.007418    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-util\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:03.007604 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.007432    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27wxz\" (UniqueName: \"kubernetes.io/projected/1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b-kube-api-access-27wxz\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:03.681443 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.681402    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx"
Jul 29 08:55:03.681871 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.681401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx" event={"ID":"1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b","Type":"ContainerDied","Data":"42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a"}
Jul 29 08:55:03.681871 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.681524    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42516e46b64d9b9a459457a3adda1a27af5242b15f08462f86d8e98be08eb59a"
Jul 29 08:55:03.683418 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.683391    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerID="61b8cba3394f069bb19857935ce95acfa3cfbe6183539f9e9a3ee90847e7d44c" exitCode=0
Jul 29 08:55:03.683526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.683478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw" event={"ID":"1cb3b2dd-187f-419d-b933-bfaf616e2875","Type":"ContainerDied","Data":"61b8cba3394f069bb19857935ce95acfa3cfbe6183539f9e9a3ee90847e7d44c"}
Jul 29 08:55:03.685573 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.685548    2573 generic.go:356] "Generic (PLEG): container finished" podID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerID="744332cadc8b99f546ecf530162331dc938f586a0eb2367da053fa60972d620e" exitCode=0
Jul 29 08:55:03.685665 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.685621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt" event={"ID":"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559","Type":"ContainerDied","Data":"744332cadc8b99f546ecf530162331dc938f586a0eb2367da053fa60972d620e"}
Jul 29 08:55:03.829159 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.829132    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:55:03.914588 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.914549    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ntdf\" (UniqueName: \"kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf\") pod \"b7e04cf2-881f-42dc-b632-0d4f8313b704\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") "
Jul 29 08:55:03.914750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.914597    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util\") pod \"b7e04cf2-881f-42dc-b632-0d4f8313b704\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") "
Jul 29 08:55:03.914750 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.914624    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle\") pod \"b7e04cf2-881f-42dc-b632-0d4f8313b704\" (UID: \"b7e04cf2-881f-42dc-b632-0d4f8313b704\") "
Jul 29 08:55:03.915334 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.915310    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle" (OuterVolumeSpecName: "bundle") pod "b7e04cf2-881f-42dc-b632-0d4f8313b704" (UID: "b7e04cf2-881f-42dc-b632-0d4f8313b704"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:03.916776 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.916738    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf" (OuterVolumeSpecName: "kube-api-access-5ntdf") pod "b7e04cf2-881f-42dc-b632-0d4f8313b704" (UID: "b7e04cf2-881f-42dc-b632-0d4f8313b704"). InnerVolumeSpecName "kube-api-access-5ntdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:03.919994 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:03.919972    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util" (OuterVolumeSpecName: "util") pod "b7e04cf2-881f-42dc-b632-0d4f8313b704" (UID: "b7e04cf2-881f-42dc-b632-0d4f8313b704"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:04.015970 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.015854    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ntdf\" (UniqueName: \"kubernetes.io/projected/b7e04cf2-881f-42dc-b632-0d4f8313b704-kube-api-access-5ntdf\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:04.015970 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.015920    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-util\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:04.015970 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.015931    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e04cf2-881f-42dc-b632-0d4f8313b704-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:04.693047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.693010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m" event={"ID":"b7e04cf2-881f-42dc-b632-0d4f8313b704","Type":"ContainerDied","Data":"28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194"}
Jul 29 08:55:04.693047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.693048    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m"
Jul 29 08:55:04.693444 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.693066    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28aac10a8262648736da3cfff0fb4a16754dc7565d3548cee31d424c2e455194"
Jul 29 08:55:04.828057 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.828027    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:55:04.860121 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.860095    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:04.923849 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923775    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle\") pod \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") "
Jul 29 08:55:04.923849 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd5nk\" (UniqueName: \"kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk\") pod \"1cb3b2dd-187f-419d-b933-bfaf616e2875\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") "
Jul 29 08:55:04.924098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923866    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d82lg\" (UniqueName: \"kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg\") pod \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") "
Jul 29 08:55:04.924098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util\") pod \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\" (UID: \"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559\") "
Jul 29 08:55:04.924098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923948    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle\") pod \"1cb3b2dd-187f-419d-b933-bfaf616e2875\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") "
Jul 29 08:55:04.924098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.923993    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util\") pod \"1cb3b2dd-187f-419d-b933-bfaf616e2875\" (UID: \"1cb3b2dd-187f-419d-b933-bfaf616e2875\") "
Jul 29 08:55:04.924470 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.924378    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle" (OuterVolumeSpecName: "bundle") pod "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" (UID: "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:04.924567 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.924542    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle" (OuterVolumeSpecName: "bundle") pod "1cb3b2dd-187f-419d-b933-bfaf616e2875" (UID: "1cb3b2dd-187f-419d-b933-bfaf616e2875"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:04.926527 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.926494    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk" (OuterVolumeSpecName: "kube-api-access-bd5nk") pod "1cb3b2dd-187f-419d-b933-bfaf616e2875" (UID: "1cb3b2dd-187f-419d-b933-bfaf616e2875"). InnerVolumeSpecName "kube-api-access-bd5nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:04.926527 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.926508    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg" (OuterVolumeSpecName: "kube-api-access-d82lg") pod "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" (UID: "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559"). InnerVolumeSpecName "kube-api-access-d82lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:04.930477 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.930454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util" (OuterVolumeSpecName: "util") pod "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" (UID: "ab1dd62a-eea5-4cbe-9a6a-dad207e0b559"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:04.930602 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:04.930582    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util" (OuterVolumeSpecName: "util") pod "1cb3b2dd-187f-419d-b933-bfaf616e2875" (UID: "1cb3b2dd-187f-419d-b933-bfaf616e2875"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:05.024935 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024875    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d82lg\" (UniqueName: \"kubernetes.io/projected/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-kube-api-access-d82lg\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.024935 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024926    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-util\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.024935 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024936    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.024935 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024943    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb3b2dd-187f-419d-b933-bfaf616e2875-util\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.025186 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024951    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab1dd62a-eea5-4cbe-9a6a-dad207e0b559-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.025186 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.024960    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd5nk\" (UniqueName: \"kubernetes.io/projected/1cb3b2dd-187f-419d-b933-bfaf616e2875-kube-api-access-bd5nk\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:05.704292 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.704255    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw"
Jul 29 08:55:05.704292 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.704275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw" event={"ID":"1cb3b2dd-187f-419d-b933-bfaf616e2875","Type":"ContainerDied","Data":"a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d"}
Jul 29 08:55:05.704812 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.704341    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8d7be043fa6701c9de0772992e98842116490ff01096bdd85957f7afce5594d"
Jul 29 08:55:05.706021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.705991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt" event={"ID":"ab1dd62a-eea5-4cbe-9a6a-dad207e0b559","Type":"ContainerDied","Data":"5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a"}
Jul 29 08:55:05.706021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.706005    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt"
Jul 29 08:55:05.706021 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:05.706023    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5260fad7b0ceb6dcdbbb4b783cb555767cfc881b67a0cdfe8ba224007cb4ae1a"
Jul 29 08:55:11.657302 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:11.657262    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:11.657811 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:11.657377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:11.662000 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:11.661977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:11.739103 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:11.739075    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65db55cc87-b7thh"
Jul 29 08:55:15.583423 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583386    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"]
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583756    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="util"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583768    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="util"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583778    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="pull"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583783    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="pull"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583789    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="extract"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583795    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="extract"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583800    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="util"
Jul 29 08:55:15.583803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583805    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="util"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583812    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583817    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583830    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="util"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583834    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="util"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583842    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="util"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583854    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="util"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583861    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583867    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583873    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583878    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583887    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583905    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583915    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583920    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583925    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583930    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="pull"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583984    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7e04cf2-881f-42dc-b632-0d4f8313b704" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.583995    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb3b2dd-187f-419d-b933-bfaf616e2875" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.584003    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1dd62a-eea5-4cbe-9a6a-dad207e0b559" containerName="extract"
Jul 29 08:55:15.584101 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.584009    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b" containerName="extract"
Jul 29 08:55:15.587164 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.587146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:15.589861 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.589841    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qhb4k\""
Jul 29 08:55:15.602430 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.602406    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"]
Jul 29 08:55:15.717000 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.716955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj2rg\" (UniqueName: \"kubernetes.io/projected/3943b20d-0422-4283-9b43-733489c7b6d1-kube-api-access-xj2rg\") pod \"authorino-operator-75cc8d5cb7-pcvzx\" (UID: \"3943b20d-0422-4283-9b43-733489c7b6d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:15.817739 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.817699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj2rg\" (UniqueName: \"kubernetes.io/projected/3943b20d-0422-4283-9b43-733489c7b6d1-kube-api-access-xj2rg\") pod \"authorino-operator-75cc8d5cb7-pcvzx\" (UID: \"3943b20d-0422-4283-9b43-733489c7b6d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:15.836783 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.836760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj2rg\" (UniqueName: \"kubernetes.io/projected/3943b20d-0422-4283-9b43-733489c7b6d1-kube-api-access-xj2rg\") pod \"authorino-operator-75cc8d5cb7-pcvzx\" (UID: \"3943b20d-0422-4283-9b43-733489c7b6d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:15.897902 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:15.897869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:16.059299 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:16.059256    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3943b20d_0422_4283_9b43_733489c7b6d1.slice/crio-d0604ed25ddeee12dcc68d27d52071a54a59f7e0f195c377a8d972d41dce377c WatchSource:0}: Error finding container d0604ed25ddeee12dcc68d27d52071a54a59f7e0f195c377a8d972d41dce377c: Status 404 returned error can't find the container with id d0604ed25ddeee12dcc68d27d52071a54a59f7e0f195c377a8d972d41dce377c
Jul 29 08:55:16.061765 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:16.061671    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"]
Jul 29 08:55:16.764118 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:16.764079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx" event={"ID":"3943b20d-0422-4283-9b43-733489c7b6d1","Type":"ContainerStarted","Data":"d0604ed25ddeee12dcc68d27d52071a54a59f7e0f195c377a8d972d41dce377c"}
Jul 29 08:55:18.382224 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.382188    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"]
Jul 29 08:55:18.385857 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.385834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:18.387987 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.387967    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jxvjb\""
Jul 29 08:55:18.397459 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.397436    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"]
Jul 29 08:55:18.442019 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.441952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nm9l\" (UniqueName: \"kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l\") pod \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" (UID: \"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:18.542956 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.542919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nm9l\" (UniqueName: \"kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l\") pod \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" (UID: \"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:18.551774 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.551752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nm9l\" (UniqueName: \"kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l\") pod \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" (UID: \"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:18.697646 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.697559    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:18.777857 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.777822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx" event={"ID":"3943b20d-0422-4283-9b43-733489c7b6d1","Type":"ContainerStarted","Data":"76196f8fa5f7b0c4eb96da6e3e70936f71b4503e37582b522893133cad6db408"}
Jul 29 08:55:18.778027 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.777916    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:18.797269 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.797222    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx" podStartSLOduration=1.668414852 podStartE2EDuration="3.797205403s" totalImagesPullingTime="2.128790551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:18.794966371 +0000 UTC m=+456.767109248" watchObservedRunningTime="2026-07-29 08:55:18.797205403 +0000 UTC m=+456.769348278"
Jul 29 08:55:18.841016 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:18.840988    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"]
Jul 29 08:55:18.842768 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:18.842743    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bbb00d_38d5_4517_8317_a6e13ebaa4fa.slice/crio-42ddf7fea165abbea2bac15acaed35111236ff22e884bbf595140ca6caa1d90a WatchSource:0}: Error finding container 42ddf7fea165abbea2bac15acaed35111236ff22e884bbf595140ca6caa1d90a: Status 404 returned error can't find the container with id 42ddf7fea165abbea2bac15acaed35111236ff22e884bbf595140ca6caa1d90a
Jul 29 08:55:19.786181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:19.786131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m" event={"ID":"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa","Type":"ContainerStarted","Data":"42ddf7fea165abbea2bac15acaed35111236ff22e884bbf595140ca6caa1d90a"}
Jul 29 08:55:20.792429 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.792393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m" event={"ID":"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa","Type":"ContainerStarted","Data":"32b8ec2d694d9a46bd61dffa858cc7e7b5974c0e06333369eea19c64b91c102c"}
Jul 29 08:55:20.792816 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.792504    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:20.815614 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.815540    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m" podStartSLOduration=1.418115354 podStartE2EDuration="2.815520045s" totalImagesPullingTime="1.397404691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:20.815142884 +0000 UTC m=+458.787285885" watchObservedRunningTime="2026-07-29 08:55:20.815520045 +0000 UTC m=+458.787662921"
Jul 29 08:55:20.892374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.892339    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"]
Jul 29 08:55:20.895999 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.895977    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:20.899724 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.899688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 08:55:20.899828 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.899793    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xf5fq\""
Jul 29 08:55:20.920920 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.920871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"]
Jul 29 08:55:20.962958 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:20.962920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6c5d\" (UniqueName: \"kubernetes.io/projected/c6261e08-8c07-4a22-862a-5ed2c6534c38-kube-api-access-d6c5d\") pod \"dns-operator-controller-manager-864dd78c4c-qnwtf\" (UID: \"c6261e08-8c07-4a22-862a-5ed2c6534c38\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:21.064035 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:21.063944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6c5d\" (UniqueName: \"kubernetes.io/projected/c6261e08-8c07-4a22-862a-5ed2c6534c38-kube-api-access-d6c5d\") pod \"dns-operator-controller-manager-864dd78c4c-qnwtf\" (UID: \"c6261e08-8c07-4a22-862a-5ed2c6534c38\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:21.079428 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:21.079398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6c5d\" (UniqueName: \"kubernetes.io/projected/c6261e08-8c07-4a22-862a-5ed2c6534c38-kube-api-access-d6c5d\") pod \"dns-operator-controller-manager-864dd78c4c-qnwtf\" (UID: \"c6261e08-8c07-4a22-862a-5ed2c6534c38\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:21.206601 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:21.206549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:21.343000 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:21.342912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"]
Jul 29 08:55:21.345359 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:21.345334    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6261e08_8c07_4a22_862a_5ed2c6534c38.slice/crio-4a0e18586cb904a8685317dd801d427159ac3841d8147d66500083d8e3820733 WatchSource:0}: Error finding container 4a0e18586cb904a8685317dd801d427159ac3841d8147d66500083d8e3820733: Status 404 returned error can't find the container with id 4a0e18586cb904a8685317dd801d427159ac3841d8147d66500083d8e3820733
Jul 29 08:55:21.798803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:21.798720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf" event={"ID":"c6261e08-8c07-4a22-862a-5ed2c6534c38","Type":"ContainerStarted","Data":"4a0e18586cb904a8685317dd801d427159ac3841d8147d66500083d8e3820733"}
Jul 29 08:55:23.811339 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:23.811303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf" event={"ID":"c6261e08-8c07-4a22-862a-5ed2c6534c38","Type":"ContainerStarted","Data":"a5baa01dc42cd39435530b05cbf1db29c1aed0148b4b2fb0e7502e36446ecbb9"}
Jul 29 08:55:23.811824 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:23.811446    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:23.828755 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:23.828705    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf" podStartSLOduration=2.162433869 podStartE2EDuration="3.82869099s" totalImagesPullingTime="1.666257121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:23.826053298 +0000 UTC m=+461.798196174" watchObservedRunningTime="2026-07-29 08:55:23.82869099 +0000 UTC m=+461.800833865"
Jul 29 08:55:25.414116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.414082    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"]
Jul 29 08:55:25.417644 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.417627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.421699 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.421678    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsh69\""
Jul 29 08:55:25.441306 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.441278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"]
Jul 29 08:55:25.502491 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.502453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzb2p\" (UniqueName: \"kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.502491 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.502495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.603465 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.603422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzb2p\" (UniqueName: \"kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.603636 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.603475    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.603928 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.603884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.614674 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.614639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzb2p\" (UniqueName: \"kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.727745 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.727665    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:25.867203 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:25.867176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"]
Jul 29 08:55:25.869886 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:25.869855    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6d4c11_119a_4f5c_aefc_718baba74d17.slice/crio-8e1904a18c21c6c35cff21be28de4d5877799cedd1020b7dc2a196dc1dace5f7 WatchSource:0}: Error finding container 8e1904a18c21c6c35cff21be28de4d5877799cedd1020b7dc2a196dc1dace5f7: Status 404 returned error can't find the container with id 8e1904a18c21c6c35cff21be28de4d5877799cedd1020b7dc2a196dc1dace5f7
Jul 29 08:55:26.829253 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:26.829216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v" event={"ID":"bb6d4c11-119a-4f5c-aefc-718baba74d17","Type":"ContainerStarted","Data":"8e1904a18c21c6c35cff21be28de4d5877799cedd1020b7dc2a196dc1dace5f7"}
Jul 29 08:55:29.788721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:29.788691    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pcvzx"
Jul 29 08:55:30.853929 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:30.853812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v" event={"ID":"bb6d4c11-119a-4f5c-aefc-718baba74d17","Type":"ContainerStarted","Data":"50b1949561a01cad1255b552b3d3c1cfd9e1214f9fb3ecc45c8783e218a19a6b"}
Jul 29 08:55:30.853929 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:30.853907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:30.872969 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:30.872918    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v" podStartSLOduration=1.156570444 podStartE2EDuration="5.872883261s" totalImagesPullingTime="4.716312817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:30.871562855 +0000 UTC m=+468.843705740" watchObservedRunningTime="2026-07-29 08:55:30.872883261 +0000 UTC m=+468.845026136"
Jul 29 08:55:31.801582 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:31.801551    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:33.374805 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.374769    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"]
Jul 29 08:55:33.378618 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.378601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.380642 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.380618    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 08:55:33.380762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.380712    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 08:55:33.380762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.380725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pcrnr\""
Jul 29 08:55:33.387796 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.387772    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"]
Jul 29 08:55:33.481984 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.481948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4325e682-4382-45e6-9fb0-0041ecb883e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.482140 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.482076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7kv\" (UniqueName: \"kubernetes.io/projected/4325e682-4382-45e6-9fb0-0041ecb883e6-kube-api-access-dz7kv\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.482140 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.482120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4325e682-4382-45e6-9fb0-0041ecb883e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.583103 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.583051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7kv\" (UniqueName: \"kubernetes.io/projected/4325e682-4382-45e6-9fb0-0041ecb883e6-kube-api-access-dz7kv\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.583481 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.583110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4325e682-4382-45e6-9fb0-0041ecb883e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.583481 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.583147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4325e682-4382-45e6-9fb0-0041ecb883e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.583762 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.583740    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4325e682-4382-45e6-9fb0-0041ecb883e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.585673 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.585641    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4325e682-4382-45e6-9fb0-0041ecb883e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.601335 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.601307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7kv\" (UniqueName: \"kubernetes.io/projected/4325e682-4382-45e6-9fb0-0041ecb883e6-kube-api-access-dz7kv\") pod \"kuadrant-console-plugin-66b5774985-jstc7\" (UID: \"4325e682-4382-45e6-9fb0-0041ecb883e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.688526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.688449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"
Jul 29 08:55:33.839495 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.839470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7"]
Jul 29 08:55:33.841954 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:33.841928    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4325e682_4382_45e6_9fb0_0041ecb883e6.slice/crio-650b4f33ed5a0819ef27337efb6895d02044adc8c34dcc572462a7ad124361cd WatchSource:0}: Error finding container 650b4f33ed5a0819ef27337efb6895d02044adc8c34dcc572462a7ad124361cd: Status 404 returned error can't find the container with id 650b4f33ed5a0819ef27337efb6895d02044adc8c34dcc572462a7ad124361cd
Jul 29 08:55:33.879002 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:33.878939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7" event={"ID":"4325e682-4382-45e6-9fb0-0041ecb883e6","Type":"ContainerStarted","Data":"650b4f33ed5a0819ef27337efb6895d02044adc8c34dcc572462a7ad124361cd"}
Jul 29 08:55:34.819450 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:34.819414    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qnwtf"
Jul 29 08:55:41.863377 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:41.863341    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:43.714241 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.714205    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"]
Jul 29 08:55:43.714647 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.714391    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" containerName="manager" containerID="cri-o://50b1949561a01cad1255b552b3d3c1cfd9e1214f9fb3ecc45c8783e218a19a6b" gracePeriod=2
Jul 29 08:55:43.727075 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.727000    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"]
Jul 29 08:55:43.735932 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:43.735828    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bb6d4c11-119a-4f5c-aefc-718baba74d17\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\": pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:43.747198 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.747088    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:55:43.749865 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.749676    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" containerName="manager"
Jul 29 08:55:43.750131 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.750022    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" containerName="manager"
Jul 29 08:55:43.750279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.750265    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" containerName="manager"
Jul 29 08:55:43.765489 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.764729    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:43.767102 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.764679    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"]
Jul 29 08:55:43.767102 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.765700    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:55:43.767102 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.765911    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" containerName="manager" containerID="cri-o://32b8ec2d694d9a46bd61dffa858cc7e7b5974c0e06333369eea19c64b91c102c" gracePeriod=2
Jul 29 08:55:43.769681 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.769652    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"]
Jul 29 08:55:43.784397 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.784353    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"]
Jul 29 08:55:43.785097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.784918    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" containerName="manager"
Jul 29 08:55:43.785097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.784940    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" containerName="manager"
Jul 29 08:55:43.785097 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.785032    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" containerName="manager"
Jul 29 08:55:43.790098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.790072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:43.798425 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.798395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"]
Jul 29 08:55:43.800157 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:43.799968    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:43.801789 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:43.801690    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:43.821995 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:43.821950    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:43.887085 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.887048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzljx\" (UniqueName: \"kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:43.887255 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.887136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2g7\" (UniqueName: \"kubernetes.io/projected/0bb85cb3-2f26-4396-9ac7-68cdb7a08f89-kube-api-access-7c2g7\") pod \"limitador-operator-controller-manager-859d7b78bd-h57d2\" (UID: \"0bb85cb3-2f26-4396-9ac7-68cdb7a08f89\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:43.887255 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.887213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:43.988049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.987954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzljx\" (UniqueName: \"kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:43.988049 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.988007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2g7\" (UniqueName: \"kubernetes.io/projected/0bb85cb3-2f26-4396-9ac7-68cdb7a08f89-kube-api-access-7c2g7\") pod \"limitador-operator-controller-manager-859d7b78bd-h57d2\" (UID: \"0bb85cb3-2f26-4396-9ac7-68cdb7a08f89\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:43.988261 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.988076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:43.988454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:43.988435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:44.001325 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:44.001297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzljx\" (UniqueName: \"kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sr56f\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:44.002048 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:44.002022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2g7\" (UniqueName: \"kubernetes.io/projected/0bb85cb3-2f26-4396-9ac7-68cdb7a08f89-kube-api-access-7c2g7\") pod \"limitador-operator-controller-manager-859d7b78bd-h57d2\" (UID: \"0bb85cb3-2f26-4396-9ac7-68cdb7a08f89\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:44.161510 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:44.161466    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:44.168546 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:44.168505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:55.026923 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.026760    2573 generic.go:356] "Generic (PLEG): container finished" podID="bb6d4c11-119a-4f5c-aefc-718baba74d17" containerID="50b1949561a01cad1255b552b3d3c1cfd9e1214f9fb3ecc45c8783e218a19a6b" exitCode=0
Jul 29 08:55:55.028877 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.028736    2573 generic.go:356] "Generic (PLEG): container finished" podID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" containerID="32b8ec2d694d9a46bd61dffa858cc7e7b5974c0e06333369eea19c64b91c102c" exitCode=0
Jul 29 08:55:55.049955 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.049874    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:55.051843 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:55.051814    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:55.052763 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.052737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"]
Jul 29 08:55:55.054407 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:55.054384    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb85cb3_2f26_4396_9ac7_68cdb7a08f89.slice/crio-78fdd1fdfd317dba4fd61bcb1049a428fe1a9d641d4becfaeab5ebbc0debf016 WatchSource:0}: Error finding container 78fdd1fdfd317dba4fd61bcb1049a428fe1a9d641d4becfaeab5ebbc0debf016: Status 404 returned error can't find the container with id 78fdd1fdfd317dba4fd61bcb1049a428fe1a9d641d4becfaeab5ebbc0debf016
Jul 29 08:55:55.056322 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.056304    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:55.058270 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:55.058233    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:55.059961 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:55.059775    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:55.083499 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.083471    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:55:55.086395 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:55:55.086371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569b9e7_cdd8_4ae2_ade8_945c41939495.slice/crio-6f34e183facbda3b12536f157a3a544c788e7b39bb6d60ddaaecdfbca163a1cd WatchSource:0}: Error finding container 6f34e183facbda3b12536f157a3a544c788e7b39bb6d60ddaaecdfbca163a1cd: Status 404 returned error can't find the container with id 6f34e183facbda3b12536f157a3a544c788e7b39bb6d60ddaaecdfbca163a1cd
Jul 29 08:55:55.096754 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.096732    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume\") pod \"bb6d4c11-119a-4f5c-aefc-718baba74d17\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") "
Jul 29 08:55:55.096857 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.096783    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nm9l\" (UniqueName: \"kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l\") pod \"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa\" (UID: \"c3bbb00d-38d5-4517-8317-a6e13ebaa4fa\") "
Jul 29 08:55:55.096857 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.096822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzb2p\" (UniqueName: \"kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p\") pod \"bb6d4c11-119a-4f5c-aefc-718baba74d17\" (UID: \"bb6d4c11-119a-4f5c-aefc-718baba74d17\") "
Jul 29 08:55:55.097170 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.097141    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bb6d4c11-119a-4f5c-aefc-718baba74d17" (UID: "bb6d4c11-119a-4f5c-aefc-718baba74d17"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:55.098918 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.098876    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l" (OuterVolumeSpecName: "kube-api-access-8nm9l") pod "c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" (UID: "c3bbb00d-38d5-4517-8317-a6e13ebaa4fa"). InnerVolumeSpecName "kube-api-access-8nm9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:55.098978 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.098945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p" (OuterVolumeSpecName: "kube-api-access-tzb2p") pod "bb6d4c11-119a-4f5c-aefc-718baba74d17" (UID: "bb6d4c11-119a-4f5c-aefc-718baba74d17"). InnerVolumeSpecName "kube-api-access-tzb2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:55.198341 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.198301    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzb2p\" (UniqueName: \"kubernetes.io/projected/bb6d4c11-119a-4f5c-aefc-718baba74d17-kube-api-access-tzb2p\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:55.198341 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.198336    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb6d4c11-119a-4f5c-aefc-718baba74d17-extensions-socket-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:55.198341 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:55.198346    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nm9l\" (UniqueName: \"kubernetes.io/projected/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa-kube-api-access-8nm9l\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:56.035408 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.035364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" event={"ID":"2569b9e7-cdd8-4ae2-ade8-945c41939495","Type":"ContainerStarted","Data":"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"}
Jul 29 08:55:56.035883 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.035428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" event={"ID":"2569b9e7-cdd8-4ae2-ade8-945c41939495","Type":"ContainerStarted","Data":"6f34e183facbda3b12536f157a3a544c788e7b39bb6d60ddaaecdfbca163a1cd"}
Jul 29 08:55:56.035883 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.035455    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:56.036672 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.036650    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:56.036749 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.036653    2573 scope.go:117] "RemoveContainer" containerID="50b1949561a01cad1255b552b3d3c1cfd9e1214f9fb3ecc45c8783e218a19a6b"
Jul 29 08:55:56.038036 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:56.037990    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:56.038387 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.038365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2" event={"ID":"0bb85cb3-2f26-4396-9ac7-68cdb7a08f89","Type":"ContainerStarted","Data":"e0c4987cb880df20e9026595a376827e81e092e875c08e4ff68b53c158bfcafa"}
Jul 29 08:55:56.038470 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.038402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2" event={"ID":"0bb85cb3-2f26-4396-9ac7-68cdb7a08f89","Type":"ContainerStarted","Data":"78fdd1fdfd317dba4fd61bcb1049a428fe1a9d641d4becfaeab5ebbc0debf016"}
Jul 29 08:55:56.038470 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.038452    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:55:56.039839 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.039817    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:56.041334 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.041308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7" event={"ID":"4325e682-4382-45e6-9fb0-0041ecb883e6","Type":"ContainerStarted","Data":"97650e073d09aadae479301735699cbe653f5b8d26b393f2a809de24d0e6c2f9"}
Jul 29 08:55:56.046944 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.046925    2573 scope.go:117] "RemoveContainer" containerID="32b8ec2d694d9a46bd61dffa858cc7e7b5974c0e06333369eea19c64b91c102c"
Jul 29 08:55:56.057692 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:56.057666    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:56.058440 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.058403    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" podStartSLOduration=13.058391648 podStartE2EDuration="13.058391648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:56.056138898 +0000 UTC m=+494.028281783" watchObservedRunningTime="2026-07-29 08:55:56.058391648 +0000 UTC m=+494.030534523"
Jul 29 08:55:56.062155 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:56.062120    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mqg5v\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mqg5v"
Jul 29 08:55:56.063581 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:55:56.063555    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4g2m\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4g2m"
Jul 29 08:55:56.078493 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.078450    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jstc7" podStartSLOduration=1.9722434739999999 podStartE2EDuration="23.078437507s" totalImagesPullingTime="21.106194033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:56.077496226 +0000 UTC m=+494.049639101" watchObservedRunningTime="2026-07-29 08:55:56.078437507 +0000 UTC m=+494.050580382"
Jul 29 08:55:56.092153 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.092111    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2" podStartSLOduration=13.092097911 podStartE2EDuration="13.092097911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:55:56.091342017 +0000 UTC m=+494.063484895" watchObservedRunningTime="2026-07-29 08:55:56.092097911 +0000 UTC m=+494.064240786"
Jul 29 08:55:56.644910 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.644862    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb6d4c11-119a-4f5c-aefc-718baba74d17" path="/var/lib/kubelet/pods/bb6d4c11-119a-4f5c-aefc-718baba74d17/volumes"
Jul 29 08:55:56.645282 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:56.645266    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3bbb00d-38d5-4517-8317-a6e13ebaa4fa" path="/var/lib/kubelet/pods/c3bbb00d-38d5-4517-8317-a6e13ebaa4fa/volumes"
Jul 29 08:55:59.536556 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.536520    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:55:59.536961 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.536704    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" podUID="2569b9e7-cdd8-4ae2-ade8-945c41939495" containerName="manager" containerID="cri-o://4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c" gracePeriod=10
Jul 29 08:55:59.783580 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.783551    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:55:59.836294 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.836267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume\") pod \"2569b9e7-cdd8-4ae2-ade8-945c41939495\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") "
Jul 29 08:55:59.836437 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.836344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzljx\" (UniqueName: \"kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx\") pod \"2569b9e7-cdd8-4ae2-ade8-945c41939495\" (UID: \"2569b9e7-cdd8-4ae2-ade8-945c41939495\") "
Jul 29 08:55:59.836642 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.836619    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2569b9e7-cdd8-4ae2-ade8-945c41939495" (UID: "2569b9e7-cdd8-4ae2-ade8-945c41939495"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:55:59.838452 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.838419    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx" (OuterVolumeSpecName: "kube-api-access-mzljx") pod "2569b9e7-cdd8-4ae2-ade8-945c41939495" (UID: "2569b9e7-cdd8-4ae2-ade8-945c41939495"). InnerVolumeSpecName "kube-api-access-mzljx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:55:59.937841 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.937795    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2569b9e7-cdd8-4ae2-ade8-945c41939495-extensions-socket-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:55:59.937841 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:55:59.937827    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzljx\" (UniqueName: \"kubernetes.io/projected/2569b9e7-cdd8-4ae2-ade8-945c41939495-kube-api-access-mzljx\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:56:00.065203 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.065169    2573 generic.go:356] "Generic (PLEG): container finished" podID="2569b9e7-cdd8-4ae2-ade8-945c41939495" containerID="4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c" exitCode=0
Jul 29 08:56:00.065364 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.065217    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"
Jul 29 08:56:00.065364 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.065239    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" event={"ID":"2569b9e7-cdd8-4ae2-ade8-945c41939495","Type":"ContainerDied","Data":"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"}
Jul 29 08:56:00.065364 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.065293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f" event={"ID":"2569b9e7-cdd8-4ae2-ade8-945c41939495","Type":"ContainerDied","Data":"6f34e183facbda3b12536f157a3a544c788e7b39bb6d60ddaaecdfbca163a1cd"}
Jul 29 08:56:00.065364 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.065317    2573 scope.go:117] "RemoveContainer" containerID="4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"
Jul 29 08:56:00.074361 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.074342    2573 scope.go:117] "RemoveContainer" containerID="4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"
Jul 29 08:56:00.074627 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:56:00.074608    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c\": container with ID starting with 4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c not found: ID does not exist" containerID="4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"
Jul 29 08:56:00.074691 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.074633    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c"} err="failed to get container status \"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c\": rpc error: code = NotFound desc = could not find container \"4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c\": container with ID starting with 4d01dd5172252f3824a5491d19179d5e099bae31753ef6f62a35d94166aa420c not found: ID does not exist"
Jul 29 08:56:00.092277 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.092222    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:56:00.096249 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.096229    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sr56f"]
Jul 29 08:56:00.644590 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:00.644558    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2569b9e7-cdd8-4ae2-ade8-945c41939495" path="/var/lib/kubelet/pods/2569b9e7-cdd8-4ae2-ade8-945c41939495/volumes"
Jul 29 08:56:07.051443 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:07.051404    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h57d2"
Jul 29 08:56:15.950422 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:15.950384    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"]
Jul 29 08:56:15.950799 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:15.950765    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569b9e7-cdd8-4ae2-ade8-945c41939495" containerName="manager"
Jul 29 08:56:15.950799 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:15.950778    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569b9e7-cdd8-4ae2-ade8-945c41939495" containerName="manager"
Jul 29 08:56:15.950881 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:15.950849    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2569b9e7-cdd8-4ae2-ade8-945c41939495" containerName="manager"
Jul 29 08:56:16.135758 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.135718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"]
Jul 29 08:56:16.135971 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.135836    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.138355 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.138324    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 08:56:16.138464 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.138412    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-msgz5\""
Jul 29 08:56:16.276116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlts9\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-kube-api-access-nlts9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276116 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276318 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276318 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276318 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276318 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276484 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276484 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bd778b-da1b-451a-8d60-f66d883aadcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.276484 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.276399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377042 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlts9\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-kube-api-access-nlts9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377064    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377462 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377462 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bd778b-da1b-451a-8d60-f66d883aadcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377462 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377606 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377507    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377606 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377717 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377759 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.377999 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.377975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bd778b-da1b-451a-8d60-f66d883aadcf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.379677 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.379654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.379912 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.379879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.385632 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.385609    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.385987 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.385965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlts9\" (UniqueName: \"kubernetes.io/projected/45bd778b-da1b-451a-8d60-f66d883aadcf-kube-api-access-nlts9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lqjvs\" (UID: \"45bd778b-da1b-451a-8d60-f66d883aadcf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.446963 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.446922    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:16.618699 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:16.618669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"]
Jul 29 08:56:16.620522 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:56:16.620493    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bd778b_da1b_451a_8d60_f66d883aadcf.slice/crio-3324360f6599167d7ba2291597cb8ec697e4afb672fc60fc924a24d3b191460e WatchSource:0}: Error finding container 3324360f6599167d7ba2291597cb8ec697e4afb672fc60fc924a24d3b191460e: Status 404 returned error can't find the container with id 3324360f6599167d7ba2291597cb8ec697e4afb672fc60fc924a24d3b191460e
Jul 29 08:56:17.161374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:17.161335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" event={"ID":"45bd778b-da1b-451a-8d60-f66d883aadcf","Type":"ContainerStarted","Data":"3324360f6599167d7ba2291597cb8ec697e4afb672fc60fc924a24d3b191460e"}
Jul 29 08:56:19.638825 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:19.638791    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:56:19.639181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:19.638870    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:56:19.639181 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:19.638932    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:56:20.182411 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:20.182374    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" event={"ID":"45bd778b-da1b-451a-8d60-f66d883aadcf","Type":"ContainerStarted","Data":"17d4485898a4800b7f8e7d57202890ae79f901abacdca98a33a2ba7c5725089f"}
Jul 29 08:56:20.203272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:20.203112    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" podStartSLOduration=2.187545496 podStartE2EDuration="5.203089023s" totalImagesPullingTime="3.015543527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:56:20.201450584 +0000 UTC m=+518.173593458" watchObservedRunningTime="2026-07-29 08:56:20.203089023 +0000 UTC m=+518.175231899"
Jul 29 08:56:20.447973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:20.447874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:20.452744 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:20.452717    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:21.188933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:21.188874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:21.189795 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:21.189777    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:56:35.349477 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.349392    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:35.450199 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.450147    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:35.450376 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.450216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:35.450376 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.450263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.452454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.452418    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 08:56:35.557469 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.557436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gx5\" (UniqueName: \"kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.557639 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.557510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.658712 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.658631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79gx5\" (UniqueName: \"kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.658885 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.658709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.659429 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.659403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.669722 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.669691    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gx5\" (UniqueName: \"kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5\") pod \"limitador-limitador-64c94fd64f-rj9tr\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.761811 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.761769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:35.904609 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:35.904583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:35.906334 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:56:35.906307    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e4d223_c51d_4536_8bde_9cb4635dc6c6.slice/crio-78b77a8b5a7bf18ab653ff8c9bf85eaab39b4d449f1ebe44d6c845dd7231217a WatchSource:0}: Error finding container 78b77a8b5a7bf18ab653ff8c9bf85eaab39b4d449f1ebe44d6c845dd7231217a: Status 404 returned error can't find the container with id 78b77a8b5a7bf18ab653ff8c9bf85eaab39b4d449f1ebe44d6c845dd7231217a
Jul 29 08:56:36.159305 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.159273    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:36.162758 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.162688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:36.164763 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.164729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wtjt5\""
Jul 29 08:56:36.171234 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.171183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:36.263532 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.263501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hlcl\" (UniqueName: \"kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl\") pod \"authorino-58cd955675-m4wfv\" (UID: \"d91f6036-65f4-43e2-beaa-c6ab3b83ad20\") " pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:36.269062 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.269028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" event={"ID":"40e4d223-c51d-4536-8bde-9cb4635dc6c6","Type":"ContainerStarted","Data":"78b77a8b5a7bf18ab653ff8c9bf85eaab39b4d449f1ebe44d6c845dd7231217a"}
Jul 29 08:56:36.364685 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.364651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hlcl\" (UniqueName: \"kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl\") pod \"authorino-58cd955675-m4wfv\" (UID: \"d91f6036-65f4-43e2-beaa-c6ab3b83ad20\") " pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:36.373167 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.373139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hlcl\" (UniqueName: \"kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl\") pod \"authorino-58cd955675-m4wfv\" (UID: \"d91f6036-65f4-43e2-beaa-c6ab3b83ad20\") " pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:36.475103 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.475027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:36.606248 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:36.606221    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:36.607757 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:56:36.607730    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd91f6036_65f4_43e2_beaa_c6ab3b83ad20.slice/crio-a8b9ea3e8d376548caab213a63b714bf9e64bfbf960a1dbbaca06fc850ba5a4f WatchSource:0}: Error finding container a8b9ea3e8d376548caab213a63b714bf9e64bfbf960a1dbbaca06fc850ba5a4f: Status 404 returned error can't find the container with id a8b9ea3e8d376548caab213a63b714bf9e64bfbf960a1dbbaca06fc850ba5a4f
Jul 29 08:56:37.280729 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:37.280653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m4wfv" event={"ID":"d91f6036-65f4-43e2-beaa-c6ab3b83ad20","Type":"ContainerStarted","Data":"a8b9ea3e8d376548caab213a63b714bf9e64bfbf960a1dbbaca06fc850ba5a4f"}
Jul 29 08:56:41.317967 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.317924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m4wfv" event={"ID":"d91f6036-65f4-43e2-beaa-c6ab3b83ad20","Type":"ContainerStarted","Data":"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"}
Jul 29 08:56:41.319432 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.319410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" event={"ID":"40e4d223-c51d-4536-8bde-9cb4635dc6c6","Type":"ContainerStarted","Data":"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"}
Jul 29 08:56:41.319584 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.319564    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:41.329927 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.329869    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-m4wfv" podStartSLOduration=1.338932008 podStartE2EDuration="5.329856656s" totalImagesPullingTime="3.990924648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:56:41.328593868 +0000 UTC m=+539.300736744" watchObservedRunningTime="2026-07-29 08:56:41.329856656 +0000 UTC m=+539.301999531"
Jul 29 08:56:41.344365 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.344308    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" podStartSLOduration=1.652844711 podStartE2EDuration="6.344289801s" totalImagesPullingTime="4.69144509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:56:41.342034276 +0000 UTC m=+539.314177152" watchObservedRunningTime="2026-07-29 08:56:41.344289801 +0000 UTC m=+539.316432677"
Jul 29 08:56:41.749661 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:41.749629    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:43.329988 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:43.329943    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-m4wfv" podUID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" containerName="authorino" containerID="cri-o://033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c" gracePeriod=30
Jul 29 08:56:43.583425 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:43.583369    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:43.625994 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:43.625960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hlcl\" (UniqueName: \"kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl\") pod \"d91f6036-65f4-43e2-beaa-c6ab3b83ad20\" (UID: \"d91f6036-65f4-43e2-beaa-c6ab3b83ad20\") "
Jul 29 08:56:43.628026 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:43.627994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl" (OuterVolumeSpecName: "kube-api-access-8hlcl") pod "d91f6036-65f4-43e2-beaa-c6ab3b83ad20" (UID: "d91f6036-65f4-43e2-beaa-c6ab3b83ad20"). InnerVolumeSpecName "kube-api-access-8hlcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:56:43.727010 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:43.726973    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hlcl\" (UniqueName: \"kubernetes.io/projected/d91f6036-65f4-43e2-beaa-c6ab3b83ad20-kube-api-access-8hlcl\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:56:44.336300 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.336267    2573 generic.go:356] "Generic (PLEG): container finished" podID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" containerID="033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c" exitCode=0
Jul 29 08:56:44.336703 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.336321    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m4wfv"
Jul 29 08:56:44.336703 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.336351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m4wfv" event={"ID":"d91f6036-65f4-43e2-beaa-c6ab3b83ad20","Type":"ContainerDied","Data":"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"}
Jul 29 08:56:44.336703 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.336395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m4wfv" event={"ID":"d91f6036-65f4-43e2-beaa-c6ab3b83ad20","Type":"ContainerDied","Data":"a8b9ea3e8d376548caab213a63b714bf9e64bfbf960a1dbbaca06fc850ba5a4f"}
Jul 29 08:56:44.336703 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.336412    2573 scope.go:117] "RemoveContainer" containerID="033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"
Jul 29 08:56:44.345596 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.345579    2573 scope.go:117] "RemoveContainer" containerID="033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"
Jul 29 08:56:44.345856 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:56:44.345837    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c\": container with ID starting with 033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c not found: ID does not exist" containerID="033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"
Jul 29 08:56:44.345989 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.345867    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c"} err="failed to get container status \"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c\": rpc error: code = NotFound desc = could not find container \"033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c\": container with ID starting with 033f2822e1afd422f4a52320ad4c64764e092ef34618eea1159f55d578fc0d9c not found: ID does not exist"
Jul 29 08:56:44.356040 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.356015    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:44.359193 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.359169    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-m4wfv"]
Jul 29 08:56:44.644379 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:44.644299    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" path="/var/lib/kubelet/pods/d91f6036-65f4-43e2-beaa-c6ab3b83ad20/volumes"
Jul 29 08:56:52.325991 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:52.325957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:52.788626 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:52.788590    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:52.788878 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:52.788829    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" podUID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" containerName="limitador" containerID="cri-o://e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5" gracePeriod=30
Jul 29 08:56:53.346609 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.346586    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:53.386604 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.386519    2573 generic.go:356] "Generic (PLEG): container finished" podID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" containerID="e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5" exitCode=0
Jul 29 08:56:53.386604 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.386565    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"
Jul 29 08:56:53.386792 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.386610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" event={"ID":"40e4d223-c51d-4536-8bde-9cb4635dc6c6","Type":"ContainerDied","Data":"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"}
Jul 29 08:56:53.386792 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.386676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rj9tr" event={"ID":"40e4d223-c51d-4536-8bde-9cb4635dc6c6","Type":"ContainerDied","Data":"78b77a8b5a7bf18ab653ff8c9bf85eaab39b4d449f1ebe44d6c845dd7231217a"}
Jul 29 08:56:53.386792 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.386692    2573 scope.go:117] "RemoveContainer" containerID="e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"
Jul 29 08:56:53.396933 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.396885    2573 scope.go:117] "RemoveContainer" containerID="e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"
Jul 29 08:56:53.397222 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:56:53.397193    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5\": container with ID starting with e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5 not found: ID does not exist" containerID="e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"
Jul 29 08:56:53.397281 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.397237    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5"} err="failed to get container status \"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5\": rpc error: code = NotFound desc = could not find container \"e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5\": container with ID starting with e21bdd96b1678d2f752c40d66867e11d2f78fcf880b004dff00c1e8cba62fec5 not found: ID does not exist"
Jul 29 08:56:53.410503 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.410480    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file\") pod \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") "
Jul 29 08:56:53.410591 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.410580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79gx5\" (UniqueName: \"kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5\") pod \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\" (UID: \"40e4d223-c51d-4536-8bde-9cb4635dc6c6\") "
Jul 29 08:56:53.410777 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.410756    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file" (OuterVolumeSpecName: "config-file") pod "40e4d223-c51d-4536-8bde-9cb4635dc6c6" (UID: "40e4d223-c51d-4536-8bde-9cb4635dc6c6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:56:53.412494 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.412469    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5" (OuterVolumeSpecName: "kube-api-access-79gx5") pod "40e4d223-c51d-4536-8bde-9cb4635dc6c6" (UID: "40e4d223-c51d-4536-8bde-9cb4635dc6c6"). InnerVolumeSpecName "kube-api-access-79gx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:56:53.511800 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.511766    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79gx5\" (UniqueName: \"kubernetes.io/projected/40e4d223-c51d-4536-8bde-9cb4635dc6c6-kube-api-access-79gx5\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:56:53.511800 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.511794    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40e4d223-c51d-4536-8bde-9cb4635dc6c6-config-file\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:56:53.708816 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.708782    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:53.713602 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:53.713579    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rj9tr"]
Jul 29 08:56:54.644724 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:54.644685    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" path="/var/lib/kubelet/pods/40e4d223-c51d-4536-8bde-9cb4635dc6c6/volumes"
Jul 29 08:56:58.182254 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182213    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"]
Jul 29 08:56:58.182721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182670    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" containerName="authorino"
Jul 29 08:56:58.182721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182687    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" containerName="authorino"
Jul 29 08:56:58.182721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182703    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" containerName="limitador"
Jul 29 08:56:58.182721 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182715    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" containerName="limitador"
Jul 29 08:56:58.182963 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182795    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e4d223-c51d-4536-8bde-9cb4635dc6c6" containerName="limitador"
Jul 29 08:56:58.182963 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.182803    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91f6036-65f4-43e2-beaa-c6ab3b83ad20" containerName="authorino"
Jul 29 08:56:58.187267 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.187244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.189508 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.189483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 29 08:56:58.189732 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.189564    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 08:56:58.190113 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.190090    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 08:56:58.190355 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.190337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4tm9h\""
Jul 29 08:56:58.195035 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.195009    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"]
Jul 29 08:56:58.254391 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.254357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-data\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.254553 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.254400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mj4k\" (UniqueName: \"kubernetes.io/projected/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-kube-api-access-6mj4k\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.355162 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.355131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-data\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.355324 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.355168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mj4k\" (UniqueName: \"kubernetes.io/projected/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-kube-api-access-6mj4k\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.355498 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.355478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-data\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.363646 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.363621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mj4k\" (UniqueName: \"kubernetes.io/projected/bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2-kube-api-access-6mj4k\") pod \"postgres-69fb4594cf-p9mfn\" (UID: \"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.499397 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.499314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:56:58.630204 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:58.630177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"]
Jul 29 08:56:58.632054 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:56:58.632024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf5f625_1ed1_4e03_9dd0_f9ddbe59c1d2.slice/crio-d6dd0e74217ee162a473a6b079fd0355df27bd5c39d099dd7a773fb2fdf2a669 WatchSource:0}: Error finding container d6dd0e74217ee162a473a6b079fd0355df27bd5c39d099dd7a773fb2fdf2a669: Status 404 returned error can't find the container with id d6dd0e74217ee162a473a6b079fd0355df27bd5c39d099dd7a773fb2fdf2a669
Jul 29 08:56:59.429738 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:56:59.429650    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn" event={"ID":"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2","Type":"ContainerStarted","Data":"d6dd0e74217ee162a473a6b079fd0355df27bd5c39d099dd7a773fb2fdf2a669"}
Jul 29 08:57:03.454985 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:03.454943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn" event={"ID":"bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2","Type":"ContainerStarted","Data":"a5af505ae5778e151ecf9be2673a544245d9553843bd6a66b77fe335f5cde498"}
Jul 29 08:57:03.455335 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:03.455131    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:57:03.471805 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:03.471755    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn" podStartSLOduration=0.828449117 podStartE2EDuration="5.471739723s" totalImagesPullingTime="4.643290606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:03.470365339 +0000 UTC m=+561.442508218" watchObservedRunningTime="2026-07-29 08:57:03.471739723 +0000 UTC m=+561.443882597"
Jul 29 08:57:09.490119 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:09.490089    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p9mfn"
Jul 29 08:57:10.025646 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.025609    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t79mc"]
Jul 29 08:57:10.030835 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.030812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.032974 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.032945    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wtjt5\""
Jul 29 08:57:10.035524 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.035502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t79mc"]
Jul 29 08:57:10.166362 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.166321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jvw\" (UniqueName: \"kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw\") pod \"authorino-5d4b67c446-t79mc\" (UID: \"d561a354-70eb-4016-ac01-baf1b4d0ce8a\") " pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.263789 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.263746    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t79mc"]
Jul 29 08:57:10.264095 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:57:10.264071    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j4jvw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-t79mc" podUID="d561a354-70eb-4016-ac01-baf1b4d0ce8a"
Jul 29 08:57:10.267638 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.267615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jvw\" (UniqueName: \"kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw\") pod \"authorino-5d4b67c446-t79mc\" (UID: \"d561a354-70eb-4016-ac01-baf1b4d0ce8a\") " pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.281184 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.281121    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jvw\" (UniqueName: \"kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw\") pod \"authorino-5d4b67c446-t79mc\" (UID: \"d561a354-70eb-4016-ac01-baf1b4d0ce8a\") " pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.289218 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.289195    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7686dc7b54-948j9"]
Jul 29 08:57:10.292695 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.292680    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.299533 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.299510    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7686dc7b54-948j9"]
Jul 29 08:57:10.368377 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.368338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89bh\" (UniqueName: \"kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh\") pod \"authorino-7686dc7b54-948j9\" (UID: \"87fef019-1fa8-42fd-aec9-c57cdd5cf5e5\") " pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.383788 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.383761    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7686dc7b54-948j9"]
Jul 29 08:57:10.384039 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:57:10.384020    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n89bh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7686dc7b54-948j9" podUID="87fef019-1fa8-42fd-aec9-c57cdd5cf5e5"
Jul 29 08:57:10.410485 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.410450    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 08:57:10.416108 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.416076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.418508 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.418464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 08:57:10.422355 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.422330    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 08:57:10.469239 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.469208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89bh\" (UniqueName: \"kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh\") pod \"authorino-7686dc7b54-948j9\" (UID: \"87fef019-1fa8-42fd-aec9-c57cdd5cf5e5\") " pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.477184 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.477157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89bh\" (UniqueName: \"kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh\") pod \"authorino-7686dc7b54-948j9\" (UID: \"87fef019-1fa8-42fd-aec9-c57cdd5cf5e5\") " pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.493506 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.493480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.493866 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.493480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.500906 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.500875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:10.503830 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.503814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:10.570018 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.569922    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4jvw\" (UniqueName: \"kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw\") pod \"d561a354-70eb-4016-ac01-baf1b4d0ce8a\" (UID: \"d561a354-70eb-4016-ac01-baf1b4d0ce8a\") "
Jul 29 08:57:10.570161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.570044    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n89bh\" (UniqueName: \"kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh\") pod \"87fef019-1fa8-42fd-aec9-c57cdd5cf5e5\" (UID: \"87fef019-1fa8-42fd-aec9-c57cdd5cf5e5\") "
Jul 29 08:57:10.570161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.570145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.570244 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.570212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfhn8\" (UniqueName: \"kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.572119 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.572089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh" (OuterVolumeSpecName: "kube-api-access-n89bh") pod "87fef019-1fa8-42fd-aec9-c57cdd5cf5e5" (UID: "87fef019-1fa8-42fd-aec9-c57cdd5cf5e5"). InnerVolumeSpecName "kube-api-access-n89bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:57:10.572119 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.572102    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw" (OuterVolumeSpecName: "kube-api-access-j4jvw") pod "d561a354-70eb-4016-ac01-baf1b4d0ce8a" (UID: "d561a354-70eb-4016-ac01-baf1b4d0ce8a"). InnerVolumeSpecName "kube-api-access-j4jvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:57:10.671387 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.671354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.671526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.671431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfhn8\" (UniqueName: \"kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.671526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.671490    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n89bh\" (UniqueName: \"kubernetes.io/projected/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5-kube-api-access-n89bh\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:57:10.671526 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.671500    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4jvw\" (UniqueName: \"kubernetes.io/projected/d561a354-70eb-4016-ac01-baf1b4d0ce8a-kube-api-access-j4jvw\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:57:10.673871 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.673845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.678342 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.678317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfhn8\" (UniqueName: \"kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8\") pod \"authorino-645fdb8cd6-kjt89\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") " pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.727055 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.727018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 08:57:10.864688 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:10.864659    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 08:57:10.865392 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:10.865368    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c77e77f_471c_4325_abe9_a6a82a713831.slice/crio-b7ea56da285408de6fc126ebad9d6db08878dc335dca40df230a74f2bd507caa WatchSource:0}: Error finding container b7ea56da285408de6fc126ebad9d6db08878dc335dca40df230a74f2bd507caa: Status 404 returned error can't find the container with id b7ea56da285408de6fc126ebad9d6db08878dc335dca40df230a74f2bd507caa
Jul 29 08:57:11.499436 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.499402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" event={"ID":"4c77e77f-471c-4325-abe9-a6a82a713831","Type":"ContainerStarted","Data":"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"}
Jul 29 08:57:11.499823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.499444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" event={"ID":"4c77e77f-471c-4325-abe9-a6a82a713831","Type":"ContainerStarted","Data":"b7ea56da285408de6fc126ebad9d6db08878dc335dca40df230a74f2bd507caa"}
Jul 29 08:57:11.499823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.499515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7686dc7b54-948j9"
Jul 29 08:57:11.499823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.499527    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-t79mc"
Jul 29 08:57:11.513159 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.513106    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" podStartSLOduration=1.06671569 podStartE2EDuration="1.513090726s" totalImagesPullingTime="446.375036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:11.512588639 +0000 UTC m=+569.484731519" watchObservedRunningTime="2026-07-29 08:57:11.513090726 +0000 UTC m=+569.485233601"
Jul 29 08:57:11.534614 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.534579    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t79mc"]
Jul 29 08:57:11.540087 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.540065    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-t79mc"]
Jul 29 08:57:11.563073 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.562984    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7686dc7b54-948j9"]
Jul 29 08:57:11.565197 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:11.565170    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7686dc7b54-948j9"]
Jul 29 08:57:12.644272 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:12.644242    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87fef019-1fa8-42fd-aec9-c57cdd5cf5e5" path="/var/lib/kubelet/pods/87fef019-1fa8-42fd-aec9-c57cdd5cf5e5/volumes"
Jul 29 08:57:12.644637 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:12.644471    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d561a354-70eb-4016-ac01-baf1b4d0ce8a" path="/var/lib/kubelet/pods/d561a354-70eb-4016-ac01-baf1b4d0ce8a/volumes"
Jul 29 08:57:16.221492 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.221453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:16.445856 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.445823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:16.445856 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.445859    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 08:57:16.446085 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.445959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.448819 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.448792    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 29 08:57:16.448973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.448837    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 08:57:16.448973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.448837    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qtgm\""
Jul 29 08:57:16.448973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.448797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 08:57:16.472692 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.472625    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 08:57:16.472824 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.472721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.525604 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.525576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.525764 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.525693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.525764 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.525723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbhl\" (UniqueName: \"kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.626379 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.626561 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lspm7\" (UniqueName: \"kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.626561 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.626561 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.626561 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.626823 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.626565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbhl\" (UniqueName: \"kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.628867 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.628842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.628973 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.628874    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.634047 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.634028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbhl\" (UniqueName: \"kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl\") pod \"maas-controller-78dc94c995-bqjqw\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") " pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.727872 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.727795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.727872 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.727841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.728062 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.728035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lspm7\" (UniqueName: \"kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.730316 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.730295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.730430 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.730328    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.735723 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.735701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lspm7\" (UniqueName: \"kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7\") pod \"maas-controller-95cc89ddf-sdb9x\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") " pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.756312 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.756286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:16.782362 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.782340    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:16.921163 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.921137    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:16.924487 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:16.924145    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f7d855_4de0_4c25_9b87_372bb8a1adff.slice/crio-91540e3e143103fcf02f0464ca11a4d957c276402f5d69bceb5fba0e44ebcd3e WatchSource:0}: Error finding container 91540e3e143103fcf02f0464ca11a4d957c276402f5d69bceb5fba0e44ebcd3e: Status 404 returned error can't find the container with id 91540e3e143103fcf02f0464ca11a4d957c276402f5d69bceb5fba0e44ebcd3e
Jul 29 08:57:16.955354 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:16.955329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 08:57:16.957759 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:16.957733    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55581bb_2fde_4fa2_bbd1_3b53ed820e65.slice/crio-8055bc93172dc476dbdb3309f2e4cb07fc9837e1d7188455a540a4be6ad87c9f WatchSource:0}: Error finding container 8055bc93172dc476dbdb3309f2e4cb07fc9837e1d7188455a540a4be6ad87c9f: Status 404 returned error can't find the container with id 8055bc93172dc476dbdb3309f2e4cb07fc9837e1d7188455a540a4be6ad87c9f
Jul 29 08:57:17.536165 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:17.536122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" event={"ID":"e55581bb-2fde-4fa2-bbd1-3b53ed820e65","Type":"ContainerStarted","Data":"8055bc93172dc476dbdb3309f2e4cb07fc9837e1d7188455a540a4be6ad87c9f"}
Jul 29 08:57:17.537770 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:17.537727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78dc94c995-bqjqw" event={"ID":"89f7d855-4de0-4c25-9b87-372bb8a1adff","Type":"ContainerStarted","Data":"91540e3e143103fcf02f0464ca11a4d957c276402f5d69bceb5fba0e44ebcd3e"}
Jul 29 08:57:20.554605 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.554566    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" event={"ID":"e55581bb-2fde-4fa2-bbd1-3b53ed820e65","Type":"ContainerStarted","Data":"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"}
Jul 29 08:57:20.555074 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.554656    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:20.556217 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.556188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78dc94c995-bqjqw" event={"ID":"89f7d855-4de0-4c25-9b87-372bb8a1adff","Type":"ContainerStarted","Data":"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"}
Jul 29 08:57:20.556352 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.556266    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:20.572222 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.572164    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" podStartSLOduration=1.9342905350000001 podStartE2EDuration="4.572145562s" totalImagesPullingTime="2.637855027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:20.571364182 +0000 UTC m=+578.543507056" watchObservedRunningTime="2026-07-29 08:57:20.572145562 +0000 UTC m=+578.544288436"
Jul 29 08:57:20.589683 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:20.589633    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78dc94c995-bqjqw" podStartSLOduration=1.9305686290000001 podStartE2EDuration="4.589618381s" totalImagesPullingTime="2.659049752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:20.588531399 +0000 UTC m=+578.560674287" watchObservedRunningTime="2026-07-29 08:57:20.589618381 +0000 UTC m=+578.561761256"
Jul 29 08:57:31.563490 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.563458    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 08:57:31.563919 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.563550    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:31.626813 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.626780    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:31.627264 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.627207    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-78dc94c995-bqjqw" podUID="89f7d855-4de0-4c25-9b87-372bb8a1adff" containerName="manager" containerID="cri-o://120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81" gracePeriod=30
Jul 29 08:57:31.872088 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.872060    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:31.963098 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.963066    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbbhl\" (UniqueName: \"kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl\") pod \"89f7d855-4de0-4c25-9b87-372bb8a1adff\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") "
Jul 29 08:57:31.963273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.963187    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert\") pod \"89f7d855-4de0-4c25-9b87-372bb8a1adff\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") "
Jul 29 08:57:31.965244 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.965217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "89f7d855-4de0-4c25-9b87-372bb8a1adff" (UID: "89f7d855-4de0-4c25-9b87-372bb8a1adff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:57:31.965363 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:31.965311    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl" (OuterVolumeSpecName: "kube-api-access-fbbhl") pod "89f7d855-4de0-4c25-9b87-372bb8a1adff" (UID: "89f7d855-4de0-4c25-9b87-372bb8a1adff"). InnerVolumeSpecName "kube-api-access-fbbhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:57:32.064121 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.064090    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs\") pod \"89f7d855-4de0-4c25-9b87-372bb8a1adff\" (UID: \"89f7d855-4de0-4c25-9b87-372bb8a1adff\") "
Jul 29 08:57:32.064291 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.064280    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-webhook-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:57:32.064454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.064294    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbbhl\" (UniqueName: \"kubernetes.io/projected/89f7d855-4de0-4c25-9b87-372bb8a1adff-kube-api-access-fbbhl\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:57:32.066111 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.066089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "89f7d855-4de0-4c25-9b87-372bb8a1adff" (UID: "89f7d855-4de0-4c25-9b87-372bb8a1adff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:57:32.164733 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.164658    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f7d855-4de0-4c25-9b87-372bb8a1adff-metrics-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 08:57:32.621845 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.621810    2573 generic.go:356] "Generic (PLEG): container finished" podID="89f7d855-4de0-4c25-9b87-372bb8a1adff" containerID="120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81" exitCode=0
Jul 29 08:57:32.622279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.621857    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78dc94c995-bqjqw"
Jul 29 08:57:32.622279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.621913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78dc94c995-bqjqw" event={"ID":"89f7d855-4de0-4c25-9b87-372bb8a1adff","Type":"ContainerDied","Data":"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"}
Jul 29 08:57:32.622279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.621971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78dc94c995-bqjqw" event={"ID":"89f7d855-4de0-4c25-9b87-372bb8a1adff","Type":"ContainerDied","Data":"91540e3e143103fcf02f0464ca11a4d957c276402f5d69bceb5fba0e44ebcd3e"}
Jul 29 08:57:32.622279 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.621995    2573 scope.go:117] "RemoveContainer" containerID="120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"
Jul 29 08:57:32.631733 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.631577    2573 scope.go:117] "RemoveContainer" containerID="120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"
Jul 29 08:57:32.631848 ip-10-0-133-190 kubenswrapper[2573]: E0729 08:57:32.631829    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81\": container with ID starting with 120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81 not found: ID does not exist" containerID="120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"
Jul 29 08:57:32.631905 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.631856    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81"} err="failed to get container status \"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81\": rpc error: code = NotFound desc = could not find container \"120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81\": container with ID starting with 120cf1553ddea23a70e3bf43fa4756541dd0d6084e8a2a2e4327eff6f9546e81 not found: ID does not exist"
Jul 29 08:57:32.647385 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.647364    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:32.647530 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:32.647393    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78dc94c995-bqjqw"]
Jul 29 08:57:34.644124 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:34.644092    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89f7d855-4de0-4c25-9b87-372bb8a1adff" path="/var/lib/kubelet/pods/89f7d855-4de0-4c25-9b87-372bb8a1adff/volumes"
Jul 29 08:57:42.496252 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:42.496221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:57:42.504367 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:42.504345    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 08:57:54.564803 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.564770    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"]
Jul 29 08:57:54.570115 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.565196    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89f7d855-4de0-4c25-9b87-372bb8a1adff" containerName="manager"
Jul 29 08:57:54.570115 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.565208    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="89f7d855-4de0-4c25-9b87-372bb8a1adff" containerName="manager"
Jul 29 08:57:54.570115 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.565272    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="89f7d855-4de0-4c25-9b87-372bb8a1adff" containerName="manager"
Jul 29 08:57:54.570416 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.570401    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.573197 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.573173    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 08:57:54.573494 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.573478    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 29 08:57:54.578362 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.578333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"]
Jul 29 08:57:54.672019 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.671985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-openshift-service-ca\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.672161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.672041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-maas-api-tls\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.672161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.672131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd24d\" (UniqueName: \"kubernetes.io/projected/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-kube-api-access-jd24d\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.773054 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.773020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-openshift-service-ca\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.773225 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.773077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-maas-api-tls\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.773225 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.773154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd24d\" (UniqueName: \"kubernetes.io/projected/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-kube-api-access-jd24d\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.773698 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.773677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-openshift-service-ca\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.775588 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.775568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-maas-api-tls\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.789520 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.789495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd24d\" (UniqueName: \"kubernetes.io/projected/7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d-kube-api-access-jd24d\") pod \"maas-api-84c7dbbd44-spd7j\" (UID: \"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d\") " pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:54.882940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:54.882918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:55.047228 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.047202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"]
Jul 29 08:57:55.048607 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:55.048585    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe3cdde_ce75_4e6c_ad5d_7487dac7cf0d.slice/crio-f47212fbc832e549409a567e29744f23a38e92e01af30b5401701e189e3febbf WatchSource:0}: Error finding container f47212fbc832e549409a567e29744f23a38e92e01af30b5401701e189e3febbf: Status 404 returned error can't find the container with id f47212fbc832e549409a567e29744f23a38e92e01af30b5401701e189e3febbf
Jul 29 08:57:55.050011 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.049966    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:57:55.105516 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.105488    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-g5bbx"]
Jul 29 08:57:55.110139 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.110118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.112140 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.112121    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 08:57:55.112565 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.112542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j654q\""
Jul 29 08:57:55.119023 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.118864    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-g5bbx"]
Jul 29 08:57:55.154683 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.154604    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"]
Jul 29 08:57:55.158095 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.158079    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.170374 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.170348    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"]
Jul 29 08:57:55.178024 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.177993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2695ccb5-8e36-4468-ae15-d2a0c96427a8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.178175 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.178043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9jc9\" (UniqueName: \"kubernetes.io/projected/2695ccb5-8e36-4468-ae15-d2a0c96427a8-kube-api-access-g9jc9\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.279695 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.279652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2695ccb5-8e36-4468-ae15-d2a0c96427a8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.279852 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.279708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9jc9\" (UniqueName: \"kubernetes.io/projected/2695ccb5-8e36-4468-ae15-d2a0c96427a8-kube-api-access-g9jc9\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.279926 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.279857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xx8\" (UniqueName: \"kubernetes.io/projected/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-kube-api-access-j4xx8\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.279926 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.279921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.280450 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.280428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2695ccb5-8e36-4468-ae15-d2a0c96427a8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.290577 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.290551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9jc9\" (UniqueName: \"kubernetes.io/projected/2695ccb5-8e36-4468-ae15-d2a0c96427a8-kube-api-access-g9jc9\") pod \"payload-processing-5cc6cd444b-g5bbx\" (UID: \"2695ccb5-8e36-4468-ae15-d2a0c96427a8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.380809 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.380774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xx8\" (UniqueName: \"kubernetes.io/projected/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-kube-api-access-j4xx8\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.381008 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.380817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.381617 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.381594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.388062 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.388032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xx8\" (UniqueName: \"kubernetes.io/projected/1dc48f10-8634-452b-b3c5-b05ddd3d5cbb-kube-api-access-j4xx8\") pod \"payload-pre-processing-687dbb6cf6-6bpz9\" (UID: \"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.423806 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.423733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:55.469260 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.469226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:55.575513 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.575483    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-g5bbx"]
Jul 29 08:57:55.577028 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:55.577000    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2695ccb5_8e36_4468_ae15_d2a0c96427a8.slice/crio-c590bbe500a536db2d2af7459c1480b1354c23479449f2a61afe568981dc74cf WatchSource:0}: Error finding container c590bbe500a536db2d2af7459c1480b1354c23479449f2a61afe568981dc74cf: Status 404 returned error can't find the container with id c590bbe500a536db2d2af7459c1480b1354c23479449f2a61afe568981dc74cf
Jul 29 08:57:55.628114 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.628089    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"]
Jul 29 08:57:55.630417 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:57:55.630383    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc48f10_8634_452b_b3c5_b05ddd3d5cbb.slice/crio-06a1583d1d6bde20e9836e1306d08091e5d6cea4c196c6b1f253c2f6cc6f67c8 WatchSource:0}: Error finding container 06a1583d1d6bde20e9836e1306d08091e5d6cea4c196c6b1f253c2f6cc6f67c8: Status 404 returned error can't find the container with id 06a1583d1d6bde20e9836e1306d08091e5d6cea4c196c6b1f253c2f6cc6f67c8
Jul 29 08:57:55.789126 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.789041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9" event={"ID":"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb","Type":"ContainerStarted","Data":"06a1583d1d6bde20e9836e1306d08091e5d6cea4c196c6b1f253c2f6cc6f67c8"}
Jul 29 08:57:55.790852 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.790788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j" event={"ID":"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d","Type":"ContainerStarted","Data":"f47212fbc832e549409a567e29744f23a38e92e01af30b5401701e189e3febbf"}
Jul 29 08:57:55.792822 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:55.792796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx" event={"ID":"2695ccb5-8e36-4468-ae15-d2a0c96427a8","Type":"ContainerStarted","Data":"c590bbe500a536db2d2af7459c1480b1354c23479449f2a61afe568981dc74cf"}
Jul 29 08:57:58.817167 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.817125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j" event={"ID":"7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d","Type":"ContainerStarted","Data":"9ea664297e89d0db7524fc4e7d8b7ada8e0d1ba220a5497371493caefa0fd556"}
Jul 29 08:57:58.817671 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.817195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:57:58.818759 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.818736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx" event={"ID":"2695ccb5-8e36-4468-ae15-d2a0c96427a8","Type":"ContainerStarted","Data":"546b3ff4e1ea6ff032f56b37b454d0ab6b702bf3fe62365fdf211cef7f171e47"}
Jul 29 08:57:58.818920 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.818788    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:57:58.820264 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.820242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9" event={"ID":"1dc48f10-8634-452b-b3c5-b05ddd3d5cbb","Type":"ContainerStarted","Data":"09d59836bc89f4d29fef870d0a9df5a2ea9e4e3db3ccb560f0a9c3cba4b20e10"}
Jul 29 08:57:58.820353 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.820284    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:57:58.834592 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.834542    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j" podStartSLOduration=1.998473844 podStartE2EDuration="4.834528509s" totalImagesPullingTime="2.836054665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:58.832928162 +0000 UTC m=+616.805071033" watchObservedRunningTime="2026-07-29 08:57:58.834528509 +0000 UTC m=+616.806671441"
Jul 29 08:57:58.848151 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.848105    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx" podStartSLOduration=1.479781387 podStartE2EDuration="3.848089472s" totalImagesPullingTime="2.368308085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:58.846517601 +0000 UTC m=+616.818660476" watchObservedRunningTime="2026-07-29 08:57:58.848089472 +0000 UTC m=+616.820232347"
Jul 29 08:57:58.861614 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:57:58.861550    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9" podStartSLOduration=1.539838979 podStartE2EDuration="3.861528661s" totalImagesPullingTime="2.321689682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:57:58.860005352 +0000 UTC m=+616.832148232" watchObservedRunningTime="2026-07-29 08:57:58.861528661 +0000 UTC m=+616.833671539"
Jul 29 08:58:02.846019 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.845984    2573 generic.go:356] "Generic (PLEG): container finished" podID="45bd778b-da1b-451a-8d60-f66d883aadcf" containerID="17d4485898a4800b7f8e7d57202890ae79f901abacdca98a33a2ba7c5725089f" exitCode=0
Jul 29 08:58:02.846436 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.846034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" event={"ID":"45bd778b-da1b-451a-8d60-f66d883aadcf","Type":"ContainerDied","Data":"17d4485898a4800b7f8e7d57202890ae79f901abacdca98a33a2ba7c5725089f"}
Jul 29 08:58:02.846483 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.846433    2573 scope.go:117] "RemoveContainer" containerID="17d4485898a4800b7f8e7d57202890ae79f901abacdca98a33a2ba7c5725089f"
Jul 29 08:58:02.847473 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.847442    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:58:02.847578 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.847529    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:58:02.847641 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:02.847585    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 08:58:03.853212 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:03.853173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" event={"ID":"45bd778b-da1b-451a-8d60-f66d883aadcf","Type":"ContainerStarted","Data":"c740018b786e46102d7731d9f6593e5faf4c92ce9137cb82cda6f22e0ef0e61d"}
Jul 29 08:58:04.447389 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:04.447348    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:58:04.448465 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:04.448434    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lqjvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 08:58:04.448593 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:04.448489    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" podUID="45bd778b-da1b-451a-8d60-f66d883aadcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 08:58:04.831617 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:04.831510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84c7dbbd44-spd7j"
Jul 29 08:58:05.447410 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:05.447374    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lqjvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 08:58:05.447825 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:05.447428    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" podUID="45bd778b-da1b-451a-8d60-f66d883aadcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 08:58:06.189585 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:06.189538    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:58:06.448189 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:06.448099    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lqjvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 08:58:06.448189 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:06.448166    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" podUID="45bd778b-da1b-451a-8d60-f66d883aadcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 08:58:07.448409 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:07.448361    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lqjvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 29 08:58:07.448884 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:07.448429    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs" podUID="45bd778b-da1b-451a-8d60-f66d883aadcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 29 08:58:08.451819 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:08.451784    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:58:08.453011 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:08.452986    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs"
Jul 29 08:58:09.828860 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:09.828823    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9"
Jul 29 08:58:09.829338 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:09.829169    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-g5bbx"
Jul 29 08:58:30.407598 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.407558    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"]
Jul 29 08:58:30.415102 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.415075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.418090 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.418065    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 08:58:30.418090 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.418075    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 08:58:30.418273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.418080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-27jj4\""
Jul 29 08:58:30.418273 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.418109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 08:58:30.422692 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.422668    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"]
Jul 29 08:58:30.506681 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3c42269-67fb-4bd6-99db-6dd56779b097-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.506681 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.506940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.506940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqrht\" (UniqueName: \"kubernetes.io/projected/d3c42269-67fb-4bd6-99db-6dd56779b097-kube-api-access-bqrht\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.506940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.506940 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.506921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608454 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3c42269-67fb-4bd6-99db-6dd56779b097-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqrht\" (UniqueName: \"kubernetes.io/projected/d3c42269-67fb-4bd6-99db-6dd56779b097-kube-api-access-bqrht\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608640 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.608938 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608875    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.609020 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.608998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.609119 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.609102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.610985 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.610964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3c42269-67fb-4bd6-99db-6dd56779b097-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.611161 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.611145    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3c42269-67fb-4bd6-99db-6dd56779b097-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.616328 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.616307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqrht\" (UniqueName: \"kubernetes.io/projected/d3c42269-67fb-4bd6-99db-6dd56779b097-kube-api-access-bqrht\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl\" (UID: \"d3c42269-67fb-4bd6-99db-6dd56779b097\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.730026 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.729933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:30.869559 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:30.869533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"]
Jul 29 08:58:30.871396 ip-10-0-133-190 kubenswrapper[2573]: W0729 08:58:30.871356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c42269_67fb_4bd6_99db_6dd56779b097.slice/crio-bcef7c9f41d7d3ee8e35fedb7782fcbf2b5621b8b307aa78591e52b05bf024ac WatchSource:0}: Error finding container bcef7c9f41d7d3ee8e35fedb7782fcbf2b5621b8b307aa78591e52b05bf024ac: Status 404 returned error can't find the container with id bcef7c9f41d7d3ee8e35fedb7782fcbf2b5621b8b307aa78591e52b05bf024ac
Jul 29 08:58:31.015699 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:31.015617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl" event={"ID":"d3c42269-67fb-4bd6-99db-6dd56779b097","Type":"ContainerStarted","Data":"bcef7c9f41d7d3ee8e35fedb7782fcbf2b5621b8b307aa78591e52b05bf024ac"}
Jul 29 08:58:33.029521 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:33.029478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl" event={"ID":"d3c42269-67fb-4bd6-99db-6dd56779b097","Type":"ContainerStarted","Data":"16cca92ab033e563cfcb14acc039e39559bebe0dff6598e6db377bd442b97898"}
Jul 29 08:58:33.046221 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:33.046168    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl" podStartSLOduration=1.886837324 podStartE2EDuration="3.046151764s" totalImagesPullingTime="1.15931444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:58:33.04530626 +0000 UTC m=+651.017449137" watchObservedRunningTime="2026-07-29 08:58:33.046151764 +0000 UTC m=+651.018294638"
Jul 29 08:58:40.730862 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:40.730828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:40.731250 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:40.730907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:40.743566 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:40.743533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 08:58:41.087614 ip-10-0-133-190 kubenswrapper[2573]: I0729 08:58:41.087589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl"
Jul 29 09:00:00.140597 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.140517    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"]
Jul 29 09:00:00.144289 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.144270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"
Jul 29 09:00:00.146438 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.146416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:00:00.155936 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.155594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"]
Jul 29 09:00:00.157361 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.157173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"
Jul 29 09:00:00.502183 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.502153    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"]
Jul 29 09:00:00.503839 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:00:00.503802    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda067c614_886c_43de_8204_df96f9407736.slice/crio-39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd WatchSource:0}: Error finding container 39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd: Status 404 returned error can't find the container with id 39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd
Jul 29 09:00:00.537352 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:00.537313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r" event={"ID":"a067c614-886c-43de-8204-df96f9407736","Type":"ContainerStarted","Data":"39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd"}
Jul 29 09:00:03.557963 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:03.557921    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r" event={"ID":"a067c614-886c-43de-8204-df96f9407736","Type":"ContainerStarted","Data":"441209210a4a288687ac61f1d9087df95daac40e535d89b1ff9261ad7a0812ca"}
Jul 29 09:00:03.574329 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:03.574273    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r" podStartSLOduration=0.879580292 podStartE2EDuration="3.574257218s" totalImagesPullingTime="2.694676926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:00:03.572433185 +0000 UTC m=+741.544576061" watchObservedRunningTime="2026-07-29 09:00:03.574257218 +0000 UTC m=+741.546400092"
Jul 29 09:00:04.564933 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:04.564884    2573 generic.go:356] "Generic (PLEG): container finished" podID="a067c614-886c-43de-8204-df96f9407736" containerID="441209210a4a288687ac61f1d9087df95daac40e535d89b1ff9261ad7a0812ca" exitCode=0
Jul 29 09:00:04.565390 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:04.564945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r" event={"ID":"a067c614-886c-43de-8204-df96f9407736","Type":"ContainerDied","Data":"441209210a4a288687ac61f1d9087df95daac40e535d89b1ff9261ad7a0812ca"}
Jul 29 09:00:05.710788 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:05.710758    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"
Jul 29 09:00:06.584851 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:06.584809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r" event={"ID":"a067c614-886c-43de-8204-df96f9407736","Type":"ContainerDied","Data":"39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd"}
Jul 29 09:00:06.584851 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:06.584839    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"
Jul 29 09:00:06.585119 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:06.584919    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39cbcb3fdab7168ce1abc11f5680d1d1ebb3f52a7841cb10c2154bb1524dfbfd"
Jul 29 09:00:35.848974 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:35.848930    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 09:00:35.849574 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:35.849196    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" podUID="4c77e77f-471c-4325-abe9-a6a82a713831" containerName="authorino" containerID="cri-o://861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd" gracePeriod=30
Jul 29 09:00:36.117245 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.117220    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 09:00:36.261985 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.261943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert\") pod \"4c77e77f-471c-4325-abe9-a6a82a713831\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") "
Jul 29 09:00:36.262157 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.262004    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfhn8\" (UniqueName: \"kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8\") pod \"4c77e77f-471c-4325-abe9-a6a82a713831\" (UID: \"4c77e77f-471c-4325-abe9-a6a82a713831\") "
Jul 29 09:00:36.264059 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.264026    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8" (OuterVolumeSpecName: "kube-api-access-dfhn8") pod "4c77e77f-471c-4325-abe9-a6a82a713831" (UID: "4c77e77f-471c-4325-abe9-a6a82a713831"). InnerVolumeSpecName "kube-api-access-dfhn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:00:36.273236 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.273205    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4c77e77f-471c-4325-abe9-a6a82a713831" (UID: "4c77e77f-471c-4325-abe9-a6a82a713831"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:00:36.362966 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.362855    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c77e77f-471c-4325-abe9-a6a82a713831-tls-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:00:36.362966 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.362887    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfhn8\" (UniqueName: \"kubernetes.io/projected/4c77e77f-471c-4325-abe9-a6a82a713831-kube-api-access-dfhn8\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:00:36.752202 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.752161    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c77e77f-471c-4325-abe9-a6a82a713831" containerID="861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd" exitCode=0
Jul 29 09:00:36.752202 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.752205    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645fdb8cd6-kjt89"
Jul 29 09:00:36.752419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.752232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" event={"ID":"4c77e77f-471c-4325-abe9-a6a82a713831","Type":"ContainerDied","Data":"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"}
Jul 29 09:00:36.752419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.752271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645fdb8cd6-kjt89" event={"ID":"4c77e77f-471c-4325-abe9-a6a82a713831","Type":"ContainerDied","Data":"b7ea56da285408de6fc126ebad9d6db08878dc335dca40df230a74f2bd507caa"}
Jul 29 09:00:36.752419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.752293    2573 scope.go:117] "RemoveContainer" containerID="861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"
Jul 29 09:00:36.761637 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.761617    2573 scope.go:117] "RemoveContainer" containerID="861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"
Jul 29 09:00:36.761916 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:00:36.761874    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd\": container with ID starting with 861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd not found: ID does not exist" containerID="861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"
Jul 29 09:00:36.761982 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.761920    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd"} err="failed to get container status \"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd\": rpc error: code = NotFound desc = could not find container \"861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd\": container with ID starting with 861923f7b1cde42e7909150ce1b3abe321fa47f141a4a2052181cc2f8f38afdd not found: ID does not exist"
Jul 29 09:00:36.768400 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.768378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 09:00:36.772408 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:36.772380    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-645fdb8cd6-kjt89"]
Jul 29 09:00:38.646241 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:00:38.646204    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c77e77f-471c-4325-abe9-a6a82a713831" path="/var/lib/kubelet/pods/4c77e77f-471c-4325-abe9-a6a82a713831/volumes"
Jul 29 09:01:22.366547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.366506    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 09:01:22.367151 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.366752    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" podUID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" containerName="manager" containerID="cri-o://48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd" gracePeriod=30
Jul 29 09:01:22.630304 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.630277    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 09:01:22.701461 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.701430    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lspm7\" (UniqueName: \"kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7\") pod \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") "
Jul 29 09:01:22.701461 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.701466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert\") pod \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") "
Jul 29 09:01:22.701660 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.701496    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs\") pod \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\" (UID: \"e55581bb-2fde-4fa2-bbd1-3b53ed820e65\") "
Jul 29 09:01:22.703548 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.703513    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e55581bb-2fde-4fa2-bbd1-3b53ed820e65" (UID: "e55581bb-2fde-4fa2-bbd1-3b53ed820e65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:01:22.703675 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.703586    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7" (OuterVolumeSpecName: "kube-api-access-lspm7") pod "e55581bb-2fde-4fa2-bbd1-3b53ed820e65" (UID: "e55581bb-2fde-4fa2-bbd1-3b53ed820e65"). InnerVolumeSpecName "kube-api-access-lspm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:01:22.703675 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.703579    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e55581bb-2fde-4fa2-bbd1-3b53ed820e65" (UID: "e55581bb-2fde-4fa2-bbd1-3b53ed820e65"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:01:22.803176 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.803087    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lspm7\" (UniqueName: \"kubernetes.io/projected/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-kube-api-access-lspm7\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:01:22.803176 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.803115    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-webhook-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:01:22.803176 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:22.803124    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e55581bb-2fde-4fa2-bbd1-3b53ed820e65-metrics-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:01:23.005850 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.005815    2573 generic.go:356] "Generic (PLEG): container finished" podID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" containerID="48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd" exitCode=0
Jul 29 09:01:23.006037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.005857    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-sdb9x"
Jul 29 09:01:23.006037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.005907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" event={"ID":"e55581bb-2fde-4fa2-bbd1-3b53ed820e65","Type":"ContainerDied","Data":"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"}
Jul 29 09:01:23.006037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.005958    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-sdb9x" event={"ID":"e55581bb-2fde-4fa2-bbd1-3b53ed820e65","Type":"ContainerDied","Data":"8055bc93172dc476dbdb3309f2e4cb07fc9837e1d7188455a540a4be6ad87c9f"}
Jul 29 09:01:23.006037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.005981    2573 scope.go:117] "RemoveContainer" containerID="48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"
Jul 29 09:01:23.015595 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.015578    2573 scope.go:117] "RemoveContainer" containerID="48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"
Jul 29 09:01:23.015855 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:01:23.015837    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd\": container with ID starting with 48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd not found: ID does not exist" containerID="48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"
Jul 29 09:01:23.015925 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.015864    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd"} err="failed to get container status \"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd\": rpc error: code = NotFound desc = could not find container \"48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd\": container with ID starting with 48a5f3cb286be43a52c8bfd415cfe740a2072609508c9f5f974d842ffbc012cd not found: ID does not exist"
Jul 29 09:01:23.027744 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.027723    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 09:01:23.031479 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:23.031460    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-sdb9x"]
Jul 29 09:01:24.651864 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:01:24.651821    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" path="/var/lib/kubelet/pods/e55581bb-2fde-4fa2-bbd1-3b53ed820e65/volumes"
Jul 29 09:02:23.804302 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804266    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:23.804783 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804758    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c77e77f-471c-4325-abe9-a6a82a713831" containerName="authorino"
Jul 29 09:02:23.804839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804784    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c77e77f-471c-4325-abe9-a6a82a713831" containerName="authorino"
Jul 29 09:02:23.804839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804792    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a067c614-886c-43de-8204-df96f9407736" containerName="cleanup"
Jul 29 09:02:23.804839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804797    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a067c614-886c-43de-8204-df96f9407736" containerName="cleanup"
Jul 29 09:02:23.804839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804815    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" containerName="manager"
Jul 29 09:02:23.804839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804820    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" containerName="manager"
Jul 29 09:02:23.805047 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804880    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a067c614-886c-43de-8204-df96f9407736" containerName="cleanup"
Jul 29 09:02:23.805047 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804887    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c77e77f-471c-4325-abe9-a6a82a713831" containerName="authorino"
Jul 29 09:02:23.805047 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.804905    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e55581bb-2fde-4fa2-bbd1-3b53ed820e65" containerName="manager"
Jul 29 09:02:23.808187 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.808172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.810307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.810281    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 09:02:23.810419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.810305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 09:02:23.811135 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.811118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qtgm\""
Jul 29 09:02:23.811232 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.811214    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 29 09:02:23.816246 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.816158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:23.856148 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.856110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7fj\" (UniqueName: \"kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.856323 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.856162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.856323 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.856201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.957274 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.957230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.957274 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.957283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.957531 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.957356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7fj\" (UniqueName: \"kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.959869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.959848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.959991 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.959881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:23.965585 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:23.965555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7fj\" (UniqueName: \"kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj\") pod \"maas-controller-95cc89ddf-r9ktn\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") " pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:24.119856 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:24.119824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:24.261182 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:24.261152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:24.262754 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:02:24.262727    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7d6458_cbf6_48d2_9415_7550580d1382.slice/crio-1205eaf1169b045e30dea7c5f3dddeb4f815bebde761b3417e96b60b706d2b3a WatchSource:0}: Error finding container 1205eaf1169b045e30dea7c5f3dddeb4f815bebde761b3417e96b60b706d2b3a: Status 404 returned error can't find the container with id 1205eaf1169b045e30dea7c5f3dddeb4f815bebde761b3417e96b60b706d2b3a
Jul 29 09:02:24.347831 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:24.347799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" event={"ID":"3f7d6458-cbf6-48d2-9415-7550580d1382","Type":"ContainerStarted","Data":"1205eaf1169b045e30dea7c5f3dddeb4f815bebde761b3417e96b60b706d2b3a"}
Jul 29 09:02:25.354963 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:25.354926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" event={"ID":"3f7d6458-cbf6-48d2-9415-7550580d1382","Type":"ContainerStarted","Data":"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"}
Jul 29 09:02:25.355519 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:25.355062    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:25.371045 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:25.370994    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" podStartSLOduration=1.90283721 podStartE2EDuration="2.370979574s" totalImagesPullingTime="468.142364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:02:25.370354253 +0000 UTC m=+883.342497127" watchObservedRunningTime="2026-07-29 09:02:25.370979574 +0000 UTC m=+883.343122480"
Jul 29 09:02:36.363240 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:36.363164    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:40.991538 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:40.991496    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:40.992228 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:40.991744    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" podUID="3f7d6458-cbf6-48d2-9415-7550580d1382" containerName="manager" containerID="cri-o://6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95" gracePeriod=30
Jul 29 09:02:41.253227 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.253157    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:41.331185 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.331150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs\") pod \"3f7d6458-cbf6-48d2-9415-7550580d1382\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") "
Jul 29 09:02:41.331378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.331249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp7fj\" (UniqueName: \"kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj\") pod \"3f7d6458-cbf6-48d2-9415-7550580d1382\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") "
Jul 29 09:02:41.331378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.331285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert\") pod \"3f7d6458-cbf6-48d2-9415-7550580d1382\" (UID: \"3f7d6458-cbf6-48d2-9415-7550580d1382\") "
Jul 29 09:02:41.333330 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.333301    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj" (OuterVolumeSpecName: "kube-api-access-wp7fj") pod "3f7d6458-cbf6-48d2-9415-7550580d1382" (UID: "3f7d6458-cbf6-48d2-9415-7550580d1382"). InnerVolumeSpecName "kube-api-access-wp7fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:02:41.333446 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.333327    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3f7d6458-cbf6-48d2-9415-7550580d1382" (UID: "3f7d6458-cbf6-48d2-9415-7550580d1382"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:02:41.333446 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.333341    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3f7d6458-cbf6-48d2-9415-7550580d1382" (UID: "3f7d6458-cbf6-48d2-9415-7550580d1382"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:02:41.432252 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.432215    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-metrics-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:02:41.432252 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.432246    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp7fj\" (UniqueName: \"kubernetes.io/projected/3f7d6458-cbf6-48d2-9415-7550580d1382-kube-api-access-wp7fj\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:02:41.432461 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.432258    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7d6458-cbf6-48d2-9415-7550580d1382-webhook-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:02:41.448091 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.448064    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f7d6458-cbf6-48d2-9415-7550580d1382" containerID="6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95" exitCode=0
Jul 29 09:02:41.448232 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.448106    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-r9ktn"
Jul 29 09:02:41.448232 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.448158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" event={"ID":"3f7d6458-cbf6-48d2-9415-7550580d1382","Type":"ContainerDied","Data":"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"}
Jul 29 09:02:41.448232 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.448207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-r9ktn" event={"ID":"3f7d6458-cbf6-48d2-9415-7550580d1382","Type":"ContainerDied","Data":"1205eaf1169b045e30dea7c5f3dddeb4f815bebde761b3417e96b60b706d2b3a"}
Jul 29 09:02:41.448346 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.448235    2573 scope.go:117] "RemoveContainer" containerID="6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"
Jul 29 09:02:41.457804 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.457789    2573 scope.go:117] "RemoveContainer" containerID="6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"
Jul 29 09:02:41.458109 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:02:41.458088    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95\": container with ID starting with 6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95 not found: ID does not exist" containerID="6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"
Jul 29 09:02:41.458203 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.458115    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95"} err="failed to get container status \"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95\": rpc error: code = NotFound desc = could not find container \"6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95\": container with ID starting with 6099467c80c4f667aa4015ed17f5ed396ec6979a4a9b516c8e435a7909f28b95 not found: ID does not exist"
Jul 29 09:02:41.468738 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.468717    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:41.473056 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:41.473036    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-r9ktn"]
Jul 29 09:02:42.249169 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.249134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95cc89ddf-7hzfk"]
Jul 29 09:02:42.249636 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.249622    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7d6458-cbf6-48d2-9415-7550580d1382" containerName="manager"
Jul 29 09:02:42.249681 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.249638    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7d6458-cbf6-48d2-9415-7550580d1382" containerName="manager"
Jul 29 09:02:42.249717 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.249699    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7d6458-cbf6-48d2-9415-7550580d1382" containerName="manager"
Jul 29 09:02:42.254051 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.254031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.256643 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.256618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 09:02:42.256643 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.256632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 09:02:42.256643 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.256645    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qtgm\""
Jul 29 09:02:42.257028 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.256631    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 29 09:02:42.261652 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.261630    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-7hzfk"]
Jul 29 09:02:42.339960 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.339918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrtw\" (UniqueName: \"kubernetes.io/projected/ff3d63b7-84bd-4a02-afe7-e4ca63120277-kube-api-access-dkrtw\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.340129 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.339967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-webhook-cert\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.340129 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.340023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-metrics-certs\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.441063 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.441022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrtw\" (UniqueName: \"kubernetes.io/projected/ff3d63b7-84bd-4a02-afe7-e4ca63120277-kube-api-access-dkrtw\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.441063 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.441065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-webhook-cert\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.441328 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.441089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-metrics-certs\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.443070 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.443047    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 09:02:42.443135 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.443120    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Jul 29 09:02:42.449574 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.449548    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrtw\" (UniqueName: \"kubernetes.io/projected/ff3d63b7-84bd-4a02-afe7-e4ca63120277-kube-api-access-dkrtw\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.454039 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.454013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-metrics-certs\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.454159 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.454074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3d63b7-84bd-4a02-afe7-e4ca63120277-webhook-cert\") pod \"maas-controller-95cc89ddf-7hzfk\" (UID: \"ff3d63b7-84bd-4a02-afe7-e4ca63120277\") " pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.534782 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.534705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:02:42.538257 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.538234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:02:42.568974 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.568948    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qtgm\""
Jul 29 09:02:42.577499 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.577478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:42.647653 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.647623    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7d6458-cbf6-48d2-9415-7550580d1382" path="/var/lib/kubelet/pods/3f7d6458-cbf6-48d2-9415-7550580d1382/volumes"
Jul 29 09:02:42.714168 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:42.714139    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95cc89ddf-7hzfk"]
Jul 29 09:02:42.714965 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:02:42.714940    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3d63b7_84bd_4a02_afe7_e4ca63120277.slice/crio-33fcd7c302b3fbda3683ffc7aaeda81aaff5f483a8f8d37ad6ff8d76a24a2cd5 WatchSource:0}: Error finding container 33fcd7c302b3fbda3683ffc7aaeda81aaff5f483a8f8d37ad6ff8d76a24a2cd5: Status 404 returned error can't find the container with id 33fcd7c302b3fbda3683ffc7aaeda81aaff5f483a8f8d37ad6ff8d76a24a2cd5
Jul 29 09:02:43.462437 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:43.462401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-7hzfk" event={"ID":"ff3d63b7-84bd-4a02-afe7-e4ca63120277","Type":"ContainerStarted","Data":"33fcd7c302b3fbda3683ffc7aaeda81aaff5f483a8f8d37ad6ff8d76a24a2cd5"}
Jul 29 09:02:43.624297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:43.624274    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 09:02:44.474816 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:44.474780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95cc89ddf-7hzfk" event={"ID":"ff3d63b7-84bd-4a02-afe7-e4ca63120277","Type":"ContainerStarted","Data":"144c88e2b894948d75df8e230c9e8bf14c0bed508a625b70f3f36e5e14731257"}
Jul 29 09:02:44.475404 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:44.475378    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:02:44.492829 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:44.492782    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95cc89ddf-7hzfk" podStartSLOduration=1.587184508 podStartE2EDuration="2.492767982s" totalImagesPullingTime="905.583474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:02:44.489920997 +0000 UTC m=+902.462063871" watchObservedRunningTime="2026-07-29 09:02:44.492767982 +0000 UTC m=+902.464910873"
Jul 29 09:02:55.483235 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:02:55.483201    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95cc89ddf-7hzfk"
Jul 29 09:07:42.574967 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:07:42.574937    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:07:42.575468 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:07:42.575062    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:08:56.100062 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.099983    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"]
Jul 29 09:08:56.103481 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.103464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.105971 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.105949    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsh69\""
Jul 29 09:08:56.115206 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.115183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"]
Jul 29 09:08:56.205583 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.205547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w2tx\" (UniqueName: \"kubernetes.io/projected/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-kube-api-access-8w2tx\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.205758 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.205633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.307152 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.307118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w2tx\" (UniqueName: \"kubernetes.io/projected/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-kube-api-access-8w2tx\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.307309 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.307263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.307667 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.307647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.315393 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.315366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w2tx\" (UniqueName: \"kubernetes.io/projected/3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26-kube-api-access-8w2tx\") pod \"kuadrant-operator-controller-manager-86878c769f-5jrg6\" (UID: \"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.414047 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.413971    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:56.581281 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:56.581250    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"]
Jul 29 09:08:56.582956 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:08:56.582928    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db3f5f5_d8f6_4284_a676_cf3b7e3a7f26.slice/crio-a41ee5cad01885941bf3cba4e0403f3f6351be49096a163b0c6506e0a8273731 WatchSource:0}: Error finding container a41ee5cad01885941bf3cba4e0403f3f6351be49096a163b0c6506e0a8273731: Status 404 returned error can't find the container with id a41ee5cad01885941bf3cba4e0403f3f6351be49096a163b0c6506e0a8273731
Jul 29 09:08:57.537744 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:57.537701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6" event={"ID":"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26","Type":"ContainerStarted","Data":"cd70fb09c8bdeaedf51b92ffdb6a59600961d74e9616885353aac9c395bcf0ff"}
Jul 29 09:08:57.538224 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:57.537766    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:08:57.538224 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:57.537788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6" event={"ID":"3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26","Type":"ContainerStarted","Data":"a41ee5cad01885941bf3cba4e0403f3f6351be49096a163b0c6506e0a8273731"}
Jul 29 09:08:57.556717 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:08:57.556664    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6" podStartSLOduration=1.5566470049999999 podStartE2EDuration="1.556647005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:08:57.555041609 +0000 UTC m=+1275.527184484" watchObservedRunningTime="2026-07-29 09:08:57.556647005 +0000 UTC m=+1275.528789882"
Jul 29 09:09:08.545700 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:09:08.545612    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jrg6"
Jul 29 09:11:46.726216 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.726132    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:11:46.729735 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.729718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.731740 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.731719    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-3dafdacb-kserve-self-signed-certs\""
Jul 29 09:11:46.752455 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.752424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:11:46.895354 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.895354 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59fkh\" (UniqueName: \"kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.895648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.895648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.895648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.895648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.895606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59fkh\" (UniqueName: \"kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996729 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996729 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996729 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.996935 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.997037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.997037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.996989    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.998853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.998833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:46.999155 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:46.999136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:47.004450 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.004423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59fkh\" (UniqueName: \"kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh\") pod \"e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") " pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:47.039454 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.039411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:47.206443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.206407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:11:47.208049 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:11:47.208020    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab5c3bd9_96a1_4728_98c2_c02aaec7085a.slice/crio-aaa4e2dfb2ade9405d37723a226310cca14fdaba357011178529264d3a6dfc85 WatchSource:0}: Error finding container aaa4e2dfb2ade9405d37723a226310cca14fdaba357011178529264d3a6dfc85: Status 404 returned error can't find the container with id aaa4e2dfb2ade9405d37723a226310cca14fdaba357011178529264d3a6dfc85
Jul 29 09:11:47.513354 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.513265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" event={"ID":"ab5c3bd9-96a1-4728-98c2-c02aaec7085a","Type":"ContainerStarted","Data":"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"}
Jul 29 09:11:47.513354 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.513316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" event={"ID":"ab5c3bd9-96a1-4728-98c2-c02aaec7085a","Type":"ContainerStarted","Data":"aaa4e2dfb2ade9405d37723a226310cca14fdaba357011178529264d3a6dfc85"}
Jul 29 09:11:47.530443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:47.530386    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" podStartSLOduration=1.530368215 podStartE2EDuration="1.530368215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:11:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:11:47.527709664 +0000 UTC m=+1445.499852539" watchObservedRunningTime="2026-07-29 09:11:47.530368215 +0000 UTC m=+1445.502511089"
Jul 29 09:11:57.039691 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:57.039586    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:57.040102 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:57.039730    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:57.052610 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:57.052587    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:11:57.583422 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:11:57.583381    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:12:26.334104 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:26.334065    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:12:41.353839 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.353793    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" podUID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" containerName="main" containerID="cri-o://c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a" gracePeriod=45
Jul 29 09:12:41.621945 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.621920    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:12:41.711084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711044    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711086    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711339 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711112    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59fkh\" (UniqueName: \"kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711339 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711149    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711339 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711339 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711240    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs\") pod \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\" (UID: \"ab5c3bd9-96a1-4728-98c2-c02aaec7085a\") "
Jul 29 09:12:41.711510 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711383    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:12:41.711510 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711394    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home" (OuterVolumeSpecName: "home") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:12:41.711605 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711513    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:12:41.711659 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711648    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.711721 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711662    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.711721 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.711671    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.713528 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.713495    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm" (OuterVolumeSpecName: "dshm") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:12:41.713528 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.713504    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:12:41.713528 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.713519    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh" (OuterVolumeSpecName: "kube-api-access-59fkh") pod "ab5c3bd9-96a1-4728-98c2-c02aaec7085a" (UID: "ab5c3bd9-96a1-4728-98c2-c02aaec7085a"). InnerVolumeSpecName "kube-api-access-59fkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:12:41.812771 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.812728    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59fkh\" (UniqueName: \"kubernetes.io/projected/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-kube-api-access-59fkh\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.812771 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.812765    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.812771 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.812777    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5c3bd9-96a1-4728-98c2-c02aaec7085a-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:12:41.819964 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.819932    2573 generic.go:356] "Generic (PLEG): container finished" podID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" containerID="c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a" exitCode=0
Jul 29 09:12:41.820127 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.820015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"
Jul 29 09:12:41.820127 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.820060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" event={"ID":"ab5c3bd9-96a1-4728-98c2-c02aaec7085a","Type":"ContainerDied","Data":"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"}
Jul 29 09:12:41.820127 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.820103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5" event={"ID":"ab5c3bd9-96a1-4728-98c2-c02aaec7085a","Type":"ContainerDied","Data":"aaa4e2dfb2ade9405d37723a226310cca14fdaba357011178529264d3a6dfc85"}
Jul 29 09:12:41.820127 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.820122    2573 scope.go:117] "RemoveContainer" containerID="c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"
Jul 29 09:12:41.832471 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.832448    2573 scope.go:117] "RemoveContainer" containerID="c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"
Jul 29 09:12:41.832753 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:12:41.832730    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a\": container with ID starting with c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a not found: ID does not exist" containerID="c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"
Jul 29 09:12:41.832814 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.832762    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a"} err="failed to get container status \"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a\": rpc error: code = NotFound desc = could not find container \"c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a\": container with ID starting with c15f75e32f0872fbbff922d366f7d8d32cd29f4eb7d58d29dfda14a24989d43a not found: ID does not exist"
Jul 29 09:12:41.844042 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.844015    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:12:41.850118 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:41.850096    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-3dafdacb-kserve-b68f89f4c-2g6c5"]
Jul 29 09:12:42.610718 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:42.610690    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:12:42.612510 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:42.612487    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:12:42.647237 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:12:42.647205    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" path="/var/lib/kubelet/pods/ab5c3bd9-96a1-4728-98c2-c02aaec7085a/volumes"
Jul 29 09:16:16.932871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.932827    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:16.933502 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.933372    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" containerName="main"
Jul 29 09:16:16.933502 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.933387    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" containerName="main"
Jul 29 09:16:16.933502 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.933464    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab5c3bd9-96a1-4728-98c2-c02aaec7085a" containerName="main"
Jul 29 09:16:16.936345 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.936328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:16.941187 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.941158    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-94ce66b8\""
Jul 29 09:16:16.941314 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.941264    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-94ce66b8-dockercfg-b6s2p\""
Jul 29 09:16:16.947926 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:16.947885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:17.035045 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.035014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.035220 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.035103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tgt6\" (UniqueName: \"kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.135942 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.135886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tgt6\" (UniqueName: \"kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.136136 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.136006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.136745 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.136725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.144516 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.144484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tgt6\" (UniqueName: \"kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6\") pod \"payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") " pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.247847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.247759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:17.396673 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:17.396640    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:17.398137 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:16:17.398110    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4f9c42_c818_4a8c_9750_2ad01a24dc90.slice/crio-40fd349438ed148a5292b60bbb31592cbe82c2ec026dd9342fefffbe2aa8c22e WatchSource:0}: Error finding container 40fd349438ed148a5292b60bbb31592cbe82c2ec026dd9342fefffbe2aa8c22e: Status 404 returned error can't find the container with id 40fd349438ed148a5292b60bbb31592cbe82c2ec026dd9342fefffbe2aa8c22e
Jul 29 09:16:18.089869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:18.089834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" event={"ID":"7b4f9c42-c818-4a8c-9750-2ad01a24dc90","Type":"ContainerStarted","Data":"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"}
Jul 29 09:16:18.090294 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:18.089884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" event={"ID":"7b4f9c42-c818-4a8c-9750-2ad01a24dc90","Type":"ContainerStarted","Data":"40fd349438ed148a5292b60bbb31592cbe82c2ec026dd9342fefffbe2aa8c22e"}
Jul 29 09:16:18.090294 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:18.089949    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:18.113660 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:18.111459    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" podStartSLOduration=2.111439103 podStartE2EDuration="2.111439103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:18.110068732 +0000 UTC m=+1716.082211610" watchObservedRunningTime="2026-07-29 09:16:18.111439103 +0000 UTC m=+1716.083581980"
Jul 29 09:16:29.097466 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:29.097432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:46.845547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:46.845510    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:46.846051 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:46.845757    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" podUID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" containerName="payload-processing" containerID="cri-o://753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0" gracePeriod=30
Jul 29 09:16:47.110073 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.110004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:47.193710 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.193680    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume\") pod \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") "
Jul 29 09:16:47.193879 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.193723    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tgt6\" (UniqueName: \"kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6\") pod \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\" (UID: \"7b4f9c42-c818-4a8c-9750-2ad01a24dc90\") "
Jul 29 09:16:47.194076 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.194047    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b4f9c42-c818-4a8c-9750-2ad01a24dc90" (UID: "7b4f9c42-c818-4a8c-9750-2ad01a24dc90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:16:47.194161 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.194147    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.195852 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.195825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6" (OuterVolumeSpecName: "kube-api-access-6tgt6") pod "7b4f9c42-c818-4a8c-9750-2ad01a24dc90" (UID: "7b4f9c42-c818-4a8c-9750-2ad01a24dc90"). InnerVolumeSpecName "kube-api-access-6tgt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:16:47.267599 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.267567    2573 generic.go:356] "Generic (PLEG): container finished" podID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" containerID="753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0" exitCode=0
Jul 29 09:16:47.267789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.267616    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"
Jul 29 09:16:47.267789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.267658    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" event={"ID":"7b4f9c42-c818-4a8c-9750-2ad01a24dc90","Type":"ContainerDied","Data":"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"}
Jul 29 09:16:47.267789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.267708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm" event={"ID":"7b4f9c42-c818-4a8c-9750-2ad01a24dc90","Type":"ContainerDied","Data":"40fd349438ed148a5292b60bbb31592cbe82c2ec026dd9342fefffbe2aa8c22e"}
Jul 29 09:16:47.267789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.267731    2573 scope.go:117] "RemoveContainer" containerID="753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"
Jul 29 09:16:47.277620 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.277604    2573 scope.go:117] "RemoveContainer" containerID="753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"
Jul 29 09:16:47.277861 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:16:47.277844    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0\": container with ID starting with 753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0 not found: ID does not exist" containerID="753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"
Jul 29 09:16:47.277931 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.277871    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0"} err="failed to get container status \"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0\": rpc error: code = NotFound desc = could not find container \"753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0\": container with ID starting with 753f7278d089e3c8034e708e26b03c07ddcdb29e36c6756636852664454694d0 not found: ID does not exist"
Jul 29 09:16:47.295357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.295335    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tgt6\" (UniqueName: \"kubernetes.io/projected/7b4f9c42-c818-4a8c-9750-2ad01a24dc90-kube-api-access-6tgt6\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.301767 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.301743    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:47.306981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:47.306958    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm"]
Jul 29 09:16:48.645086 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:16:48.645053    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" path="/var/lib/kubelet/pods/7b4f9c42-c818-4a8c-9750-2ad01a24dc90/volumes"
Jul 29 09:17:15.405986 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.405944    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"]
Jul 29 09:17:15.406440 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.406426    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" containerName="payload-processing"
Jul 29 09:17:15.406491 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.406442    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" containerName="payload-processing"
Jul 29 09:17:15.406535 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.406514    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b4f9c42-c818-4a8c-9750-2ad01a24dc90" containerName="payload-processing"
Jul 29 09:17:15.409640 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.409623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:15.415998 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.415967    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:17:15.422797 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.422769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"]
Jul 29 09:17:15.464208 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.464155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s\" (UID: \"ff8921f2-7740-42da-b890-4dbde89c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:15.564785 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.564744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s\" (UID: \"ff8921f2-7740-42da-b890-4dbde89c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:15.565442 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.565410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s\" (UID: \"ff8921f2-7740-42da-b890-4dbde89c1451\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:15.722540 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.722440    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:15.863841 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:15.863657    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"]
Jul 29 09:17:15.863996 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:17:15.863876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8921f2_7740_42da_b890_4dbde89c1451.slice/crio-e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc WatchSource:0}: Error finding container e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc: Status 404 returned error can't find the container with id e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc
Jul 29 09:17:16.433982 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:16.433939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s" event={"ID":"ff8921f2-7740-42da-b890-4dbde89c1451","Type":"ContainerStarted","Data":"2199ad3910096da69b6ca81f538dd4728e8eb537e1e95ac9566b69533eef1308"}
Jul 29 09:17:16.434367 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:16.434000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s" event={"ID":"ff8921f2-7740-42da-b890-4dbde89c1451","Type":"ContainerStarted","Data":"e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc"}
Jul 29 09:17:16.450450 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:16.450395    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s" podStartSLOduration=1.450379661 podStartE2EDuration="1.450379661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:16.4477543 +0000 UTC m=+1774.419897174" watchObservedRunningTime="2026-07-29 09:17:16.450379661 +0000 UTC m=+1774.422522554"
Jul 29 09:17:17.440699 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:17.440662    2573 generic.go:356] "Generic (PLEG): container finished" podID="ff8921f2-7740-42da-b890-4dbde89c1451" containerID="2199ad3910096da69b6ca81f538dd4728e8eb537e1e95ac9566b69533eef1308" exitCode=0
Jul 29 09:17:17.441206 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:17.440748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s" event={"ID":"ff8921f2-7740-42da-b890-4dbde89c1451","Type":"ContainerDied","Data":"2199ad3910096da69b6ca81f538dd4728e8eb537e1e95ac9566b69533eef1308"}
Jul 29 09:17:18.594860 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:18.594827    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:18.688762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:18.688729    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca\") pod \"ff8921f2-7740-42da-b890-4dbde89c1451\" (UID: \"ff8921f2-7740-42da-b890-4dbde89c1451\") "
Jul 29 09:17:18.689156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:18.689132    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff8921f2-7740-42da-b890-4dbde89c1451" (UID: "ff8921f2-7740-42da-b890-4dbde89c1451"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:18.790008 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:18.789915    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8921f2-7740-42da-b890-4dbde89c1451-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:17:19.454197 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:19.454163    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"
Jul 29 09:17:19.454443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:19.454199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s" event={"ID":"ff8921f2-7740-42da-b890-4dbde89c1451","Type":"ContainerDied","Data":"e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc"}
Jul 29 09:17:19.454443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:19.454251    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7fa72d751ae28f88cb949b4095ce8cbf77c37b18b2ab47aef2edc686884fadc"
Jul 29 09:17:22.109957 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:22.109887    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"]
Jul 29 09:17:22.112446 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:22.112417    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-610dc5ab-7rx2s"]
Jul 29 09:17:22.645031 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:22.644998    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff8921f2-7740-42da-b890-4dbde89c1451" path="/var/lib/kubelet/pods/ff8921f2-7740-42da-b890-4dbde89c1451/volumes"
Jul 29 09:17:42.648414 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:42.648389    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:17:42.652230 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:42.652207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:17:51.205628 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.205540    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"]
Jul 29 09:17:51.206064 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.206019    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff8921f2-7740-42da-b890-4dbde89c1451" containerName="revoke-keys"
Jul 29 09:17:51.206064 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.206043    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff8921f2-7740-42da-b890-4dbde89c1451" containerName="revoke-keys"
Jul 29 09:17:51.206146 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.206136    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff8921f2-7740-42da-b890-4dbde89c1451" containerName="revoke-keys"
Jul 29 09:17:51.209299 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.209282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:51.211230 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.211206    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:17:51.215431 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.215405    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"]
Jul 29 09:17:51.299018 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.298977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2\" (UID: \"aadce72f-a074-4458-897b-0ba0a2471156\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:51.400138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.400102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2\" (UID: \"aadce72f-a074-4458-897b-0ba0a2471156\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:51.400799 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.400772    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2\" (UID: \"aadce72f-a074-4458-897b-0ba0a2471156\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:51.522871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.522776    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:51.669143 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:51.669113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"]
Jul 29 09:17:51.670344 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:17:51.670315    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadce72f_a074_4458_897b_0ba0a2471156.slice/crio-50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b WatchSource:0}: Error finding container 50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b: Status 404 returned error can't find the container with id 50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b
Jul 29 09:17:52.657999 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:52.657888    2573 generic.go:356] "Generic (PLEG): container finished" podID="aadce72f-a074-4458-897b-0ba0a2471156" containerID="940d81030254aa8afa1af91ddef7e245288e3fbc98853696413669fb26005c3c" exitCode=0
Jul 29 09:17:52.658393 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:52.657923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2" event={"ID":"aadce72f-a074-4458-897b-0ba0a2471156","Type":"ContainerDied","Data":"940d81030254aa8afa1af91ddef7e245288e3fbc98853696413669fb26005c3c"}
Jul 29 09:17:52.658393 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:52.658046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2" event={"ID":"aadce72f-a074-4458-897b-0ba0a2471156","Type":"ContainerStarted","Data":"50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b"}
Jul 29 09:17:53.808823 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:53.808796    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:53.924148 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:53.924056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca\") pod \"aadce72f-a074-4458-897b-0ba0a2471156\" (UID: \"aadce72f-a074-4458-897b-0ba0a2471156\") "
Jul 29 09:17:53.924442 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:53.924418    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aadce72f-a074-4458-897b-0ba0a2471156" (UID: "aadce72f-a074-4458-897b-0ba0a2471156"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:54.025610 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:54.025571    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aadce72f-a074-4458-897b-0ba0a2471156-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:17:54.670375 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:54.670340    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"
Jul 29 09:17:54.670546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:54.670371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2" event={"ID":"aadce72f-a074-4458-897b-0ba0a2471156","Type":"ContainerDied","Data":"50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b"}
Jul 29 09:17:54.670546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:54.670428    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a7fdec8db520618a8dd896536f72026ca85068103d38c5848db05fbf1cf91b"
Jul 29 09:17:56.448054 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:56.448018    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"]
Jul 29 09:17:56.450405 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:56.450381    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-696b6b1c-fxbk2"]
Jul 29 09:17:56.645919 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:17:56.645871    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aadce72f-a074-4458-897b-0ba0a2471156" path="/var/lib/kubelet/pods/aadce72f-a074-4458-897b-0ba0a2471156/volumes"
Jul 29 09:18:25.537933 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.537885    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"]
Jul 29 09:18:25.538343 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.538319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadce72f-a074-4458-897b-0ba0a2471156" containerName="revoke-keys"
Jul 29 09:18:25.538343 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.538330    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadce72f-a074-4458-897b-0ba0a2471156" containerName="revoke-keys"
Jul 29 09:18:25.538419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.538416    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadce72f-a074-4458-897b-0ba0a2471156" containerName="revoke-keys"
Jul 29 09:18:25.541755 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.541738    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:25.543857 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.543836    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:18:25.551402 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.551365    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"]
Jul 29 09:18:25.621724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.621687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8\" (UID: \"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:25.723097 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.723057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8\" (UID: \"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:25.723815 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.723796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8\" (UID: \"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:25.852790 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.852754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:25.994598 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:25.994570    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"]
Jul 29 09:18:25.995652 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:18:25.995627    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb826fb8c_4f65_4509_bcd2_2bb6ceaa99f3.slice/crio-93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc WatchSource:0}: Error finding container 93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc: Status 404 returned error can't find the container with id 93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc
Jul 29 09:18:26.865379 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:26.865341    2573 generic.go:356] "Generic (PLEG): container finished" podID="b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" containerID="fc23d63ba59e32721399b7f81caa84f58066fede55086873ccf1b1426cf8a8a9" exitCode=0
Jul 29 09:18:26.865910 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:26.865403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8" event={"ID":"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3","Type":"ContainerDied","Data":"fc23d63ba59e32721399b7f81caa84f58066fede55086873ccf1b1426cf8a8a9"}
Jul 29 09:18:26.865910 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:26.865455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8" event={"ID":"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3","Type":"ContainerStarted","Data":"93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc"}
Jul 29 09:18:28.009875 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.009850    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:28.146695 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.146589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca\") pod \"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3\" (UID: \"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3\") "
Jul 29 09:18:28.147000 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.146978    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" (UID: "b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:28.247694 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.247651    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:18:28.885410 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.885374    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"
Jul 29 09:18:28.885577 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.885410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8" event={"ID":"b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3","Type":"ContainerDied","Data":"93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc"}
Jul 29 09:18:28.885577 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:28.885485    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93d9eda7e6bc3efc7163b17fd5680375b4d99e5f3685e1f5d601a4ac23dee2fc"
Jul 29 09:18:31.701625 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:31.701590    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"]
Jul 29 09:18:31.703863 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:31.703839    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3cfa77ca-vfbs8"]
Jul 29 09:18:32.646152 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:18:32.646119    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" path="/var/lib/kubelet/pods/b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3/volumes"
Jul 29 09:20:49.291244 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.291161    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"]
Jul 29 09:20:49.291682 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.291665    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" containerName="revoke-keys"
Jul 29 09:20:49.291729 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.291684    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" containerName="revoke-keys"
Jul 29 09:20:49.291782 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.291773    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b826fb8c-4f65-4509-bcd2-2bb6ceaa99f3" containerName="revoke-keys"
Jul 29 09:20:49.295099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.295077    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:49.297631 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.297608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:20:49.307148 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.307119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"]
Jul 29 09:20:49.381316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.381281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq\" (UID: \"872309a5-2911-4d22-b842-89c3bedd5aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:49.482869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.482826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq\" (UID: \"872309a5-2911-4d22-b842-89c3bedd5aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:49.483476 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.483451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq\" (UID: \"872309a5-2911-4d22-b842-89c3bedd5aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:49.606348 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.606314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:49.751770 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:49.751741    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"]
Jul 29 09:20:50.712443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:50.712407    2573 generic.go:356] "Generic (PLEG): container finished" podID="872309a5-2911-4d22-b842-89c3bedd5aba" containerID="f8fbf25e6b8a95f3ae598f41ab5253a0a87bb660f37577705600789fd19869d9" exitCode=0
Jul 29 09:20:50.712813 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:50.712496    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq" event={"ID":"872309a5-2911-4d22-b842-89c3bedd5aba","Type":"ContainerDied","Data":"f8fbf25e6b8a95f3ae598f41ab5253a0a87bb660f37577705600789fd19869d9"}
Jul 29 09:20:50.712813 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:50.712543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq" event={"ID":"872309a5-2911-4d22-b842-89c3bedd5aba","Type":"ContainerStarted","Data":"d2c72d50fdfc5c4660655d19b6ba0a2fef101806cb04ef7a3b6e0db40b000206"}
Jul 29 09:20:51.865869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:51.865839    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:52.008066 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.007953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca\") pod \"872309a5-2911-4d22-b842-89c3bedd5aba\" (UID: \"872309a5-2911-4d22-b842-89c3bedd5aba\") "
Jul 29 09:20:52.008317 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.008295    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "872309a5-2911-4d22-b842-89c3bedd5aba" (UID: "872309a5-2911-4d22-b842-89c3bedd5aba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:20:52.109394 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.109347    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872309a5-2911-4d22-b842-89c3bedd5aba-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:20:52.724546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.724508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq" event={"ID":"872309a5-2911-4d22-b842-89c3bedd5aba","Type":"ContainerDied","Data":"d2c72d50fdfc5c4660655d19b6ba0a2fef101806cb04ef7a3b6e0db40b000206"}
Jul 29 09:20:52.724546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.724547    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"
Jul 29 09:20:52.724769 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:52.724563    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2c72d50fdfc5c4660655d19b6ba0a2fef101806cb04ef7a3b6e0db40b000206"
Jul 29 09:20:59.937428 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:59.937390    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"]
Jul 29 09:20:59.940436 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:20:59.940400    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6f2e14d7-rbchq"]
Jul 29 09:21:00.645590 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:00.645557    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="872309a5-2911-4d22-b842-89c3bedd5aba" path="/var/lib/kubelet/pods/872309a5-2911-4d22-b842-89c3bedd5aba/volumes"
Jul 29 09:21:59.211592 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.211557    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:21:59.212109 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.212032    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872309a5-2911-4d22-b842-89c3bedd5aba" containerName="revoke-keys"
Jul 29 09:21:59.212109 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.212046    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="872309a5-2911-4d22-b842-89c3bedd5aba" containerName="revoke-keys"
Jul 29 09:21:59.212196 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.212120    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="872309a5-2911-4d22-b842-89c3bedd5aba" containerName="revoke-keys"
Jul 29 09:21:59.215551 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.215531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.218981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.218952    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2dc45aaa\"/\"openshift-service-ca.crt\""
Jul 29 09:21:59.219131 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.218952    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2dc45aaa\"/\"kube-root-ca.crt\""
Jul 29 09:21:59.219131 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.218998    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2dc45aaa\"/\"default-dockercfg-r6jvn\""
Jul 29 09:21:59.219131 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.219042    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2dc45aaa\"/\"e2e-lifecycle-model-2dc45aaa-kserve-self-signed-certs\""
Jul 29 09:21:59.227335 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.227306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:21:59.337878 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.337843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.338099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.337916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.338099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.337951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.338099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.338040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.338099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.338077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.338290 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.338126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds744\" (UniqueName: \"kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.438648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.438607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.438822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.438689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.438822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.438713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.438822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.438744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds744\" (UniqueName: \"kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.438822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.438808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.439083 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.439006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.439142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.439080    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.439142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.439104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.439347 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.439325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.441132 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.441110    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.441318 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.441302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.447208 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.447187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds744\" (UniqueName: \"kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744\") pod \"e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") " pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.526991 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.526888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:21:59.670690 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:21:59.670644    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:21:59.677290 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:21:59.677263    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82197a59_00dd_4423_8f3d_97ca95029013.slice/crio-84daee643ec962c1d3ac78b822e7566380ec4fbe5ee6975f93c6dcf99d11414e WatchSource:0}: Error finding container 84daee643ec962c1d3ac78b822e7566380ec4fbe5ee6975f93c6dcf99d11414e: Status 404 returned error can't find the container with id 84daee643ec962c1d3ac78b822e7566380ec4fbe5ee6975f93c6dcf99d11414e
Jul 29 09:22:00.122359 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:00.122319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" event={"ID":"82197a59-00dd-4423-8f3d-97ca95029013","Type":"ContainerStarted","Data":"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"}
Jul 29 09:22:00.122568 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:00.122366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" event={"ID":"82197a59-00dd-4423-8f3d-97ca95029013","Type":"ContainerStarted","Data":"84daee643ec962c1d3ac78b822e7566380ec4fbe5ee6975f93c6dcf99d11414e"}
Jul 29 09:22:00.141845 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:00.141797    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" podStartSLOduration=1.1417800869999999 podStartE2EDuration="1.141780087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:22:00.138629032 +0000 UTC m=+2058.110771912" watchObservedRunningTime="2026-07-29 09:22:00.141780087 +0000 UTC m=+2058.113922961"
Jul 29 09:22:09.527191 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:09.527156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:22:09.527654 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:09.527397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:22:09.540201 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:09.540172    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:22:10.196849 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:10.196811    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:22:42.687585 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:42.687550    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:22:42.695304 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:42.695280    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:22:48.051320 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:22:48.051285    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:23:03.071204 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.071135    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" podUID="82197a59-00dd-4423-8f3d-97ca95029013" containerName="main" containerID="cri-o://c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f" gracePeriod=45
Jul 29 09:23:03.337093 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.337070    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:23:03.449160 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449132    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449330 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449179    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds744\" (UniqueName: \"kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449330 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449211    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449330 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449312    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449462 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449462 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm\") pod \"82197a59-00dd-4423-8f3d-97ca95029013\" (UID: \"82197a59-00dd-4423-8f3d-97ca95029013\") "
Jul 29 09:23:03.449565 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449539    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home" (OuterVolumeSpecName: "home") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:03.449629 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449562    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:03.449629 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449576    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache" (OuterVolumeSpecName: "model-cache") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:03.449744 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449732    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:03.449786 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449749    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:03.449786 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.449764    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:03.451488 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.451454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm" (OuterVolumeSpecName: "dshm") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:03.451613 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.451492    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:23:03.451613 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.451520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744" (OuterVolumeSpecName: "kube-api-access-ds744") pod "82197a59-00dd-4423-8f3d-97ca95029013" (UID: "82197a59-00dd-4423-8f3d-97ca95029013"). InnerVolumeSpecName "kube-api-access-ds744". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:23:03.506300 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.506268    2573 generic.go:356] "Generic (PLEG): container finished" podID="82197a59-00dd-4423-8f3d-97ca95029013" containerID="c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f" exitCode=0
Jul 29 09:23:03.506493 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.506315    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"
Jul 29 09:23:03.506493 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.506366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" event={"ID":"82197a59-00dd-4423-8f3d-97ca95029013","Type":"ContainerDied","Data":"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"}
Jul 29 09:23:03.506493 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.506417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk" event={"ID":"82197a59-00dd-4423-8f3d-97ca95029013","Type":"ContainerDied","Data":"84daee643ec962c1d3ac78b822e7566380ec4fbe5ee6975f93c6dcf99d11414e"}
Jul 29 09:23:03.506493 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.506440    2573 scope.go:117] "RemoveContainer" containerID="c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"
Jul 29 09:23:03.516222 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.516204    2573 scope.go:117] "RemoveContainer" containerID="c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"
Jul 29 09:23:03.516488 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:23:03.516471    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f\": container with ID starting with c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f not found: ID does not exist" containerID="c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"
Jul 29 09:23:03.516540 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.516498    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f"} err="failed to get container status \"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f\": rpc error: code = NotFound desc = could not find container \"c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f\": container with ID starting with c5ad34fb1ef126e8981a0906475b33adb6f425c166694486b75b8fc1ea0d352f not found: ID does not exist"
Jul 29 09:23:03.528479 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.528434    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:23:03.530852 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.530832    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2dc45aaa/e2e-lifecycle-model-2dc45aaa-kserve-6b49d88647-4phqk"]
Jul 29 09:23:03.550695 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.550669    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82197a59-00dd-4423-8f3d-97ca95029013-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:03.550695 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.550691    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds744\" (UniqueName: \"kubernetes.io/projected/82197a59-00dd-4423-8f3d-97ca95029013-kube-api-access-ds744\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:03.550849 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:03.550701    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82197a59-00dd-4423-8f3d-97ca95029013-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:23:04.644722 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:04.644690    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82197a59-00dd-4423-8f3d-97ca95029013" path="/var/lib/kubelet/pods/82197a59-00dd-4423-8f3d-97ca95029013/volumes"
Jul 29 09:23:55.137742 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:55.137654    2573 scope.go:117] "RemoveContainer" containerID="940d81030254aa8afa1af91ddef7e245288e3fbc98853696413669fb26005c3c"
Jul 29 09:23:55.146789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:23:55.146768    2573 scope.go:117] "RemoveContainer" containerID="2199ad3910096da69b6ca81f538dd4728e8eb537e1e95ac9566b69533eef1308"
Jul 29 09:24:55.179118 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:24:55.179077    2573 scope.go:117] "RemoveContainer" containerID="fc23d63ba59e32721399b7f81caa84f58066fede55086873ccf1b1426cf8a8a9"
Jul 29 09:25:14.365412 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.365374    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:25:14.365861 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.365847    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82197a59-00dd-4423-8f3d-97ca95029013" containerName="main"
Jul 29 09:25:14.365933 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.365863    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="82197a59-00dd-4423-8f3d-97ca95029013" containerName="main"
Jul 29 09:25:14.365977 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.365949    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="82197a59-00dd-4423-8f3d-97ca95029013" containerName="main"
Jul 29 09:25:14.370491 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.370474    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.374990 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.374970    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-612453\""
Jul 29 09:25:14.375229 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.375213    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-612453-dockercfg-9dtlx\""
Jul 29 09:25:14.388576 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.388548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:25:14.486495 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.486460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6zl\" (UniqueName: \"kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.486682 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.486513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.587603 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.587565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.587810 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.587718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6zl\" (UniqueName: \"kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.588406 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.588387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.599474 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.599444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6zl\" (UniqueName: \"kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl\") pod \"payload-processing-e2e-inf-b-612453-767cf94c94-q8djt\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") " pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.682132 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.682045    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:14.824486 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:14.824461    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:25:14.825761 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:25:14.825734    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e936cc3_b547_4b00_a8ef_40f79789b025.slice/crio-297fc57d62fad6fc30ed9a97856b944e0c4e8601ab4a875043700a0a70aabd2a WatchSource:0}: Error finding container 297fc57d62fad6fc30ed9a97856b944e0c4e8601ab4a875043700a0a70aabd2a: Status 404 returned error can't find the container with id 297fc57d62fad6fc30ed9a97856b944e0c4e8601ab4a875043700a0a70aabd2a
Jul 29 09:25:15.291182 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:15.291149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" event={"ID":"4e936cc3-b547-4b00-a8ef-40f79789b025","Type":"ContainerStarted","Data":"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"}
Jul 29 09:25:15.291367 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:15.291222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" event={"ID":"4e936cc3-b547-4b00-a8ef-40f79789b025","Type":"ContainerStarted","Data":"297fc57d62fad6fc30ed9a97856b944e0c4e8601ab4a875043700a0a70aabd2a"}
Jul 29 09:25:15.291367 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:15.291303    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:25:15.313416 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:15.313338    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" podStartSLOduration=1.313320509 podStartE2EDuration="1.313320509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:25:15.31264176 +0000 UTC m=+2253.284784642" watchObservedRunningTime="2026-07-29 09:25:15.313320509 +0000 UTC m=+2253.285463384"
Jul 29 09:25:26.299754 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:25:26.299724    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:26:10.915684 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.915648    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:26:10.919537 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.919514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:10.922063 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.922040    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-612453\"/\"kube-root-ca.crt\""
Jul 29 09:26:10.922188 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.922058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-612453\"/\"default-dockercfg-k4k4f\""
Jul 29 09:26:10.922188 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.922083    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-612453\"/\"openshift-service-ca.crt\""
Jul 29 09:26:10.922363 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.922347    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-612453\"/\"test-model-612453-kserve-self-signed-certs\""
Jul 29 09:26:10.928159 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:10.928117    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:26:11.013279 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.013457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.013457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.013457 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.013565 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4hz\" (UniqueName: \"kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.013565 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.013538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.114764 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.114726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.114983 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.114789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.114983 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.114821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4hz\" (UniqueName: \"kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.114983 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.114847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.114983 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.114867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.115175 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.115017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.115391 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.115361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.115515 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.115397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.115515 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.115437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.117241 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.117213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.117414 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.117396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.122713 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.122690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4hz\" (UniqueName: \"kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz\") pod \"test-model-612453-kserve-686548c7d7-tmlc6\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") " pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.231029 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.230926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:11.377478 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.377444    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:26:11.378401 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:26:11.378370    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb21969_b9f4_4480_9940_94b9356b997d.slice/crio-3694bebb3980598b80b44d2bb58e5987273a0ee3cf83b2d582ae4e330be86092 WatchSource:0}: Error finding container 3694bebb3980598b80b44d2bb58e5987273a0ee3cf83b2d582ae4e330be86092: Status 404 returned error can't find the container with id 3694bebb3980598b80b44d2bb58e5987273a0ee3cf83b2d582ae4e330be86092
Jul 29 09:26:11.625697 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.625655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" event={"ID":"4eb21969-b9f4-4480-9940-94b9356b997d","Type":"ContainerStarted","Data":"a01a2fd2eac6afbaa561156b50501ea5735483486756e00bbb3d87a995abf3f7"}
Jul 29 09:26:11.625867 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.625706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" event={"ID":"4eb21969-b9f4-4480-9940-94b9356b997d","Type":"ContainerStarted","Data":"3694bebb3980598b80b44d2bb58e5987273a0ee3cf83b2d582ae4e330be86092"}
Jul 29 09:26:11.642116 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:11.642065    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" podStartSLOduration=1.642048156 podStartE2EDuration="1.642048156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:26:11.641031858 +0000 UTC m=+2309.613174736" watchObservedRunningTime="2026-07-29 09:26:11.642048156 +0000 UTC m=+2309.614191030"
Jul 29 09:26:21.231146 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:21.231104    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:21.231546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:21.231161    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:21.243981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:21.243959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:21.697143 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:21.697111    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:26:53.766115 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:53.766032    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:26:55.212068 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:26:55.212035    2573 scope.go:117] "RemoveContainer" containerID="f8fbf25e6b8a95f3ae598f41ab5253a0a87bb660f37577705600789fd19869d9"
Jul 29 09:27:08.785927 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:08.785874    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" podUID="4eb21969-b9f4-4480-9940-94b9356b997d" containerName="main" containerID="cri-o://a01a2fd2eac6afbaa561156b50501ea5735483486756e00bbb3d87a995abf3f7" gracePeriod=45
Jul 29 09:27:08.969737 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:08.969707    2573 generic.go:356] "Generic (PLEG): container finished" podID="4eb21969-b9f4-4480-9940-94b9356b997d" containerID="a01a2fd2eac6afbaa561156b50501ea5735483486756e00bbb3d87a995abf3f7" exitCode=0
Jul 29 09:27:08.969880 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:08.969779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" event={"ID":"4eb21969-b9f4-4480-9940-94b9356b997d","Type":"ContainerDied","Data":"a01a2fd2eac6afbaa561156b50501ea5735483486756e00bbb3d87a995abf3f7"}
Jul 29 09:27:09.045037 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.044980    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:27:09.195661 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.195628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.195847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.195691    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.195847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.195743    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.195847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.195770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.195847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.195795    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.196207 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.196015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q4hz\" (UniqueName: \"kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz\") pod \"4eb21969-b9f4-4480-9940-94b9356b997d\" (UID: \"4eb21969-b9f4-4480-9940-94b9356b997d\") "
Jul 29 09:27:09.196497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.196323    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:09.196497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.196333    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:09.196497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.196461    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.196778 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.196754    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home" (OuterVolumeSpecName: "home") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:09.198659 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.198636    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm" (OuterVolumeSpecName: "dshm") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:09.198659 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.198651    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:27:09.198781 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.198671    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz" (OuterVolumeSpecName: "kube-api-access-2q4hz") pod "4eb21969-b9f4-4480-9940-94b9356b997d" (UID: "4eb21969-b9f4-4480-9940-94b9356b997d"). InnerVolumeSpecName "kube-api-access-2q4hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:09.297411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.297334    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q4hz\" (UniqueName: \"kubernetes.io/projected/4eb21969-b9f4-4480-9940-94b9356b997d-kube-api-access-2q4hz\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.297411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.297360    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.297411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.297371    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb21969-b9f4-4480-9940-94b9356b997d-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.297411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.297378    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.297411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.297387    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb21969-b9f4-4480-9940-94b9356b997d-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:09.976431 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.976401    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"
Jul 29 09:27:09.976869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.976441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6" event={"ID":"4eb21969-b9f4-4480-9940-94b9356b997d","Type":"ContainerDied","Data":"3694bebb3980598b80b44d2bb58e5987273a0ee3cf83b2d582ae4e330be86092"}
Jul 29 09:27:09.976869 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:09.976495    2573 scope.go:117] "RemoveContainer" containerID="a01a2fd2eac6afbaa561156b50501ea5735483486756e00bbb3d87a995abf3f7"
Jul 29 09:27:10.000391 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:10.000363    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:27:10.006920 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:10.006878    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-612453/test-model-612453-kserve-686548c7d7-tmlc6"]
Jul 29 09:27:10.645165 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:10.645131    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb21969-b9f4-4480-9940-94b9356b997d" path="/var/lib/kubelet/pods/4eb21969-b9f4-4480-9940-94b9356b997d/volumes"
Jul 29 09:27:21.617989 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.617953    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:27:21.618500 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.618258    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" podUID="4e936cc3-b547-4b00-a8ef-40f79789b025" containerName="payload-processing" containerID="cri-o://cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444" gracePeriod=30
Jul 29 09:27:21.882539 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.882474    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:27:21.919027 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.918995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl6zl\" (UniqueName: \"kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl\") pod \"4e936cc3-b547-4b00-a8ef-40f79789b025\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") "
Jul 29 09:27:21.919190 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.919172    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume\") pod \"4e936cc3-b547-4b00-a8ef-40f79789b025\" (UID: \"4e936cc3-b547-4b00-a8ef-40f79789b025\") "
Jul 29 09:27:21.919607 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.919575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e936cc3-b547-4b00-a8ef-40f79789b025" (UID: "4e936cc3-b547-4b00-a8ef-40f79789b025"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:21.921301 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:21.921278    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl" (OuterVolumeSpecName: "kube-api-access-zl6zl") pod "4e936cc3-b547-4b00-a8ef-40f79789b025" (UID: "4e936cc3-b547-4b00-a8ef-40f79789b025"). InnerVolumeSpecName "kube-api-access-zl6zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:22.020644 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.020611    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e936cc3-b547-4b00-a8ef-40f79789b025-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.020644 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.020638    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl6zl\" (UniqueName: \"kubernetes.io/projected/4e936cc3-b547-4b00-a8ef-40f79789b025-kube-api-access-zl6zl\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.055526 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.055492    2573 generic.go:356] "Generic (PLEG): container finished" podID="4e936cc3-b547-4b00-a8ef-40f79789b025" containerID="cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444" exitCode=0
Jul 29 09:27:22.055685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.055528    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"
Jul 29 09:27:22.055685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.055578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" event={"ID":"4e936cc3-b547-4b00-a8ef-40f79789b025","Type":"ContainerDied","Data":"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"}
Jul 29 09:27:22.055685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.055626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt" event={"ID":"4e936cc3-b547-4b00-a8ef-40f79789b025","Type":"ContainerDied","Data":"297fc57d62fad6fc30ed9a97856b944e0c4e8601ab4a875043700a0a70aabd2a"}
Jul 29 09:27:22.055685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.055648    2573 scope.go:117] "RemoveContainer" containerID="cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"
Jul 29 09:27:22.065943 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.065887    2573 scope.go:117] "RemoveContainer" containerID="cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"
Jul 29 09:27:22.066244 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:27:22.066216    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444\": container with ID starting with cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444 not found: ID does not exist" containerID="cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"
Jul 29 09:27:22.066307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.066253    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444"} err="failed to get container status \"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444\": rpc error: code = NotFound desc = could not find container \"cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444\": container with ID starting with cc7788c17db0ce765a15b151e24986246785e22eac86bf5e773e8b65775d6444 not found: ID does not exist"
Jul 29 09:27:22.079133 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.079108    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:27:22.082724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.082701    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt"]
Jul 29 09:27:22.645942 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:22.645885    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e936cc3-b547-4b00-a8ef-40f79789b025" path="/var/lib/kubelet/pods/4e936cc3-b547-4b00-a8ef-40f79789b025/volumes"
Jul 29 09:27:42.723773 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:42.723744    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:27:42.733540 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:27:42.733516    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:28:01.050398 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050362    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:28:01.050806 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050794    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb21969-b9f4-4480-9940-94b9356b997d" containerName="main"
Jul 29 09:28:01.050854 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050807    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb21969-b9f4-4480-9940-94b9356b997d" containerName="main"
Jul 29 09:28:01.050854 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050820    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e936cc3-b547-4b00-a8ef-40f79789b025" containerName="payload-processing"
Jul 29 09:28:01.050854 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050826    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e936cc3-b547-4b00-a8ef-40f79789b025" containerName="payload-processing"
Jul 29 09:28:01.050975 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050916    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb21969-b9f4-4480-9940-94b9356b997d" containerName="main"
Jul 29 09:28:01.050975 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.050925    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e936cc3-b547-4b00-a8ef-40f79789b025" containerName="payload-processing"
Jul 29 09:28:01.055569 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.055540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.058563 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.058302    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cddb75\""
Jul 29 09:28:01.058563 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.058416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cddb75-dockercfg-m2q7w\""
Jul 29 09:28:01.066678 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.066480    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:28:01.188958 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.188916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.189143 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.189024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgh4\" (UniqueName: \"kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.290029 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.289993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svgh4\" (UniqueName: \"kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.290222 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.290071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.290765 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.290745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.298730 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.298695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgh4\" (UniqueName: \"kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4\") pod \"payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.370525 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.370487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:01.516337 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:01.516184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:28:01.519048 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:28:01.519021    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3998755_be7b_4c9a_9ae6_838673dba469.slice/crio-8f675abb40e9cee94bcefe1641ef63708f3ed6a31fcea295e790fdfc025cd2f2 WatchSource:0}: Error finding container 8f675abb40e9cee94bcefe1641ef63708f3ed6a31fcea295e790fdfc025cd2f2: Status 404 returned error can't find the container with id 8f675abb40e9cee94bcefe1641ef63708f3ed6a31fcea295e790fdfc025cd2f2
Jul 29 09:28:02.290883 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:02.290837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" event={"ID":"e3998755-be7b-4c9a-9ae6-838673dba469","Type":"ContainerStarted","Data":"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"}
Jul 29 09:28:02.291316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:02.290924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" event={"ID":"e3998755-be7b-4c9a-9ae6-838673dba469","Type":"ContainerStarted","Data":"8f675abb40e9cee94bcefe1641ef63708f3ed6a31fcea295e790fdfc025cd2f2"}
Jul 29 09:28:02.291316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:02.291066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:02.304817 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:02.304761    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" podStartSLOduration=1.304746582 podStartE2EDuration="1.304746582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:28:02.30357418 +0000 UTC m=+2420.275717056" watchObservedRunningTime="2026-07-29 09:28:02.304746582 +0000 UTC m=+2420.276889494"
Jul 29 09:28:13.297871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:13.297839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:28:27.889415 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:27.889372    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"]
Jul 29 09:28:27.893342 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:27.893322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:27.895278 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:27.895258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:28:27.899138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:27.899115    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"]
Jul 29 09:28:27.941651 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:27.941609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd\" (UID: \"e0044770-17bb-4c34-b5e6-4ccc667e7d9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:28.042552 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:28.042511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd\" (UID: \"e0044770-17bb-4c34-b5e6-4ccc667e7d9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:28.043261 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:28.043237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd\" (UID: \"e0044770-17bb-4c34-b5e6-4ccc667e7d9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:28.207340 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:28.207257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:28.345708 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:28.345673    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"]
Jul 29 09:28:28.347701 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:28:28.347672    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0044770_17bb_4c34_b5e6_4ccc667e7d9e.slice/crio-4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be WatchSource:0}: Error finding container 4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be: Status 404 returned error can't find the container with id 4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be
Jul 29 09:28:28.449970 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:28.449928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd" event={"ID":"e0044770-17bb-4c34-b5e6-4ccc667e7d9e","Type":"ContainerStarted","Data":"4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be"}
Jul 29 09:28:29.458852 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:29.458754    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0044770-17bb-4c34-b5e6-4ccc667e7d9e" containerID="e4caa43ea6bbc76d2b4a5bc20c68bce08418a1e143dbba694a43fa493cf9176e" exitCode=0
Jul 29 09:28:29.459238 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:29.458841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd" event={"ID":"e0044770-17bb-4c34-b5e6-4ccc667e7d9e","Type":"ContainerDied","Data":"e4caa43ea6bbc76d2b4a5bc20c68bce08418a1e143dbba694a43fa493cf9176e"}
Jul 29 09:28:30.615201 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:30.615169    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:30.666355 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:30.666317    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca\") pod \"e0044770-17bb-4c34-b5e6-4ccc667e7d9e\" (UID: \"e0044770-17bb-4c34-b5e6-4ccc667e7d9e\") "
Jul 29 09:28:30.666712 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:30.666688    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0044770-17bb-4c34-b5e6-4ccc667e7d9e" (UID: "e0044770-17bb-4c34-b5e6-4ccc667e7d9e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:30.767355 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:30.767265    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0044770-17bb-4c34-b5e6-4ccc667e7d9e-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:28:31.472223 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:31.472194    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"
Jul 29 09:28:31.472372 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:31.472232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd" event={"ID":"e0044770-17bb-4c34-b5e6-4ccc667e7d9e","Type":"ContainerDied","Data":"4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be"}
Jul 29 09:28:31.472372 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:31.472279    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d1af2517133f254452aaea38cf5b25845c78ecbae73e66a439399d0f68921be"
Jul 29 09:28:43.585147 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:43.585111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"]
Jul 29 09:28:43.588088 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:43.588064    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0f1b8-7sgwd"]
Jul 29 09:28:44.645094 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:44.645062    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0044770-17bb-4c34-b5e6-4ccc667e7d9e" path="/var/lib/kubelet/pods/e0044770-17bb-4c34-b5e6-4ccc667e7d9e/volumes"
Jul 29 09:28:50.428959 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.428917    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"]
Jul 29 09:28:50.429444 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.429353    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0044770-17bb-4c34-b5e6-4ccc667e7d9e" containerName="revoke-keys"
Jul 29 09:28:50.429444 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.429363    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0044770-17bb-4c34-b5e6-4ccc667e7d9e" containerName="revoke-keys"
Jul 29 09:28:50.429444 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.429438    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0044770-17bb-4c34-b5e6-4ccc667e7d9e" containerName="revoke-keys"
Jul 29 09:28:50.432853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.432831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:50.434959 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.434936    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:28:50.439963 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.439940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"]
Jul 29 09:28:50.558544 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.558501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cddb75-blqv7\" (UID: \"45372243-9c77-4b9c-a887-611376a05edb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:50.660033 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.660002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cddb75-blqv7\" (UID: \"45372243-9c77-4b9c-a887-611376a05edb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:50.660620 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.660600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cddb75-blqv7\" (UID: \"45372243-9c77-4b9c-a887-611376a05edb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:50.745614 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:50.745536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:51.096559 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:51.096526    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"]
Jul 29 09:28:51.099445 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:28:51.099413    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45372243_9c77_4b9c_a887_611376a05edb.slice/crio-14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d WatchSource:0}: Error finding container 14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d: Status 404 returned error can't find the container with id 14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d
Jul 29 09:28:51.595525 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:51.595492    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7" event={"ID":"45372243-9c77-4b9c-a887-611376a05edb","Type":"ContainerStarted","Data":"7e2f53970fe4139c8321c5767a21c891b47d570d0c959939d05bb31b643c21bc"}
Jul 29 09:28:51.595946 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:51.595556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7" event={"ID":"45372243-9c77-4b9c-a887-611376a05edb","Type":"ContainerStarted","Data":"14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d"}
Jul 29 09:28:51.614505 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:51.614393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7" podStartSLOduration=1.614376203 podStartE2EDuration="1.614376203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:28:51.613492157 +0000 UTC m=+2469.585635033" watchObservedRunningTime="2026-07-29 09:28:51.614376203 +0000 UTC m=+2469.586519119"
Jul 29 09:28:52.602716 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:52.602685    2573 generic.go:356] "Generic (PLEG): container finished" podID="45372243-9c77-4b9c-a887-611376a05edb" containerID="7e2f53970fe4139c8321c5767a21c891b47d570d0c959939d05bb31b643c21bc" exitCode=0
Jul 29 09:28:52.603145 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:52.602769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7" event={"ID":"45372243-9c77-4b9c-a887-611376a05edb","Type":"ContainerDied","Data":"7e2f53970fe4139c8321c5767a21c891b47d570d0c959939d05bb31b643c21bc"}
Jul 29 09:28:53.761651 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:53.761625    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:53.787881 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:53.787850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca\") pod \"45372243-9c77-4b9c-a887-611376a05edb\" (UID: \"45372243-9c77-4b9c-a887-611376a05edb\") "
Jul 29 09:28:53.788294 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:53.788267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45372243-9c77-4b9c-a887-611376a05edb" (UID: "45372243-9c77-4b9c-a887-611376a05edb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:53.889524 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:53.889442    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45372243-9c77-4b9c-a887-611376a05edb-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:28:54.615172 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:54.615141    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"
Jul 29 09:28:54.615326 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:54.615138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7" event={"ID":"45372243-9c77-4b9c-a887-611376a05edb","Type":"ContainerDied","Data":"14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d"}
Jul 29 09:28:54.615326 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:28:54.615294    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14ae56597f7574a2003e6f612a9eb425d4f2b68b07812ca64295c847437e7a3d"
Jul 29 09:29:05.989319 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:05.989285    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:29:05.989940 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:05.989484    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" podUID="e3998755-be7b-4c9a-9ae6-838673dba469" containerName="payload-pre-processing" containerID="cri-o://df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95" gracePeriod=30
Jul 29 09:29:06.141135 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.141098    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"]
Jul 29 09:29:06.143609 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.143578    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cddb75-blqv7"]
Jul 29 09:29:06.262570 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.262539    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:29:06.314193 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.314159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svgh4\" (UniqueName: \"kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4\") pod \"e3998755-be7b-4c9a-9ae6-838673dba469\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") "
Jul 29 09:29:06.314361 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.314249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume\") pod \"e3998755-be7b-4c9a-9ae6-838673dba469\" (UID: \"e3998755-be7b-4c9a-9ae6-838673dba469\") "
Jul 29 09:29:06.314660 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.314636    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3998755-be7b-4c9a-9ae6-838673dba469" (UID: "e3998755-be7b-4c9a-9ae6-838673dba469"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:29:06.316253 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.316230    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4" (OuterVolumeSpecName: "kube-api-access-svgh4") pod "e3998755-be7b-4c9a-9ae6-838673dba469" (UID: "e3998755-be7b-4c9a-9ae6-838673dba469"). InnerVolumeSpecName "kube-api-access-svgh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:29:06.415442 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.415406    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3998755-be7b-4c9a-9ae6-838673dba469-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.415442 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.415434    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svgh4\" (UniqueName: \"kubernetes.io/projected/e3998755-be7b-4c9a-9ae6-838673dba469-kube-api-access-svgh4\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.645239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.645203    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45372243-9c77-4b9c-a887-611376a05edb" path="/var/lib/kubelet/pods/45372243-9c77-4b9c-a887-611376a05edb/volumes"
Jul 29 09:29:06.682238 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.682204    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3998755-be7b-4c9a-9ae6-838673dba469" containerID="df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95" exitCode=0
Jul 29 09:29:06.682395 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.682248    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"
Jul 29 09:29:06.682395 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.682283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" event={"ID":"e3998755-be7b-4c9a-9ae6-838673dba469","Type":"ContainerDied","Data":"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"}
Jul 29 09:29:06.682395 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.682342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh" event={"ID":"e3998755-be7b-4c9a-9ae6-838673dba469","Type":"ContainerDied","Data":"8f675abb40e9cee94bcefe1641ef63708f3ed6a31fcea295e790fdfc025cd2f2"}
Jul 29 09:29:06.682395 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.682371    2573 scope.go:117] "RemoveContainer" containerID="df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"
Jul 29 09:29:06.694061 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.694042    2573 scope.go:117] "RemoveContainer" containerID="df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"
Jul 29 09:29:06.694329 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:29:06.694302    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95\": container with ID starting with df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95 not found: ID does not exist" containerID="df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"
Jul 29 09:29:06.694384 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.694329    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95"} err="failed to get container status \"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95\": rpc error: code = NotFound desc = could not find container \"df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95\": container with ID starting with df7f187dd0f66b11f24f20f5bd6ab0423399c058cc6dd557d9f7d3b11c999d95 not found: ID does not exist"
Jul 29 09:29:06.697776 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.697753    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:29:06.702796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:06.702775    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh"]
Jul 29 09:29:08.646024 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:08.645992    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3998755-be7b-4c9a-9ae6-838673dba469" path="/var/lib/kubelet/pods/e3998755-be7b-4c9a-9ae6-838673dba469/volumes"
Jul 29 09:29:45.618505 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.618407    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:29:45.619138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619117    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45372243-9c77-4b9c-a887-611376a05edb" containerName="revoke-keys"
Jul 29 09:29:45.619225 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619141    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45372243-9c77-4b9c-a887-611376a05edb" containerName="revoke-keys"
Jul 29 09:29:45.619225 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619168    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3998755-be7b-4c9a-9ae6-838673dba469" containerName="payload-pre-processing"
Jul 29 09:29:45.619225 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619177    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3998755-be7b-4c9a-9ae6-838673dba469" containerName="payload-pre-processing"
Jul 29 09:29:45.619380 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619280    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3998755-be7b-4c9a-9ae6-838673dba469" containerName="payload-pre-processing"
Jul 29 09:29:45.619380 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.619295    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="45372243-9c77-4b9c-a887-611376a05edb" containerName="revoke-keys"
Jul 29 09:29:45.622633 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.622610    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.627380 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.627359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-27430b-dockercfg-7t28q\""
Jul 29 09:29:45.628144 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.628118    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-27430b\""
Jul 29 09:29:45.659346 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.659314    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:29:45.699508 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.699470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54nqh\" (UniqueName: \"kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.699678 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.699598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.800847 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.800800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54nqh\" (UniqueName: \"kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.801058 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.800932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.801667 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.801641    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.809047 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.809024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54nqh\" (UniqueName: \"kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh\") pod \"payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") " pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:45.932820 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:45.932728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:46.284990 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:46.284940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:29:46.294536 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:29:46.294498    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3468b53b_2eff_410b_926f_47458c021a67.slice/crio-dc25acd3edc06df67b187c51f9086f38848a6fcc601b0c45fb54c9f495540c70 WatchSource:0}: Error finding container dc25acd3edc06df67b187c51f9086f38848a6fcc601b0c45fb54c9f495540c70: Status 404 returned error can't find the container with id dc25acd3edc06df67b187c51f9086f38848a6fcc601b0c45fb54c9f495540c70
Jul 29 09:29:46.920099 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:46.920060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" event={"ID":"3468b53b-2eff-410b-926f-47458c021a67","Type":"ContainerStarted","Data":"e48a98aa0631f49ab22048c9b07b4fe4cc1aab872aaa3e9b35e5750dceed98fe"}
Jul 29 09:29:46.920546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:46.920120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" event={"ID":"3468b53b-2eff-410b-926f-47458c021a67","Type":"ContainerStarted","Data":"dc25acd3edc06df67b187c51f9086f38848a6fcc601b0c45fb54c9f495540c70"}
Jul 29 09:29:46.920546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:46.920145    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:29:46.956648 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:46.956591    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" podStartSLOduration=1.956569512 podStartE2EDuration="1.956569512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:46.954833596 +0000 UTC m=+2524.926976471" watchObservedRunningTime="2026-07-29 09:29:46.956569512 +0000 UTC m=+2524.928712390"
Jul 29 09:29:57.928155 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:29:57.928127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:30:00.132737 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.132702    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"]
Jul 29 09:30:00.136410 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.136379    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"]
Jul 29 09:30:00.136574 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.136503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"
Jul 29 09:30:00.138611 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.138591    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:30:00.140290 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.140259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"
Jul 29 09:30:00.143709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.143653    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"]
Jul 29 09:30:00.146849 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.146826    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"]
Jul 29 09:30:00.151312 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.151289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"
Jul 29 09:30:00.158870 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.158846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"
Jul 29 09:30:00.332138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.332111    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"]
Jul 29 09:30:00.334512 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:30:00.334478    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760b17ee_e769_4eb2_8c79_2cf29837d210.slice/crio-045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b WatchSource:0}: Error finding container 045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b: Status 404 returned error can't find the container with id 045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b
Jul 29 09:30:00.516327 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:00.516300    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"]
Jul 29 09:30:00.517368 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:30:00.517329    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8331856f_7fe4_4792_bed5_c1e6301ce751.slice/crio-8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73 WatchSource:0}: Error finding container 8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73: Status 404 returned error can't find the container with id 8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73
Jul 29 09:30:01.007140 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.007103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf" event={"ID":"8331856f-7fe4-4792-bed5-c1e6301ce751","Type":"ContainerStarted","Data":"f3018b25657c57e9300b07ea339a0f413c705a0d4b93e8f23327b786e813ad43"}
Jul 29 09:30:01.007310 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.007160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf" event={"ID":"8331856f-7fe4-4792-bed5-c1e6301ce751","Type":"ContainerStarted","Data":"8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73"}
Jul 29 09:30:01.008671 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.008647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6" event={"ID":"760b17ee-e769-4eb2-8c79-2cf29837d210","Type":"ContainerStarted","Data":"00757250eb1be27960ff5158e9832a0c813929e9aded2079b5242791b4ab6cfc"}
Jul 29 09:30:01.008754 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.008688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6" event={"ID":"760b17ee-e769-4eb2-8c79-2cf29837d210","Type":"ContainerStarted","Data":"045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b"}
Jul 29 09:30:01.023986 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.023885    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf" podStartSLOduration=1.023871556 podStartE2EDuration="1.023871556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:30:01.021631293 +0000 UTC m=+2538.993774168" watchObservedRunningTime="2026-07-29 09:30:01.023871556 +0000 UTC m=+2538.996014431"
Jul 29 09:30:01.035239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:01.035190    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6" podStartSLOduration=1.03517493 podStartE2EDuration="1.03517493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:30:01.034171819 +0000 UTC m=+2539.006314694" watchObservedRunningTime="2026-07-29 09:30:01.03517493 +0000 UTC m=+2539.007317805"
Jul 29 09:30:02.016094 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:02.016059    2573 generic.go:356] "Generic (PLEG): container finished" podID="760b17ee-e769-4eb2-8c79-2cf29837d210" containerID="00757250eb1be27960ff5158e9832a0c813929e9aded2079b5242791b4ab6cfc" exitCode=0
Jul 29 09:30:02.016505 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:02.016152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6" event={"ID":"760b17ee-e769-4eb2-8c79-2cf29837d210","Type":"ContainerDied","Data":"00757250eb1be27960ff5158e9832a0c813929e9aded2079b5242791b4ab6cfc"}
Jul 29 09:30:02.017683 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:02.017664    2573 generic.go:356] "Generic (PLEG): container finished" podID="8331856f-7fe4-4792-bed5-c1e6301ce751" containerID="f3018b25657c57e9300b07ea339a0f413c705a0d4b93e8f23327b786e813ad43" exitCode=0
Jul 29 09:30:02.017746 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:02.017715    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf" event={"ID":"8331856f-7fe4-4792-bed5-c1e6301ce751","Type":"ContainerDied","Data":"f3018b25657c57e9300b07ea339a0f413c705a0d4b93e8f23327b786e813ad43"}
Jul 29 09:30:03.173974 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:03.173943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"
Jul 29 09:30:03.212906 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:03.212869    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"
Jul 29 09:30:04.029434 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.029399    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6"
Jul 29 09:30:04.029638 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.029439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755290-g2lk6" event={"ID":"760b17ee-e769-4eb2-8c79-2cf29837d210","Type":"ContainerDied","Data":"045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b"}
Jul 29 09:30:04.029638 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.029491    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="045f310cc68b932fe5576ecdd2292a11e92ca6293c6f7a5e6ddb872acfaa203b"
Jul 29 09:30:04.030866 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.030848    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"
Jul 29 09:30:04.030939 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.030871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf" event={"ID":"8331856f-7fe4-4792-bed5-c1e6301ce751","Type":"ContainerDied","Data":"8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73"}
Jul 29 09:30:04.030981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:04.030943    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b0d2ce5f233860f94c5fc18e46e89ec01bbc3559bb2ae90d49e757c15c5cc73"
Jul 29 09:30:32.918591 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.918552    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:30:32.919265 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919186    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8331856f-7fe4-4792-bed5-c1e6301ce751" containerName="cleanup"
Jul 29 09:30:32.919265 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919204    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8331856f-7fe4-4792-bed5-c1e6301ce751" containerName="cleanup"
Jul 29 09:30:32.919265 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919233    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="760b17ee-e769-4eb2-8c79-2cf29837d210" containerName="cleanup"
Jul 29 09:30:32.919265 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919239    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="760b17ee-e769-4eb2-8c79-2cf29837d210" containerName="cleanup"
Jul 29 09:30:32.919408 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919310    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8331856f-7fe4-4792-bed5-c1e6301ce751" containerName="cleanup"
Jul 29 09:30:32.919408 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.919321    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="760b17ee-e769-4eb2-8c79-2cf29837d210" containerName="cleanup"
Jul 29 09:30:32.922050 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.922033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:32.924183 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.924159    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"kube-root-ca.crt\""
Jul 29 09:30:32.924690 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.924675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"openshift-service-ca.crt\""
Jul 29 09:30:32.924800 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.924767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"auth-test-model-0abb48-kserve-self-signed-certs\""
Jul 29 09:30:32.924855 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.924805    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"default-dockercfg-4b4wf\""
Jul 29 09:30:32.929860 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:32.929830    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:30:33.061379 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.061564 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.061564 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.061564 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.061679 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wx7\" (UniqueName: \"kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.061714 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.061681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.162804 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.162760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163035 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.162843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wx7\" (UniqueName: \"kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163035 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.162874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163035 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.162964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163035 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.162998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163035 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.163015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163328 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.163308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163397 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.163361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.163397 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.163385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.165495 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.165470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.165649 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.165475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.169995 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.169934    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wx7\" (UniqueName: \"kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7\") pod \"auth-test-model-0abb48-kserve-6544d444ff-xczn2\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") " pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.232399 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.232361    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:33.381238 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:33.381203    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:30:33.382970 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:30:33.382945    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc54f0233_0c57_4f9e_a947_aa8eca3cf0de.slice/crio-c84197a00e6d6ae926bae8701ab7c2932a026e55e44aa3c5e6ffc098dbce8330 WatchSource:0}: Error finding container c84197a00e6d6ae926bae8701ab7c2932a026e55e44aa3c5e6ffc098dbce8330: Status 404 returned error can't find the container with id c84197a00e6d6ae926bae8701ab7c2932a026e55e44aa3c5e6ffc098dbce8330
Jul 29 09:30:34.213391 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:34.213354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" event={"ID":"c54f0233-0c57-4f9e-a947-aa8eca3cf0de","Type":"ContainerStarted","Data":"e751c30f6798fc7fa2ffabefbaf949110c5049e97a6c77b15d6d69219a5185a4"}
Jul 29 09:30:34.213391 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:34.213402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" event={"ID":"c54f0233-0c57-4f9e-a947-aa8eca3cf0de","Type":"ContainerStarted","Data":"c84197a00e6d6ae926bae8701ab7c2932a026e55e44aa3c5e6ffc098dbce8330"}
Jul 29 09:30:34.231490 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:34.231437    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" podStartSLOduration=2.231422975 podStartE2EDuration="2.231422975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:30:34.229387598 +0000 UTC m=+2572.201530473" watchObservedRunningTime="2026-07-29 09:30:34.231422975 +0000 UTC m=+2572.203565849"
Jul 29 09:30:43.233111 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:43.233076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:43.233524 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:43.233202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:43.246341 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:43.246314    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:30:43.277748 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:30:43.277715    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:31:02.526220 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.526179    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:31:02.530006 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.529985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.532193 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.532169    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"kube-root-ca.crt\""
Jul 29 09:31:02.532538 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.532520    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"default-dockercfg-rlw7g\""
Jul 29 09:31:02.532659 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.532642    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"auth-test-model-27430b-kserve-self-signed-certs\""
Jul 29 09:31:02.532714 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.532704    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"openshift-service-ca.crt\""
Jul 29 09:31:02.537716 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.537688    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:31:02.647173 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.647346 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.647346 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.647346 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.647453 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wwv\" (UniqueName: \"kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.647453 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.647419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748495 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748495 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wwv\" (UniqueName: \"kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.748762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.749020 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.749020 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.748987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.749090 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.749048    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.751077 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.751053    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.751233 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.751216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.756463 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.756436    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wwv\" (UniqueName: \"kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv\") pod \"auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") " pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.842522 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.842490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:02.987540 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:02.987493    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:31:02.990333 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:31:02.990299    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33849953_278a_4e0e_87af_758e6225d2ae.slice/crio-4d70c0a14111404e79d2ad0975d99e16744de8281d45bb95a6697f6e5595f383 WatchSource:0}: Error finding container 4d70c0a14111404e79d2ad0975d99e16744de8281d45bb95a6697f6e5595f383: Status 404 returned error can't find the container with id 4d70c0a14111404e79d2ad0975d99e16744de8281d45bb95a6697f6e5595f383
Jul 29 09:31:03.386814 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:03.386779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" event={"ID":"33849953-278a-4e0e-87af-758e6225d2ae","Type":"ContainerStarted","Data":"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"}
Jul 29 09:31:03.386814 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:03.386820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" event={"ID":"33849953-278a-4e0e-87af-758e6225d2ae","Type":"ContainerStarted","Data":"4d70c0a14111404e79d2ad0975d99e16744de8281d45bb95a6697f6e5595f383"}
Jul 29 09:31:03.404870 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:03.404811    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" podStartSLOduration=1.40479326 podStartE2EDuration="1.40479326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:31:03.402617212 +0000 UTC m=+2601.374760088" watchObservedRunningTime="2026-07-29 09:31:03.40479326 +0000 UTC m=+2601.376936135"
Jul 29 09:31:12.843409 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:12.843372    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:12.843923 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:12.843445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:12.856454 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:12.856422    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:31:13.456505 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:31:13.456462    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:32:42.764809 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:32:42.764478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:32:42.783998 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:32:42.783970    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:34:55.314253 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:34:55.314145    2573 scope.go:117] "RemoveContainer" containerID="e4caa43ea6bbc76d2b4a5bc20c68bce08418a1e143dbba694a43fa493cf9176e"
Jul 29 09:34:55.323536 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:34:55.323509    2573 scope.go:117] "RemoveContainer" containerID="7e2f53970fe4139c8321c5767a21c891b47d570d0c959939d05bb31b643c21bc"
Jul 29 09:35:24.823477 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:24.823442    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:35:25.719811 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:25.719773    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:35:39.843455 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:39.843393    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" podUID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" containerName="main" containerID="cri-o://e751c30f6798fc7fa2ffabefbaf949110c5049e97a6c77b15d6d69219a5185a4" gracePeriod=45
Jul 29 09:35:40.045289 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.045259    2573 generic.go:356] "Generic (PLEG): container finished" podID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" containerID="e751c30f6798fc7fa2ffabefbaf949110c5049e97a6c77b15d6d69219a5185a4" exitCode=0
Jul 29 09:35:40.045446 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.045333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" event={"ID":"c54f0233-0c57-4f9e-a947-aa8eca3cf0de","Type":"ContainerDied","Data":"e751c30f6798fc7fa2ffabefbaf949110c5049e97a6c77b15d6d69219a5185a4"}
Jul 29 09:35:40.106297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.106238    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:35:40.238725 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.238686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8wx7\" (UniqueName: \"kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239034 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.238755    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239034 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.238791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239034 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.238917    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239034 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.238995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239267 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239056    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home" (OuterVolumeSpecName: "home") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:40.239267 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir\") pod \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\" (UID: \"c54f0233-0c57-4f9e-a947-aa8eca3cf0de\") "
Jul 29 09:35:40.239267 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache" (OuterVolumeSpecName: "model-cache") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:40.239401 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:40.239481 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239462    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.239550 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239490    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.239550 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.239506    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.241097 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.241072    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm" (OuterVolumeSpecName: "dshm") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:40.241097 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.241081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7" (OuterVolumeSpecName: "kube-api-access-z8wx7") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "kube-api-access-z8wx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:35:40.241270 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.241098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c54f0233-0c57-4f9e-a947-aa8eca3cf0de" (UID: "c54f0233-0c57-4f9e-a947-aa8eca3cf0de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:35:40.340497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.340453    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8wx7\" (UniqueName: \"kubernetes.io/projected/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-kube-api-access-z8wx7\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.340497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.340492    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.340497 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.340506    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54f0233-0c57-4f9e-a947-aa8eca3cf0de-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:40.739073 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:40.739027    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" podUID="33849953-278a-4e0e-87af-758e6225d2ae" containerName="main" containerID="cri-o://cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684" gracePeriod=45
Jul 29 09:35:41.001293 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.001266    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:35:41.052606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.052571    2573 generic.go:356] "Generic (PLEG): container finished" podID="33849953-278a-4e0e-87af-758e6225d2ae" containerID="cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684" exitCode=0
Jul 29 09:35:41.052796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.052613    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"
Jul 29 09:35:41.052796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.052649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" event={"ID":"33849953-278a-4e0e-87af-758e6225d2ae","Type":"ContainerDied","Data":"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"}
Jul 29 09:35:41.052796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.052690    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9" event={"ID":"33849953-278a-4e0e-87af-758e6225d2ae","Type":"ContainerDied","Data":"4d70c0a14111404e79d2ad0975d99e16744de8281d45bb95a6697f6e5595f383"}
Jul 29 09:35:41.052796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.052712    2573 scope.go:117] "RemoveContainer" containerID="cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"
Jul 29 09:35:41.054095 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.054076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2" event={"ID":"c54f0233-0c57-4f9e-a947-aa8eca3cf0de","Type":"ContainerDied","Data":"c84197a00e6d6ae926bae8701ab7c2932a026e55e44aa3c5e6ffc098dbce8330"}
Jul 29 09:35:41.054177 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.054112    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"
Jul 29 09:35:41.062993 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.062965    2573 scope.go:117] "RemoveContainer" containerID="cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"
Jul 29 09:35:41.063327 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:35:41.063306    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684\": container with ID starting with cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684 not found: ID does not exist" containerID="cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"
Jul 29 09:35:41.063437 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.063336    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684"} err="failed to get container status \"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684\": rpc error: code = NotFound desc = could not find container \"cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684\": container with ID starting with cc969a6fa80c2b7cb6e7e714c999101bf27684331318b751cd4b61c3d7262684 not found: ID does not exist"
Jul 29 09:35:41.063437 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.063357    2573 scope.go:117] "RemoveContainer" containerID="e751c30f6798fc7fa2ffabefbaf949110c5049e97a6c77b15d6d69219a5185a4"
Jul 29 09:35:41.072255 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.072223    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:35:41.076045 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.076016    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/auth-test-model-0abb48-kserve-6544d444ff-xczn2"]
Jul 29 09:35:41.148761 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148724    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.148994 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148800    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.148994 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.148994 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.148994 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.148994 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.148968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67wwv\" (UniqueName: \"kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv\") pod \"33849953-278a-4e0e-87af-758e6225d2ae\" (UID: \"33849953-278a-4e0e-87af-758e6225d2ae\") "
Jul 29 09:35:41.149262 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149104    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home" (OuterVolumeSpecName: "home") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:41.149262 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:41.149262 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149226    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:41.149416 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149326    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.149416 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149340    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.149416 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.149349    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.151244 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.151215    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm" (OuterVolumeSpecName: "dshm") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:35:41.151244 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.151232    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:35:41.151421 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.151282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv" (OuterVolumeSpecName: "kube-api-access-67wwv") pod "33849953-278a-4e0e-87af-758e6225d2ae" (UID: "33849953-278a-4e0e-87af-758e6225d2ae"). InnerVolumeSpecName "kube-api-access-67wwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:35:41.250871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.250785    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33849953-278a-4e0e-87af-758e6225d2ae-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.250871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.250814    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33849953-278a-4e0e-87af-758e6225d2ae-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.250871 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.250827    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67wwv\" (UniqueName: \"kubernetes.io/projected/33849953-278a-4e0e-87af-758e6225d2ae-kube-api-access-67wwv\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:35:41.382915 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.382865    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:35:41.385464 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:41.385440    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/auth-test-model-27430b-kserve-7c9fcc47bc-bs7z9"]
Jul 29 09:35:42.645125 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:42.645093    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33849953-278a-4e0e-87af-758e6225d2ae" path="/var/lib/kubelet/pods/33849953-278a-4e0e-87af-758e6225d2ae/volumes"
Jul 29 09:35:42.645546 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:35:42.645533    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" path="/var/lib/kubelet/pods/c54f0233-0c57-4f9e-a947-aa8eca3cf0de/volumes"
Jul 29 09:36:09.511142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.511092    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:36:09.511848 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.511825    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33849953-278a-4e0e-87af-758e6225d2ae" containerName="main"
Jul 29 09:36:09.511925 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.511850    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33849953-278a-4e0e-87af-758e6225d2ae" containerName="main"
Jul 29 09:36:09.511925 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.511869    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" containerName="main"
Jul 29 09:36:09.511925 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.511879    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" containerName="main"
Jul 29 09:36:09.512032 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.512019    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54f0233-0c57-4f9e-a947-aa8eca3cf0de" containerName="main"
Jul 29 09:36:09.512066 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.512032    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33849953-278a-4e0e-87af-758e6225d2ae" containerName="main"
Jul 29 09:36:09.517022 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.516994    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.519678 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.519655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"kube-root-ca.crt\""
Jul 29 09:36:09.519942 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.519702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"default-dockercfg-rlw7g\""
Jul 29 09:36:09.520343 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.520317    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"openshift-service-ca.crt\""
Jul 29 09:36:09.520453 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.520363    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"sub-test-model-27430b-kserve-self-signed-certs\""
Jul 29 09:36:09.521341 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.521317    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:36:09.614154 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.614329 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.614329 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.614329 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8zf2\" (UniqueName: \"kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.614329 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.614482 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.614336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715379 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715600 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715600 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8zf2\" (UniqueName: \"kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715600 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715600 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.715983 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.715878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.716023 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.716010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.717751 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.717732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.718187 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.718167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.723738 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.723716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8zf2\" (UniqueName: \"kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2\") pod \"sub-test-model-27430b-kserve-75969d5ccf-5prt9\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") " pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.831373 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.831299    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:09.969141 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:09.969052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:36:09.972252 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:36:09.972219    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3049114_ed49_4369_abb2_ba925db7b104.slice/crio-8ae9b6f68cdb1a8b55ebfa692025a488f6e2589632874cb9e6e3a5000da9ed37 WatchSource:0}: Error finding container 8ae9b6f68cdb1a8b55ebfa692025a488f6e2589632874cb9e6e3a5000da9ed37: Status 404 returned error can't find the container with id 8ae9b6f68cdb1a8b55ebfa692025a488f6e2589632874cb9e6e3a5000da9ed37
Jul 29 09:36:10.227510 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:10.227473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" event={"ID":"e3049114-ed49-4369-abb2-ba925db7b104","Type":"ContainerStarted","Data":"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"}
Jul 29 09:36:10.227675 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:10.227520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" event={"ID":"e3049114-ed49-4369-abb2-ba925db7b104","Type":"ContainerStarted","Data":"8ae9b6f68cdb1a8b55ebfa692025a488f6e2589632874cb9e6e3a5000da9ed37"}
Jul 29 09:36:10.244198 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:10.244147    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" podStartSLOduration=1.244130562 podStartE2EDuration="1.244130562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:36:10.243002713 +0000 UTC m=+2908.215145585" watchObservedRunningTime="2026-07-29 09:36:10.244130562 +0000 UTC m=+2908.216273437"
Jul 29 09:36:19.832415 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:19.832376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:19.832415 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:19.832424    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:19.845186 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:19.845159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:36:20.307098 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:36:20.307067    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:37:31.325264 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:31.325227    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:37:40.742662 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.742577    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:37:40.746566 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.746542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.749748 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.749723    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"kube-root-ca.crt\""
Jul 29 09:37:40.751944 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.751919    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"default-dockercfg-4b4wf\""
Jul 29 09:37:40.752078 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.751949    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"openshift-service-ca.crt\""
Jul 29 09:37:40.752078 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.752005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0abb48\"/\"rate-test-model-0abb48-kserve-self-signed-certs\""
Jul 29 09:37:40.765575 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.765549    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:37:40.801010 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.800981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.801170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.801016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.801170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.801056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.801170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.801116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.801170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.801156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgc89\" (UniqueName: \"kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.801307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.801186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902031 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.901996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902031 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902261 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902261 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902261 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgc89\" (UniqueName: \"kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902261 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902493 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902570 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.902629 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.902567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.904298 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.904263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.904576 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.904559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:40.910789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:40.910759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgc89\" (UniqueName: \"kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89\") pod \"rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") " pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:41.056377 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:41.056217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:41.196936 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:41.196883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:37:41.198402 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:37:41.198376    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod726fa7ec_6f72_4e12_8ae3_568d1acc768d.slice/crio-5d6e2e83f9ed7a0de1ad6795830f66bd101e415cebec9865fb630752e63507a0 WatchSource:0}: Error finding container 5d6e2e83f9ed7a0de1ad6795830f66bd101e415cebec9865fb630752e63507a0: Status 404 returned error can't find the container with id 5d6e2e83f9ed7a0de1ad6795830f66bd101e415cebec9865fb630752e63507a0
Jul 29 09:37:41.782019 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:41.781970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" event={"ID":"726fa7ec-6f72-4e12-8ae3-568d1acc768d","Type":"ContainerStarted","Data":"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"}
Jul 29 09:37:41.782463 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:41.782035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" event={"ID":"726fa7ec-6f72-4e12-8ae3-568d1acc768d","Type":"ContainerStarted","Data":"5d6e2e83f9ed7a0de1ad6795830f66bd101e415cebec9865fb630752e63507a0"}
Jul 29 09:37:41.798998 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:41.798944    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" podStartSLOduration=1.798929857 podStartE2EDuration="1.798929857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:37:41.798349453 +0000 UTC m=+2999.770492329" watchObservedRunningTime="2026-07-29 09:37:41.798929857 +0000 UTC m=+2999.771072731"
Jul 29 09:37:42.812814 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:42.812786    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:37:42.823803 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:42.823780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:37:46.347223 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.347173    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" podUID="e3049114-ed49-4369-abb2-ba925db7b104" containerName="main" containerID="cri-o://5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529" gracePeriod=45
Jul 29 09:37:46.604921 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.604815    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:37:46.759979 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.759936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.759979 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.759986    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.760246 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760086    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.760246 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760186    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.760357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8zf2\" (UniqueName: \"kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.760357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm\") pod \"e3049114-ed49-4369-abb2-ba925db7b104\" (UID: \"e3049114-ed49-4369-abb2-ba925db7b104\") "
Jul 29 09:37:46.760357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760311    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache" (OuterVolumeSpecName: "model-cache") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:37:46.760511 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760358    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:37:46.760511 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760433    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home" (OuterVolumeSpecName: "home") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:37:46.760700 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760679    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:46.760773 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760704    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:46.760773 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.760718    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:46.762361 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.762335    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:37:46.762489 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.762381    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2" (OuterVolumeSpecName: "kube-api-access-b8zf2") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "kube-api-access-b8zf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:37:46.762688 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.762665    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm" (OuterVolumeSpecName: "dshm") pod "e3049114-ed49-4369-abb2-ba925db7b104" (UID: "e3049114-ed49-4369-abb2-ba925db7b104"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:37:46.814088 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.814050    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3049114-ed49-4369-abb2-ba925db7b104" containerID="5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529" exitCode=0
Jul 29 09:37:46.814297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.814106    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"
Jul 29 09:37:46.814297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.814142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" event={"ID":"e3049114-ed49-4369-abb2-ba925db7b104","Type":"ContainerDied","Data":"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"}
Jul 29 09:37:46.814297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.814203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9" event={"ID":"e3049114-ed49-4369-abb2-ba925db7b104","Type":"ContainerDied","Data":"8ae9b6f68cdb1a8b55ebfa692025a488f6e2589632874cb9e6e3a5000da9ed37"}
Jul 29 09:37:46.814297 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.814222    2573 scope.go:117] "RemoveContainer" containerID="5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"
Jul 29 09:37:46.824599 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.824579    2573 scope.go:117] "RemoveContainer" containerID="5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"
Jul 29 09:37:46.824839 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:37:46.824821    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529\": container with ID starting with 5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529 not found: ID does not exist" containerID="5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"
Jul 29 09:37:46.824882 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.824847    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529"} err="failed to get container status \"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529\": rpc error: code = NotFound desc = could not find container \"5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529\": container with ID starting with 5b6d808f1d0ef4337701f4ad325c0a17badca3a8d0a68ce8163888de811b0529 not found: ID does not exist"
Jul 29 09:37:46.835954 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.835930    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:37:46.839647 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.839620    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/sub-test-model-27430b-kserve-75969d5ccf-5prt9"]
Jul 29 09:37:46.862370 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.862291    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8zf2\" (UniqueName: \"kubernetes.io/projected/e3049114-ed49-4369-abb2-ba925db7b104-kube-api-access-b8zf2\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:46.862370 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.862329    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3049114-ed49-4369-abb2-ba925db7b104-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:46.862370 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:46.862348    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3049114-ed49-4369-abb2-ba925db7b104-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:37:48.646195 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:48.646162    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3049114-ed49-4369-abb2-ba925db7b104" path="/var/lib/kubelet/pods/e3049114-ed49-4369-abb2-ba925db7b104/volumes"
Jul 29 09:37:51.056677 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:51.056635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:51.056677 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:51.056685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:51.069838 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:51.069810    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:51.855268 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:51.855241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:37:57.525309 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.525267    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:37:57.525861 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.525842    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3049114-ed49-4369-abb2-ba925db7b104" containerName="main"
Jul 29 09:37:57.525988 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.525864    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3049114-ed49-4369-abb2-ba925db7b104" containerName="main"
Jul 29 09:37:57.525988 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.525967    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3049114-ed49-4369-abb2-ba925db7b104" containerName="main"
Jul 29 09:37:57.529822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.529802    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.532707 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.532535    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"kube-root-ca.crt\""
Jul 29 09:37:57.532707 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.532535    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"rate-test-model-27430b-kserve-self-signed-certs\""
Jul 29 09:37:57.532707 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.532539    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"default-dockercfg-rlw7g\""
Jul 29 09:37:57.532707 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.532611    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27430b\"/\"openshift-service-ca.crt\""
Jul 29 09:37:57.538138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.538113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:37:57.575953 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.575886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.576142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.575963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.576142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.576063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpvt\" (UniqueName: \"kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.576142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.576102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.576142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.576120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.576142 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.576138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677229 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpvt\" (UniqueName: \"kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677437    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677663 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677726 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.677783 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.677754    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.679503 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.679482    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.679999 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.679976    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.687836 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.687808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpvt\" (UniqueName: \"kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt\") pod \"rate-test-model-27430b-kserve-559c4784bc-qpwrb\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") " pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.842769 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.842735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:37:57.985883 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:57.985852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:37:57.987228 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:37:57.987198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba6f6608_6d39_480b_9bf1_111bbc40acc0.slice/crio-1ea79daac3163e21bb1cffba7f1427be854be9a33498e3466cb628ea2d50a4cb WatchSource:0}: Error finding container 1ea79daac3163e21bb1cffba7f1427be854be9a33498e3466cb628ea2d50a4cb: Status 404 returned error can't find the container with id 1ea79daac3163e21bb1cffba7f1427be854be9a33498e3466cb628ea2d50a4cb
Jul 29 09:37:58.885357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:58.885321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" event={"ID":"ba6f6608-6d39-480b-9bf1-111bbc40acc0","Type":"ContainerStarted","Data":"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"}
Jul 29 09:37:58.885357 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:58.885364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" event={"ID":"ba6f6608-6d39-480b-9bf1-111bbc40acc0","Type":"ContainerStarted","Data":"1ea79daac3163e21bb1cffba7f1427be854be9a33498e3466cb628ea2d50a4cb"}
Jul 29 09:37:58.901848 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:37:58.901798    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" podStartSLOduration=1.9017831950000001 podStartE2EDuration="1.901783195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:37:58.901400319 +0000 UTC m=+3016.873543194" watchObservedRunningTime="2026-07-29 09:37:58.901783195 +0000 UTC m=+3016.873926105"
Jul 29 09:38:07.843846 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:38:07.843803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:38:07.844378 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:38:07.843881    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:38:07.857543 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:38:07.857507    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:38:07.948713 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:38:07.948684    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:39:06.598578 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:06.598537    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:39:07.606259 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:07.606219    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:39:21.618598 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.618553    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerName="main" containerID="cri-o://028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9" gracePeriod=45
Jul 29 09:39:21.873441 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.873380    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:39:21.904131 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904153    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904196    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgc89\" (UniqueName: \"kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904227    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904243    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904316 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904301    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs\") pod \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\" (UID: \"726fa7ec-6f72-4e12-8ae3-568d1acc768d\") "
Jul 29 09:39:21.904602 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904370    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:21.904602 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904530    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home" (OuterVolumeSpecName: "home") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:21.904602 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904550    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache" (OuterVolumeSpecName: "model-cache") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:21.904770 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904716    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:21.904770 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904737    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:21.904770 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.904751    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:21.906411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.906389    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:39:21.906785 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.906766    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm" (OuterVolumeSpecName: "dshm") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:21.906920 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:21.906781    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89" (OuterVolumeSpecName: "kube-api-access-qgc89") pod "726fa7ec-6f72-4e12-8ae3-568d1acc768d" (UID: "726fa7ec-6f72-4e12-8ae3-568d1acc768d"). InnerVolumeSpecName "kube-api-access-qgc89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:39:22.005716 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.005683    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgc89\" (UniqueName: \"kubernetes.io/projected/726fa7ec-6f72-4e12-8ae3-568d1acc768d-kube-api-access-qgc89\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:22.005716 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.005713    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726fa7ec-6f72-4e12-8ae3-568d1acc768d-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:22.005716 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.005722    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726fa7ec-6f72-4e12-8ae3-568d1acc768d-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:22.382407 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.382370    2573 generic.go:356] "Generic (PLEG): container finished" podID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerID="028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9" exitCode=0
Jul 29 09:39:22.382606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.382425    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"
Jul 29 09:39:22.382606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.382455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" event={"ID":"726fa7ec-6f72-4e12-8ae3-568d1acc768d","Type":"ContainerDied","Data":"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"}
Jul 29 09:39:22.382606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.382503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" event={"ID":"726fa7ec-6f72-4e12-8ae3-568d1acc768d","Type":"ContainerDied","Data":"5d6e2e83f9ed7a0de1ad6795830f66bd101e415cebec9865fb630752e63507a0"}
Jul 29 09:39:22.382606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.382518    2573 scope.go:117] "RemoveContainer" containerID="028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"
Jul 29 09:39:22.392449 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.392431    2573 scope.go:117] "RemoveContainer" containerID="028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"
Jul 29 09:39:22.392693 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:39:22.392673    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9\": container with ID starting with 028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9 not found: ID does not exist" containerID="028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"
Jul 29 09:39:22.392757 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.392705    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9"} err="failed to get container status \"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9\": rpc error: code = NotFound desc = could not find container \"028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9\": container with ID starting with 028dbfaee1b9867475d5b18a7da2d0e9a217d1bc6c60a902144c548944bbe1f9 not found: ID does not exist"
Jul 29 09:39:22.403601 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.403569    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:39:22.407310 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.407291    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2"]
Jul 29 09:39:22.627389 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.627349    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" podUID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" containerName="main" containerID="cri-o://a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4" gracePeriod=45
Jul 29 09:39:22.648348 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.648315    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" path="/var/lib/kubelet/pods/726fa7ec-6f72-4e12-8ae3-568d1acc768d/volumes"
Jul 29 09:39:22.894045 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.894015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:39:22.913584 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.913507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.913807 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.913775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home" (OuterVolumeSpecName: "home") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:22.913954 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.913836    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnpvt\" (UniqueName: \"kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.913954 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.913910    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.914070 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.913955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.914070 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.914010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.914070 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.914048    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm\") pod \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\" (UID: \"ba6f6608-6d39-480b-9bf1-111bbc40acc0\") "
Jul 29 09:39:22.914363 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.914345    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-home\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:22.914492 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.914342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache" (OuterVolumeSpecName: "model-cache") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:22.914637 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.914454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:22.917789 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.917764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:39:22.917962 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.917775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt" (OuterVolumeSpecName: "kube-api-access-wnpvt") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "kube-api-access-wnpvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:39:22.918066 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:22.917957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm" (OuterVolumeSpecName: "dshm") pod "ba6f6608-6d39-480b-9bf1-111bbc40acc0" (UID: "ba6f6608-6d39-480b-9bf1-111bbc40acc0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:39:23.015484 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.015448    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnpvt\" (UniqueName: \"kubernetes.io/projected/ba6f6608-6d39-480b-9bf1-111bbc40acc0-kube-api-access-wnpvt\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:23.015484 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.015483    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tls-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:23.015724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.015496    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-model-cache\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:23.015724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.015510    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-tmp-dir\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:23.015724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.015520    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba6f6608-6d39-480b-9bf1-111bbc40acc0-dshm\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:23.390271 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.390238    2573 generic.go:356] "Generic (PLEG): container finished" podID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" containerID="a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4" exitCode=0
Jul 29 09:39:23.390460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.390282    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"
Jul 29 09:39:23.390460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.390321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" event={"ID":"ba6f6608-6d39-480b-9bf1-111bbc40acc0","Type":"ContainerDied","Data":"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"}
Jul 29 09:39:23.390460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.390370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb" event={"ID":"ba6f6608-6d39-480b-9bf1-111bbc40acc0","Type":"ContainerDied","Data":"1ea79daac3163e21bb1cffba7f1427be854be9a33498e3466cb628ea2d50a4cb"}
Jul 29 09:39:23.390460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.390394    2573 scope.go:117] "RemoveContainer" containerID="a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"
Jul 29 09:39:23.400411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.400390    2573 scope.go:117] "RemoveContainer" containerID="a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"
Jul 29 09:39:23.400677 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:39:23.400658    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4\": container with ID starting with a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4 not found: ID does not exist" containerID="a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"
Jul 29 09:39:23.400724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.400687    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4"} err="failed to get container status \"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4\": rpc error: code = NotFound desc = could not find container \"a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4\": container with ID starting with a816524c4b15d35d93cb76aa24a650c116e0760678b798885f94176c576c34d4 not found: ID does not exist"
Jul 29 09:39:23.413561 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.413532    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:39:23.419237 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:23.419214    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-27430b/rate-test-model-27430b-kserve-559c4784bc-qpwrb"]
Jul 29 09:39:24.152086 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152053    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7783-139681293118464"]
Jul 29 09:39:24.152555 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152540    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerName="main"
Jul 29 09:39:24.152596 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152558    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerName="main"
Jul 29 09:39:24.152596 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152584    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" containerName="main"
Jul 29 09:39:24.152596 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152591    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" containerName="main"
Jul 29 09:39:24.152685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152660    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" containerName="main"
Jul 29 09:39:24.152685 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.152677    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerName="main"
Jul 29 09:39:24.155596 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.155578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:24.158083 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.158058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmth9\""
Jul 29 09:39:24.161290 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.161263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7783-139681293118464"]
Jul 29 09:39:24.227345 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.227314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7c87\" (UniqueName: \"kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87\") pod \"test-curl-7783-139681293118464\" (UID: \"690a5a69-e59c-45b8-ac2a-edabbaec99b3\") " pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:24.328257 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.328221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c87\" (UniqueName: \"kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87\") pod \"test-curl-7783-139681293118464\" (UID: \"690a5a69-e59c-45b8-ac2a-edabbaec99b3\") " pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:24.335848 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.335823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7c87\" (UniqueName: \"kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87\") pod \"test-curl-7783-139681293118464\" (UID: \"690a5a69-e59c-45b8-ac2a-edabbaec99b3\") " pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:24.469279 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.469177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:24.612051 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.612025    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7783-139681293118464"]
Jul 29 09:39:24.613905 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:39:24.613855    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod690a5a69_e59c_45b8_ac2a_edabbaec99b3.slice/crio-e10a02f70604d2ca7610192ff72420c0a4a4e1c19240a55f6d97ed79d3b0ba96 WatchSource:0}: Error finding container e10a02f70604d2ca7610192ff72420c0a4a4e1c19240a55f6d97ed79d3b0ba96: Status 404 returned error can't find the container with id e10a02f70604d2ca7610192ff72420c0a4a4e1c19240a55f6d97ed79d3b0ba96
Jul 29 09:39:24.615323 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.615304    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:39:24.646011 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:24.645984    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6f6608-6d39-480b-9bf1-111bbc40acc0" path="/var/lib/kubelet/pods/ba6f6608-6d39-480b-9bf1-111bbc40acc0/volumes"
Jul 29 09:39:25.405862 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:25.405825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7783-139681293118464" event={"ID":"690a5a69-e59c-45b8-ac2a-edabbaec99b3","Type":"ContainerStarted","Data":"06afd91f97c656829fffc7a4456bcfd009234a5df726d3db05964c04904ed958"}
Jul 29 09:39:25.406311 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:25.405874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7783-139681293118464" event={"ID":"690a5a69-e59c-45b8-ac2a-edabbaec99b3","Type":"ContainerStarted","Data":"e10a02f70604d2ca7610192ff72420c0a4a4e1c19240a55f6d97ed79d3b0ba96"}
Jul 29 09:39:25.422259 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:25.422212    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7783-139681293118464" podStartSLOduration=0.741499414 podStartE2EDuration="1.422197237s" totalImagesPullingTime="680.697823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:25.420959242 +0000 UTC m=+3103.393102120" watchObservedRunningTime="2026-07-29 09:39:25.422197237 +0000 UTC m=+3103.394340129"
Jul 29 09:39:25.529097 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:25.529069    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7783-139681293118464_690a5a69-e59c-45b8-ac2a-edabbaec99b3/test-curl-7783-139681293118464/0.log"
Jul 29 09:39:26.413465 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:26.413427    2573 generic.go:356] "Generic (PLEG): container finished" podID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" containerID="06afd91f97c656829fffc7a4456bcfd009234a5df726d3db05964c04904ed958" exitCode=0
Jul 29 09:39:26.413864 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:26.413465    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7783-139681293118464" event={"ID":"690a5a69-e59c-45b8-ac2a-edabbaec99b3","Type":"ContainerDied","Data":"06afd91f97c656829fffc7a4456bcfd009234a5df726d3db05964c04904ed958"}
Jul 29 09:39:26.844631 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:26.844585    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-0abb48/rate-test-model-0abb48-kserve-d4c5b8c5-hs4l2" podUID="726fa7ec-6f72-4e12-8ae3-568d1acc768d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 29 09:39:27.565266 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.565235    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:27.593637 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.593596    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7783-139681293118464"]
Jul 29 09:39:27.597057 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.597025    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7783-139681293118464"]
Jul 29 09:39:27.661734 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.661695    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7c87\" (UniqueName: \"kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87\") pod \"690a5a69-e59c-45b8-ac2a-edabbaec99b3\" (UID: \"690a5a69-e59c-45b8-ac2a-edabbaec99b3\") "
Jul 29 09:39:27.663971 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.663943    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87" (OuterVolumeSpecName: "kube-api-access-k7c87") pod "690a5a69-e59c-45b8-ac2a-edabbaec99b3" (UID: "690a5a69-e59c-45b8-ac2a-edabbaec99b3"). InnerVolumeSpecName "kube-api-access-k7c87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:39:27.763277 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:27.763189    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7c87\" (UniqueName: \"kubernetes.io/projected/690a5a69-e59c-45b8-ac2a-edabbaec99b3-kube-api-access-k7c87\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:39:28.427508 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:28.427475    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e10a02f70604d2ca7610192ff72420c0a4a4e1c19240a55f6d97ed79d3b0ba96"
Jul 29 09:39:28.427508 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:28.427502    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:28.437355 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:39:28.437328    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-139681293118464\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" pod="opendatahub/test-curl-7783-139681293118464"
Jul 29 09:39:28.644626 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:28.644587    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" path="/var/lib/kubelet/pods/690a5a69-e59c-45b8-ac2a-edabbaec99b3/volumes"
Jul 29 09:39:32.317633 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.317600    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:39:32.318280 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.318256    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" containerName="test-curl-7783-139681293118464"
Jul 29 09:39:32.318280 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.318281    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" containerName="test-curl-7783-139681293118464"
Jul 29 09:39:32.318476 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.318407    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="690a5a69-e59c-45b8-ac2a-edabbaec99b3" containerName="test-curl-7783-139681293118464"
Jul 29 09:39:32.321886 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.321870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.323991 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.323970    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b9d569-dockercfg-p8vhn\""
Jul 29 09:39:32.324101 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.323975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b9d569\""
Jul 29 09:39:32.329831 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.329804    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:39:32.389239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.389206    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:39:32.392802 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.392785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.400995 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.400444    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:39:32.410606 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.410574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.410724 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.410637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brkfb\" (UniqueName: \"kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.512173 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.512136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.512173 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.512175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8s2\" (UniqueName: \"kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.512443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.512206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brkfb\" (UniqueName: \"kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.512443 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.512417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.513170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.513122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.520034 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.520010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brkfb\" (UniqueName: \"kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb\") pod \"payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.613628 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.613589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.613808 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.613634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8s2\" (UniqueName: \"kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.614411 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.614386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.621559 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.621536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8s2\" (UniqueName: \"kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2\") pod \"payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.633376 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.633353    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:32.705863 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.705760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:32.796800 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.796769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:39:32.798208 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:39:32.798181    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5ebdb7_5306_4210_9f59_9b9f8b759e2c.slice/crio-2d68a412c5b515195266bbc1ce5c88ce8d99fd13b10916b0df9747927f5a7a08 WatchSource:0}: Error finding container 2d68a412c5b515195266bbc1ce5c88ce8d99fd13b10916b0df9747927f5a7a08: Status 404 returned error can't find the container with id 2d68a412c5b515195266bbc1ce5c88ce8d99fd13b10916b0df9747927f5a7a08
Jul 29 09:39:32.872868 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:32.872724    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:39:32.875122 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:39:32.875093    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcace6e4d_cae8_4765_accf_ec8617ccfeb7.slice/crio-604c54b4d711284e73fcf72da767fcf9fcce3db81ab29e1e77a51ca9b669998c WatchSource:0}: Error finding container 604c54b4d711284e73fcf72da767fcf9fcce3db81ab29e1e77a51ca9b669998c: Status 404 returned error can't find the container with id 604c54b4d711284e73fcf72da767fcf9fcce3db81ab29e1e77a51ca9b669998c
Jul 29 09:39:33.463065 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.463021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" event={"ID":"cace6e4d-cae8-4765-accf-ec8617ccfeb7","Type":"ContainerStarted","Data":"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"}
Jul 29 09:39:33.463548 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.463091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" event={"ID":"cace6e4d-cae8-4765-accf-ec8617ccfeb7","Type":"ContainerStarted","Data":"604c54b4d711284e73fcf72da767fcf9fcce3db81ab29e1e77a51ca9b669998c"}
Jul 29 09:39:33.463958 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.463932    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:33.465813 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.465781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" event={"ID":"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c","Type":"ContainerStarted","Data":"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"}
Jul 29 09:39:33.465941 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.465831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" event={"ID":"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c","Type":"ContainerStarted","Data":"2d68a412c5b515195266bbc1ce5c88ce8d99fd13b10916b0df9747927f5a7a08"}
Jul 29 09:39:33.466339 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.466319    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:33.479013 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.478965    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" podStartSLOduration=1.478946063 podStartE2EDuration="1.478946063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:33.478169931 +0000 UTC m=+3111.450312807" watchObservedRunningTime="2026-07-29 09:39:33.478946063 +0000 UTC m=+3111.451088939"
Jul 29 09:39:33.493489 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:33.493434    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" podStartSLOduration=1.493415105 podStartE2EDuration="1.493415105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:33.492189619 +0000 UTC m=+3111.464332493" watchObservedRunningTime="2026-07-29 09:39:33.493415105 +0000 UTC m=+3111.465557982"
Jul 29 09:39:45.482145 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:45.482099    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:39:45.482530 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:45.482179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:39:57.556726 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.556679    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:39:57.562494 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.562469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.564882 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.564860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-150c68-openshift-default-dockercfg-zr5wj\""
Jul 29 09:39:57.574463 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.574434    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:39:57.652239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgmf\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652460 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652620 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.652620 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.652560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753439 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753439 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgmf\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.753709 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754084 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.753994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754299 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.754163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.754547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.754526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.756050 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.756029    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.756263 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.756246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.761527 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.761495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.761640 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.761614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgmf\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf\") pod \"e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") " pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:57.877734 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:57.877694    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:58.027570 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.027543    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:39:58.028476 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:39:58.028452    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8eba8aa_66ea_4d87_9cfe_2ae90bb7a32d.slice/crio-e423fafe2db5eee32192ac40050628eb5d33610a4ff3f401cd54ceab7abb76e9 WatchSource:0}: Error finding container e423fafe2db5eee32192ac40050628eb5d33610a4ff3f401cd54ceab7abb76e9: Status 404 returned error can't find the container with id e423fafe2db5eee32192ac40050628eb5d33610a4ff3f401cd54ceab7abb76e9
Jul 29 09:39:58.030698 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.030667    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:39:58.030796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.030737    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:39:58.030796 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.030767    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:39:58.627513 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.627472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerStarted","Data":"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"}
Jul 29 09:39:58.627944 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.627543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerStarted","Data":"e423fafe2db5eee32192ac40050628eb5d33610a4ff3f401cd54ceab7abb76e9"}
Jul 29 09:39:58.647408 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.647357    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podStartSLOduration=1.647341585 podStartE2EDuration="1.647341585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:58.645307388 +0000 UTC m=+3136.617450263" watchObservedRunningTime="2026-07-29 09:39:58.647341585 +0000 UTC m=+3136.619484456"
Jul 29 09:39:58.878478 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:58.878391    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:39:59.883558 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:39:59.883524    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:00.646364 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:00.646332    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:00.646574 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:00.646422    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:16.682120 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:16.682073    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 09:40:16.682535 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:16.682170    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 09:40:18.753002 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.752967    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerID="c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532" exitCode=0
Jul 29 09:40:18.753419 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.753035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerDied","Data":"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"}
Jul 29 09:40:18.753467 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.753444    2573 scope.go:117] "RemoveContainer" containerID="c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"
Jul 29 09:40:18.754547 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.754517    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:40:18.754640 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.754585    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:40:18.754640 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:18.754620    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 09:40:19.762138 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:19.762101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerStarted","Data":"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"}
Jul 29 09:40:19.878663 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:19.878633    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:19.878821 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:19.878786    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 09:40:19.878864 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:19.878832    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 09:40:20.878275 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:20.878231    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 09:40:20.878779 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:20.878301    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 09:40:21.878624 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:21.878583    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 09:40:21.879255 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:21.879221    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 09:40:22.882049 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:22.882004    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 09:40:22.882561 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:22.882076    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 09:40:23.879086 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:23.879046    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Jul 29 09:40:23.879433 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:23.879400    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Jul 29 09:40:24.882630 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:24.882588    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:24.883144 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:24.883001    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:24.883717 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:24.883685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:40:32.389501 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:40:32.389470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:41:22.331538 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:22.331500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj_cc5ebdb7-5306-4210-9f59-9b9f8b759e2c/payload-processing/0.log"
Jul 29 09:41:22.450146 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:22.450114    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:41:26.121082 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.121037    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:26.126120 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.126094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.128495 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.128473    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-82acc2-serving-cert\""
Jul 29 09:41:26.137055 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.137028    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:26.226415 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.226377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.226415 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.226415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.226773 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.226437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jws4\" (UniqueName: \"kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.327390 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.327351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.327390 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.327393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.327677 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.327415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jws4\" (UniqueName: \"kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.327677 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:41:26.327561    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-serving-cert: secret "maas-api-e2e-ipp-cleanup-82acc2-serving-cert" not found
Jul 29 09:41:26.327677 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:41:26.327674    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls podName:8eca8004-fd80-4d7b-a79f-3d6edb1730f3 nodeName:}" failed. No retries permitted until 2026-07-29 09:41:26.827651742 +0000 UTC m=+3224.799794609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" (UID: "8eca8004-fd80-4d7b-a79f-3d6edb1730f3") : secret "maas-api-e2e-ipp-cleanup-82acc2-serving-cert" not found
Jul 29 09:41:26.328102 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.328083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.338135 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.338114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jws4\" (UniqueName: \"kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.832540 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.832504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:26.835056 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:26.835027    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:27.040822 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:27.040782    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:27.402137 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:27.402106    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:27.403184 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:41:27.403151    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eca8004_fd80_4d7b_a79f_3d6edb1730f3.slice/crio-2d14ba176f12026fbaebcd2c9b946033e1bfefddedbb0dc8dd6454a93fbf93d9 WatchSource:0}: Error finding container 2d14ba176f12026fbaebcd2c9b946033e1bfefddedbb0dc8dd6454a93fbf93d9: Status 404 returned error can't find the container with id 2d14ba176f12026fbaebcd2c9b946033e1bfefddedbb0dc8dd6454a93fbf93d9
Jul 29 09:41:28.201533 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:28.201441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" event={"ID":"8eca8004-fd80-4d7b-a79f-3d6edb1730f3","Type":"ContainerStarted","Data":"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"}
Jul 29 09:41:28.201533 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:28.201509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:28.201533 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:28.201527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" event={"ID":"8eca8004-fd80-4d7b-a79f-3d6edb1730f3","Type":"ContainerStarted","Data":"2d14ba176f12026fbaebcd2c9b946033e1bfefddedbb0dc8dd6454a93fbf93d9"}
Jul 29 09:41:28.218979 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:28.218923    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" podStartSLOduration=1.7197111139999999 podStartE2EDuration="2.218907789s" totalImagesPullingTime="499.196675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:41:28.217541699 +0000 UTC m=+3226.189684575" watchObservedRunningTime="2026-07-29 09:41:28.218907789 +0000 UTC m=+3226.191050654"
Jul 29 09:41:34.213427 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:34.213390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:51.688247 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.688212    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"]
Jul 29 09:41:51.692352 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.692335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:51.694598 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.694577    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:41:51.701536 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.700548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"]
Jul 29 09:41:51.791470 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.791433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5\" (UID: \"24204c52-b9e5-4a33-8568-affeb4dbdbc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:51.892850 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.892813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5\" (UID: \"24204c52-b9e5-4a33-8568-affeb4dbdbc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:51.893753 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:51.893723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5\" (UID: \"24204c52-b9e5-4a33-8568-affeb4dbdbc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:52.005225 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:52.005142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:52.146428 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:52.146394    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"]
Jul 29 09:41:52.148590 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:41:52.148564    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24204c52_b9e5_4a33_8568_affeb4dbdbc1.slice/crio-03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7 WatchSource:0}: Error finding container 03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7: Status 404 returned error can't find the container with id 03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7
Jul 29 09:41:52.352156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:52.352124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5" event={"ID":"24204c52-b9e5-4a33-8568-affeb4dbdbc1","Type":"ContainerStarted","Data":"03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7"}
Jul 29 09:41:53.360169 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:53.360135    2573 generic.go:356] "Generic (PLEG): container finished" podID="24204c52-b9e5-4a33-8568-affeb4dbdbc1" containerID="fbd780c64541feaae43bb54899fe9915ad44899951af627438079cf6b75d24bc" exitCode=0
Jul 29 09:41:53.360562 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:53.360218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5" event={"ID":"24204c52-b9e5-4a33-8568-affeb4dbdbc1","Type":"ContainerDied","Data":"fbd780c64541feaae43bb54899fe9915ad44899951af627438079cf6b75d24bc"}
Jul 29 09:41:54.518823 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:54.518792    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:54.620251 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:54.620222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca\") pod \"24204c52-b9e5-4a33-8568-affeb4dbdbc1\" (UID: \"24204c52-b9e5-4a33-8568-affeb4dbdbc1\") "
Jul 29 09:41:54.620571 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:54.620551    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24204c52-b9e5-4a33-8568-affeb4dbdbc1" (UID: "24204c52-b9e5-4a33-8568-affeb4dbdbc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:41:54.721169 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:54.721131    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24204c52-b9e5-4a33-8568-affeb4dbdbc1-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:41:55.375296 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:55.375256    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"
Jul 29 09:41:55.375500 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:55.375305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5" event={"ID":"24204c52-b9e5-4a33-8568-affeb4dbdbc1","Type":"ContainerDied","Data":"03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7"}
Jul 29 09:41:55.375500 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:55.375358    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03c88f225640b416cd6b6496121fc7ea4d4c6b7bd9be299367586ababd824eb7"
Jul 29 09:41:56.985044 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:56.985000    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:56.985557 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:56.985278    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" podUID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" containerName="maas-api" containerID="cri-o://d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484" gracePeriod=30
Jul 29 09:41:57.199417 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.199378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"]
Jul 29 09:41:57.204340 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.204309    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-82acc2-qp2l5"]
Jul 29 09:41:57.255588 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.255559    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:57.344589 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.344556    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca\") pod \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") "
Jul 29 09:41:57.344777 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.344761    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jws4\" (UniqueName: \"kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4\") pod \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") "
Jul 29 09:41:57.344848 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.344816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") pod \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\" (UID: \"8eca8004-fd80-4d7b-a79f-3d6edb1730f3\") "
Jul 29 09:41:57.345014 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.344984    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8eca8004-fd80-4d7b-a79f-3d6edb1730f3" (UID: "8eca8004-fd80-4d7b-a79f-3d6edb1730f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:41:57.345178 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.345159    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-openshift-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:41:57.347125 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.347093    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8eca8004-fd80-4d7b-a79f-3d6edb1730f3" (UID: "8eca8004-fd80-4d7b-a79f-3d6edb1730f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:41:57.347256 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.347173    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4" (OuterVolumeSpecName: "kube-api-access-2jws4") pod "8eca8004-fd80-4d7b-a79f-3d6edb1730f3" (UID: "8eca8004-fd80-4d7b-a79f-3d6edb1730f3"). InnerVolumeSpecName "kube-api-access-2jws4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:41:57.389322 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.389287    2573 generic.go:356] "Generic (PLEG): container finished" podID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" containerID="d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484" exitCode=0
Jul 29 09:41:57.389486 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.389353    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"
Jul 29 09:41:57.389486 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.389378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" event={"ID":"8eca8004-fd80-4d7b-a79f-3d6edb1730f3","Type":"ContainerDied","Data":"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"}
Jul 29 09:41:57.389486 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.389454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2" event={"ID":"8eca8004-fd80-4d7b-a79f-3d6edb1730f3","Type":"ContainerDied","Data":"2d14ba176f12026fbaebcd2c9b946033e1bfefddedbb0dc8dd6454a93fbf93d9"}
Jul 29 09:41:57.389486 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.389477    2573 scope.go:117] "RemoveContainer" containerID="d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"
Jul 29 09:41:57.399341 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.399323    2573 scope.go:117] "RemoveContainer" containerID="d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"
Jul 29 09:41:57.399595 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:41:57.399579    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484\": container with ID starting with d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484 not found: ID does not exist" containerID="d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"
Jul 29 09:41:57.399639 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.399601    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484"} err="failed to get container status \"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484\": rpc error: code = NotFound desc = could not find container \"d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484\": container with ID starting with d52bc18ef50e8dbcb6c93f4b53518f336561b66d57753f7c529fd6eed0f72484 not found: ID does not exist"
Jul 29 09:41:57.411514 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.411486    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:57.415390 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.415368    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-82acc2-6f7f9bf5d4-zh5j2"]
Jul 29 09:41:57.446427 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.446392    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jws4\" (UniqueName: \"kubernetes.io/projected/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-kube-api-access-2jws4\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:41:57.446427 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:57.446421    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eca8004-fd80-4d7b-a79f-3d6edb1730f3-maas-api-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:41:58.645687 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:58.645651    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24204c52-b9e5-4a33-8568-affeb4dbdbc1" path="/var/lib/kubelet/pods/24204c52-b9e5-4a33-8568-affeb4dbdbc1/volumes"
Jul 29 09:41:58.646215 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:41:58.646113    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" path="/var/lib/kubelet/pods/8eca8004-fd80-4d7b-a79f-3d6edb1730f3/volumes"
Jul 29 09:42:07.131657 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.131625    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"]
Jul 29 09:42:07.132143 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132128    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" containerName="maas-api"
Jul 29 09:42:07.132143 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132144    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" containerName="maas-api"
Jul 29 09:42:07.132219 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132157    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24204c52-b9e5-4a33-8568-affeb4dbdbc1" containerName="revoke-keys"
Jul 29 09:42:07.132219 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132162    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24204c52-b9e5-4a33-8568-affeb4dbdbc1" containerName="revoke-keys"
Jul 29 09:42:07.132285 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132230    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24204c52-b9e5-4a33-8568-affeb4dbdbc1" containerName="revoke-keys"
Jul 29 09:42:07.132285 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.132242    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eca8004-fd80-4d7b-a79f-3d6edb1730f3" containerName="maas-api"
Jul 29 09:42:07.135472 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.135453    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:07.137514 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.137490    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:42:07.142698 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.142670    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"]
Jul 29 09:42:07.238758 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.238722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn\" (UID: \"16ce978a-5305-4425-8321-23e798c23520\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:07.340148 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.340110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn\" (UID: \"16ce978a-5305-4425-8321-23e798c23520\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:07.340775 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.340755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn\" (UID: \"16ce978a-5305-4425-8321-23e798c23520\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:07.449421 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.449335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:07.801530 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:07.801499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"]
Jul 29 09:42:07.803688 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:42:07.803664    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ce978a_5305_4425_8321_23e798c23520.slice/crio-6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908 WatchSource:0}: Error finding container 6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908: Status 404 returned error can't find the container with id 6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908
Jul 29 09:42:08.456046 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:08.456001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn" event={"ID":"16ce978a-5305-4425-8321-23e798c23520","Type":"ContainerStarted","Data":"a7e96da136a597b076841c48afa49b2f6bf5bf5b67cb1544d900016e43d519e5"}
Jul 29 09:42:08.456513 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:08.456069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn" event={"ID":"16ce978a-5305-4425-8321-23e798c23520","Type":"ContainerStarted","Data":"6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908"}
Jul 29 09:42:08.471837 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:08.471786    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn" podStartSLOduration=1.471770592 podStartE2EDuration="1.471770592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:42:08.470638144 +0000 UTC m=+3266.442781021" watchObservedRunningTime="2026-07-29 09:42:08.471770592 +0000 UTC m=+3266.443913496"
Jul 29 09:42:09.463948 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:09.463879    2573 generic.go:356] "Generic (PLEG): container finished" podID="16ce978a-5305-4425-8321-23e798c23520" containerID="a7e96da136a597b076841c48afa49b2f6bf5bf5b67cb1544d900016e43d519e5" exitCode=0
Jul 29 09:42:09.464403 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:09.463950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn" event={"ID":"16ce978a-5305-4425-8321-23e798c23520","Type":"ContainerDied","Data":"a7e96da136a597b076841c48afa49b2f6bf5bf5b67cb1544d900016e43d519e5"}
Jul 29 09:42:10.622663 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:10.622636    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:10.673369 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:10.673330    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca\") pod \"16ce978a-5305-4425-8321-23e798c23520\" (UID: \"16ce978a-5305-4425-8321-23e798c23520\") "
Jul 29 09:42:10.673753 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:10.673728    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "16ce978a-5305-4425-8321-23e798c23520" (UID: "16ce978a-5305-4425-8321-23e798c23520"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:42:10.775107 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:10.775014    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce978a-5305-4425-8321-23e798c23520-maas-api-service-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:42:11.479025 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:11.478997    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"
Jul 29 09:42:11.479212 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:11.479038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn" event={"ID":"16ce978a-5305-4425-8321-23e798c23520","Type":"ContainerDied","Data":"6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908"}
Jul 29 09:42:11.479212 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:11.479082    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6723989a7caa3828974f162eeed0af06caafe8bbf86ad2667b33db329a132908"
Jul 29 09:42:22.691452 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.690492    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:42:22.691452 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.690741    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" podUID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" containerName="payload-processing" containerID="cri-o://18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47" gracePeriod=30
Jul 29 09:42:22.699810 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.699777    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:42:22.700124 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.700072    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" podUID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" containerName="payload-pre-processing" containerID="cri-o://2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1" gracePeriod=30
Jul 29 09:42:22.848277 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.848239    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"]
Jul 29 09:42:22.852682 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.852645    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b9d569-69vwn"]
Jul 29 09:42:22.974036 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:22.974010    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:42:23.016245 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.016219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:42:23.094221 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094185    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x8s2\" (UniqueName: \"kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2\") pod \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") "
Jul 29 09:42:23.094389 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume\") pod \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\" (UID: \"cace6e4d-cae8-4765-accf-ec8617ccfeb7\") "
Jul 29 09:42:23.094389 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094265    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brkfb\" (UniqueName: \"kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb\") pod \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") "
Jul 29 09:42:23.094389 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume\") pod \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\" (UID: \"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c\") "
Jul 29 09:42:23.094802 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094765    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cace6e4d-cae8-4765-accf-ec8617ccfeb7" (UID: "cace6e4d-cae8-4765-accf-ec8617ccfeb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:42:23.094802 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.094791    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" (UID: "cc5ebdb7-5306-4210-9f59-9b9f8b759e2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:42:23.096961 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.096936    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2" (OuterVolumeSpecName: "kube-api-access-4x8s2") pod "cace6e4d-cae8-4765-accf-ec8617ccfeb7" (UID: "cace6e4d-cae8-4765-accf-ec8617ccfeb7"). InnerVolumeSpecName "kube-api-access-4x8s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:42:23.096961 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.096947    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb" (OuterVolumeSpecName: "kube-api-access-brkfb") pod "cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" (UID: "cc5ebdb7-5306-4210-9f59-9b9f8b759e2c"). InnerVolumeSpecName "kube-api-access-brkfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:42:23.195947 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.195885    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.195947 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.195940    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x8s2\" (UniqueName: \"kubernetes.io/projected/cace6e4d-cae8-4765-accf-ec8617ccfeb7-kube-api-access-4x8s2\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.195947 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.195949    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cace6e4d-cae8-4765-accf-ec8617ccfeb7-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.196170 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.195958    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brkfb\" (UniqueName: \"kubernetes.io/projected/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c-kube-api-access-brkfb\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.551803 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.551763    2573 generic.go:356] "Generic (PLEG): container finished" podID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" containerID="2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1" exitCode=0
Jul 29 09:42:23.552040 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.551809    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"
Jul 29 09:42:23.552040 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.551847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" event={"ID":"cace6e4d-cae8-4765-accf-ec8617ccfeb7","Type":"ContainerDied","Data":"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"}
Jul 29 09:42:23.552040 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.551929    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj" event={"ID":"cace6e4d-cae8-4765-accf-ec8617ccfeb7","Type":"ContainerDied","Data":"604c54b4d711284e73fcf72da767fcf9fcce3db81ab29e1e77a51ca9b669998c"}
Jul 29 09:42:23.552040 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.551960    2573 scope.go:117] "RemoveContainer" containerID="2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"
Jul 29 09:42:23.553360 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.553334    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" containerID="18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47" exitCode=0
Jul 29 09:42:23.553473 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.553366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" event={"ID":"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c","Type":"ContainerDied","Data":"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"}
Jul 29 09:42:23.553473 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.553428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj" event={"ID":"cc5ebdb7-5306-4210-9f59-9b9f8b759e2c","Type":"ContainerDied","Data":"2d68a412c5b515195266bbc1ce5c88ce8d99fd13b10916b0df9747927f5a7a08"}
Jul 29 09:42:23.553473 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.553379    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"
Jul 29 09:42:23.566240 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.566224    2573 scope.go:117] "RemoveContainer" containerID="2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"
Jul 29 09:42:23.566493 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:42:23.566467    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1\": container with ID starting with 2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1 not found: ID does not exist" containerID="2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"
Jul 29 09:42:23.566599 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.566498    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1"} err="failed to get container status \"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1\": rpc error: code = NotFound desc = could not find container \"2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1\": container with ID starting with 2b4bda14e79e60c49fc76de00c434e1261ff674a95dea929b2b4ae67b3670af1 not found: ID does not exist"
Jul 29 09:42:23.566599 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.566520    2573 scope.go:117] "RemoveContainer" containerID="18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"
Jul 29 09:42:23.576883 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.576866    2573 scope.go:117] "RemoveContainer" containerID="18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"
Jul 29 09:42:23.577172 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:42:23.577154    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47\": container with ID starting with 18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47 not found: ID does not exist" containerID="18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"
Jul 29 09:42:23.577239 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.577180    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47"} err="failed to get container status \"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47\": rpc error: code = NotFound desc = could not find container \"18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47\": container with ID starting with 18ea8bf65305bfb4901453308fbe32128738f0c208a90bd6a1ef1608080e0c47 not found: ID does not exist"
Jul 29 09:42:23.582418 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.582396    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:42:23.588635 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.588601    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj"]
Jul 29 09:42:23.601763 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.601729    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:42:23.604302 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:23.604278    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj"]
Jul 29 09:42:24.645624 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:24.645589    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ce978a-5305-4425-8321-23e798c23520" path="/var/lib/kubelet/pods/16ce978a-5305-4425-8321-23e798c23520/volumes"
Jul 29 09:42:24.646214 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:24.646192    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" path="/var/lib/kubelet/pods/cace6e4d-cae8-4765-accf-ec8617ccfeb7/volumes"
Jul 29 09:42:24.646609 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:24.646590    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" path="/var/lib/kubelet/pods/cc5ebdb7-5306-4210-9f59-9b9f8b759e2c/volumes"
Jul 29 09:42:42.852211 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:42.852185    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:42:42.864210 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:42:42.864188    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:43:43.422853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:43.422813    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:43:43.423367 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:43.423068    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy" containerID="cri-o://c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379" gracePeriod=30
Jul 29 09:43:48.691243 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.691180    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:43:48.839420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839386    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bgmf\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839500    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839533    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839581    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839616 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839636    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839671    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert\") pod \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\" (UID: \"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d\") "
Jul 29 09:43:48.839981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839776    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:48.839981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.839794    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:48.840160 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.840029    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:48.840160 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.840062    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.840160 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.840084    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-workload-socket\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.840160 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.840142    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:48.840614 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.840586    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:48.841946 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.841912    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:48.842052 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.841954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:43:48.842052 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.842024    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf" (OuterVolumeSpecName: "kube-api-access-4bgmf") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "kube-api-access-4bgmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:48.842134 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.842089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" (UID: "a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:48.940919 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940851    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-token\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.940919 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940882    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-envoy\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.940919 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940908    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-podinfo\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.940919 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940923    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-credential-socket\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.941185 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940934    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istio-data\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.941185 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940947    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-istiod-ca-cert\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:48.941185 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:48.940958    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bgmf\" (UniqueName: \"kubernetes.io/projected/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d-kube-api-access-4bgmf\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:43:49.087128 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.087095    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerID="c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379" exitCode=0
Jul 29 09:43:49.087307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.087145    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"
Jul 29 09:43:49.087307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.087193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerDied","Data":"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"}
Jul 29 09:43:49.087307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.087273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j" event={"ID":"a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d","Type":"ContainerDied","Data":"e423fafe2db5eee32192ac40050628eb5d33610a4ff3f401cd54ceab7abb76e9"}
Jul 29 09:43:49.087307 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.087302    2573 scope.go:117] "RemoveContainer" containerID="c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"
Jul 29 09:43:49.097511 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.097493    2573 scope.go:117] "RemoveContainer" containerID="c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"
Jul 29 09:43:49.106368 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.106349    2573 scope.go:117] "RemoveContainer" containerID="c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"
Jul 29 09:43:49.106646 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:43:49.106626    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379\": container with ID starting with c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379 not found: ID does not exist" containerID="c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"
Jul 29 09:43:49.106719 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.106657    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379"} err="failed to get container status \"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379\": rpc error: code = NotFound desc = could not find container \"c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379\": container with ID starting with c1e54dca62eb9c4d96104c192f7f88682aaf03482e5494c6ef4c91eef2e5a379 not found: ID does not exist"
Jul 29 09:43:49.106719 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.106680    2573 scope.go:117] "RemoveContainer" containerID="c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"
Jul 29 09:43:49.106947 ip-10-0-133-190 kubenswrapper[2573]: E0729 09:43:49.106932    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532\": container with ID starting with c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532 not found: ID does not exist" containerID="c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"
Jul 29 09:43:49.107005 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.106950    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532"} err="failed to get container status \"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532\": rpc error: code = NotFound desc = could not find container \"c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532\": container with ID starting with c26171f5d463626aff9868d1c60eabbe9cb9fba9d83fbf9a0ce3b591baa0b532 not found: ID does not exist"
Jul 29 09:43:49.110872 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.110848    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:43:49.115451 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:49.115425    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j"]
Jul 29 09:43:50.645051 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:43:50.645016    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" path="/var/lib/kubelet/pods/a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d/volumes"
Jul 29 09:44:12.012773 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.012734    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"]
Jul 29 09:44:12.022209 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.022176    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-27430b-29755290-62trf"]
Jul 29 09:44:12.066666 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.066629    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:44:12.066935 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.066883    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" podUID="3468b53b-2eff-410b-926f-47458c021a67" containerName="payload-processing" containerID="cri-o://e48a98aa0631f49ab22048c9b07b4fe4cc1aab872aaa3e9b35e5750dceed98fe" gracePeriod=30
Jul 29 09:44:12.225025 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.224992    2573 generic.go:356] "Generic (PLEG): container finished" podID="3468b53b-2eff-410b-926f-47458c021a67" containerID="e48a98aa0631f49ab22048c9b07b4fe4cc1aab872aaa3e9b35e5750dceed98fe" exitCode=0
Jul 29 09:44:12.225198 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.225070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" event={"ID":"3468b53b-2eff-410b-926f-47458c021a67","Type":"ContainerDied","Data":"e48a98aa0631f49ab22048c9b07b4fe4cc1aab872aaa3e9b35e5750dceed98fe"}
Jul 29 09:44:12.335619 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.335594    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:44:12.454636 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.454603    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume\") pod \"3468b53b-2eff-410b-926f-47458c021a67\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") "
Jul 29 09:44:12.454809 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.454689    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54nqh\" (UniqueName: \"kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh\") pod \"3468b53b-2eff-410b-926f-47458c021a67\" (UID: \"3468b53b-2eff-410b-926f-47458c021a67\") "
Jul 29 09:44:12.455020 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.454996    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3468b53b-2eff-410b-926f-47458c021a67" (UID: "3468b53b-2eff-410b-926f-47458c021a67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:12.456827 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.456782    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh" (OuterVolumeSpecName: "kube-api-access-54nqh") pod "3468b53b-2eff-410b-926f-47458c021a67" (UID: "3468b53b-2eff-410b-926f-47458c021a67"). InnerVolumeSpecName "kube-api-access-54nqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:12.555570 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.555534    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54nqh\" (UniqueName: \"kubernetes.io/projected/3468b53b-2eff-410b-926f-47458c021a67-kube-api-access-54nqh\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.555570 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.555564    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3468b53b-2eff-410b-926f-47458c021a67-plugins-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.649474 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:12.649442    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8331856f-7fe4-4792-bed5-c1e6301ce751" path="/var/lib/kubelet/pods/8331856f-7fe4-4792-bed5-c1e6301ce751/volumes"
Jul 29 09:44:13.232632 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:13.232596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b" event={"ID":"3468b53b-2eff-410b-926f-47458c021a67","Type":"ContainerDied","Data":"dc25acd3edc06df67b187c51f9086f38848a6fcc601b0c45fb54c9f495540c70"}
Jul 29 09:44:13.232632 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:13.232634    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"
Jul 29 09:44:13.233173 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:13.232661    2573 scope.go:117] "RemoveContainer" containerID="e48a98aa0631f49ab22048c9b07b4fe4cc1aab872aaa3e9b35e5750dceed98fe"
Jul 29 09:44:13.249925 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:13.249877    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:44:13.253977 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:13.253947    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b"]
Jul 29 09:44:14.644746 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:14.644717    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3468b53b-2eff-410b-926f-47458c021a67" path="/var/lib/kubelet/pods/3468b53b-2eff-410b-926f-47458c021a67/volumes"
Jul 29 09:44:24.627352 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:24.627314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r9fsr_b47d770a-97bc-40e5-b878-bc2fcb787077/manager/0.log"
Jul 29 09:44:24.743065 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:24.743041    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s8t5r_43eb1f99-cf03-4f6b-8bdd-9dd771a302f4/manager/0.log"
Jul 29 09:44:24.867100 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:24.867066    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-95cc89ddf-7hzfk_ff3d63b7-84bd-4a02-afe7-e4ca63120277/manager/0.log"
Jul 29 09:44:24.972744 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:24.972664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hjgz9_3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7/server/0.log"
Jul 29 09:44:25.084720 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:25.084687    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4qdqs_02fc77ac-50ff-4ab4-9b01-501c1770d014/manager/0.log"
Jul 29 09:44:25.189409 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:25.189380    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-758ck_7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c/copy-manifests/0.log"
Jul 29 09:44:25.206604 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:25.206568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-758ck_7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c/manager/0.log"
Jul 29 09:44:25.767615 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:25.767581    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-84c7dbbd44-spd7j_7fe3cdde-ce75-4e6c-ad5d-7487dac7cf0d/maas-api/0.log"
Jul 29 09:44:25.874450 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:25.874423    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755260-8jz9r_a067c614-886c-43de-8204-df96f9407736/cleanup/0.log"
Jul 29 09:44:26.086102 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:26.086071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755290-g2lk6_760b17ee-e769-4eb2-8c79-2cf29837d210/cleanup/0.log"
Jul 29 09:44:26.193085 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:26.193055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-p9mfn_bdf5f625-1ed1-4e03-9dd0-f9ddbe59c1d2/postgres/0.log"
Jul 29 09:44:26.923185 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:26.923152    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/extract/0.log"
Jul 29 09:44:26.927720 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:26.927699    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/util/0.log"
Jul 29 09:44:26.932556 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:26.932535    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/pull/0.log"
Jul 29 09:44:27.040189 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.040159    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/util/0.log"
Jul 29 09:44:27.045714 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.045684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/pull/0.log"
Jul 29 09:44:27.051234 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.051213    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/extract/0.log"
Jul 29 09:44:27.157121 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.157095    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/util/0.log"
Jul 29 09:44:27.162856 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.162824    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/pull/0.log"
Jul 29 09:44:27.167691 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.167669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/extract/0.log"
Jul 29 09:44:27.276005 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.275928    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/util/0.log"
Jul 29 09:44:27.281100 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.281077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/pull/0.log"
Jul 29 09:44:27.286536 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.286508    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/extract/0.log"
Jul 29 09:44:27.511591 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.511557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pcvzx_3943b20d-0422-4283-9b43-733489c7b6d1/manager/0.log"
Jul 29 09:44:27.617033 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.617005    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qnwtf_c6261e08-8c07-4a22-862a-5ed2c6534c38/manager/0.log"
Jul 29 09:44:27.717412 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.717388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jstc7_4325e682-4382-45e6-9fb0-0041ecb883e6/kuadrant-console-plugin/0.log"
Jul 29 09:44:27.841363 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.841335    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cr8qp_9277a86e-6ace-49d0-a241-c33f168367f2/registry-server/0.log"
Jul 29 09:44:27.960335 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:27.960255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jrg6_3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26/manager/0.log"
Jul 29 09:44:28.186680 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:28.186647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h57d2_0bb85cb3-2f26-4396-9ac7-68cdb7a08f89/manager/0.log"
Jul 29 09:44:28.801285 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:28.801258    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d544f58d6-7sgdg_92ff798b-d1cc-4b66-b0bc-17a925537801/kube-auth-proxy/0.log"
Jul 29 09:44:29.029658 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:29.029619    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/1.log"
Jul 29 09:44:29.146349 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:29.146317    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6bpz9_1dc48f10-8634-452b-b3c5-b05ddd3d5cbb/payload-pre-processing/0.log"
Jul 29 09:44:29.271126 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:29.271092    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:44:29.380947 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:29.380919    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68555bcf85-tdf9s_a4982339-3ff4-407a-80ae-922cfa8cdcbd/router/0.log"
Jul 29 09:44:29.706776 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:29.706742    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r9dpl_d3c42269-67fb-4bd6-99db-6dd56779b097/main/0.log"
Jul 29 09:44:35.858556 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.858473    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dcgtc/must-gather-mnrr4"]
Jul 29 09:44:35.859030 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.858999    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" containerName="payload-processing"
Jul 29 09:44:35.859030 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859013    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" containerName="payload-processing"
Jul 29 09:44:35.859030 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859029    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3468b53b-2eff-410b-926f-47458c021a67" containerName="payload-processing"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859035    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3468b53b-2eff-410b-926f-47458c021a67" containerName="payload-processing"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859048    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859054    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859068    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ce978a-5305-4425-8321-23e798c23520" containerName="revoke-keys"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859076    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ce978a-5305-4425-8321-23e798c23520" containerName="revoke-keys"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859088    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" containerName="payload-pre-processing"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859094    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" containerName="payload-pre-processing"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859102    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.859156 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859108    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859177    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859185    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ce978a-5305-4425-8321-23e798c23520" containerName="revoke-keys"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859194    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3468b53b-2eff-410b-926f-47458c021a67" containerName="payload-processing"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859201    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cace6e4d-cae8-4765-accf-ec8617ccfeb7" containerName="payload-pre-processing"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859208    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5ebdb7-5306-4210-9f59-9b9f8b759e2c" containerName="payload-processing"
Jul 29 09:44:35.859420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.859335    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8eba8aa-66ea-4d87-9cfe-2ae90bb7a32d" containerName="istio-proxy"
Jul 29 09:44:35.862522 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.862499    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:35.865301 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.865280    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcgtc\"/\"kube-root-ca.crt\""
Jul 29 09:44:35.865817 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.865800    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dcgtc\"/\"default-dockercfg-lkspl\""
Jul 29 09:44:35.865902 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.865798    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcgtc\"/\"openshift-service-ca.crt\""
Jul 29 09:44:35.870520 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.870495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/must-gather-mnrr4"]
Jul 29 09:44:35.981808 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.981770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rwb\" (UniqueName: \"kubernetes.io/projected/581240f5-5f98-4253-96bd-100ee667f12a-kube-api-access-k6rwb\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:35.982025 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:35.981880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/581240f5-5f98-4253-96bd-100ee667f12a-must-gather-output\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.082803 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.082754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/581240f5-5f98-4253-96bd-100ee667f12a-must-gather-output\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.083030 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.082849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rwb\" (UniqueName: \"kubernetes.io/projected/581240f5-5f98-4253-96bd-100ee667f12a-kube-api-access-k6rwb\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.083148 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.083126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/581240f5-5f98-4253-96bd-100ee667f12a-must-gather-output\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.092026 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.092006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rwb\" (UniqueName: \"kubernetes.io/projected/581240f5-5f98-4253-96bd-100ee667f12a-kube-api-access-k6rwb\") pod \"must-gather-mnrr4\" (UID: \"581240f5-5f98-4253-96bd-100ee667f12a\") " pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.174447 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.174356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/must-gather-mnrr4"
Jul 29 09:44:36.313146 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.313112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/must-gather-mnrr4"]
Jul 29 09:44:36.313746 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:44:36.313722    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod581240f5_5f98_4253_96bd_100ee667f12a.slice/crio-60ece57fed8d1554bdab55e2d928805eead245e4d4c9b42a6d1f278cb70b8004 WatchSource:0}: Error finding container 60ece57fed8d1554bdab55e2d928805eead245e4d4c9b42a6d1f278cb70b8004: Status 404 returned error can't find the container with id 60ece57fed8d1554bdab55e2d928805eead245e4d4c9b42a6d1f278cb70b8004
Jul 29 09:44:36.315637 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.315620    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:44:36.384334 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:36.384292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/must-gather-mnrr4" event={"ID":"581240f5-5f98-4253-96bd-100ee667f12a","Type":"ContainerStarted","Data":"60ece57fed8d1554bdab55e2d928805eead245e4d4c9b42a6d1f278cb70b8004"}
Jul 29 09:44:37.393971 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:37.393858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/must-gather-mnrr4" event={"ID":"581240f5-5f98-4253-96bd-100ee667f12a","Type":"ContainerStarted","Data":"04d5914dfaffb00e69477d77b36d2f10d7f50c2bdee9c8e22662f620d61454bc"}
Jul 29 09:44:37.393971 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:37.393938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/must-gather-mnrr4" event={"ID":"581240f5-5f98-4253-96bd-100ee667f12a","Type":"ContainerStarted","Data":"d5362e1a24fdfda9b88fc3626c289611fe44bf5ea9b95185258c379c06d52c9a"}
Jul 29 09:44:37.412258 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:37.412198    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dcgtc/must-gather-mnrr4" podStartSLOduration=1.595407867 podStartE2EDuration="2.412175269s" totalImagesPullingTime="816.767402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:44:37.410718079 +0000 UTC m=+3415.382860957" watchObservedRunningTime="2026-07-29 09:44:37.412175269 +0000 UTC m=+3415.384318149"
Jul 29 09:44:38.757468 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:38.757423    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8t5kw_888bb542-8e91-474c-a2c6-9ef7f46aff79/global-pull-secret-syncer/0.log"
Jul 29 09:44:38.947612 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:38.946719    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fdhtb_02bfa28d-d370-4469-a465-08dc6325a13d/konnectivity-agent/0.log"
Jul 29 09:44:39.028771 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:39.028680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-190.ec2.internal_a857da9b944da3ad89aafdae7e77bc36/haproxy/0.log"
Jul 29 09:44:43.784901 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.784852    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/extract/0.log"
Jul 29 09:44:43.811548 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.811489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/util/0.log"
Jul 29 09:44:43.832126 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.832091    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599j7zt_ab1dd62a-eea5-4cbe-9a6a-dad207e0b559/pull/0.log"
Jul 29 09:44:43.859514 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.859473    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/extract/0.log"
Jul 29 09:44:43.880934 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.880901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/util/0.log"
Jul 29 09:44:43.906762 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.906736    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0t5nwx_1d73bbc1-fedc-4bc9-bf95-c5c8d6d13b6b/pull/0.log"
Jul 29 09:44:43.941645 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.941618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/extract/0.log"
Jul 29 09:44:43.963283 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.963229    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/util/0.log"
Jul 29 09:44:43.987841 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:43.987816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rg42m_b7e04cf2-881f-42dc-b632-0d4f8313b704/pull/0.log"
Jul 29 09:44:44.015267 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.015241    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/extract/0.log"
Jul 29 09:44:44.035051 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.034915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/util/0.log"
Jul 29 09:44:44.058268 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.058237    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgxvw_1cb3b2dd-187f-419d-b933-bfaf616e2875/pull/0.log"
Jul 29 09:44:44.449748 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.449714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pcvzx_3943b20d-0422-4283-9b43-733489c7b6d1/manager/0.log"
Jul 29 09:44:44.488360 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.488334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qnwtf_c6261e08-8c07-4a22-862a-5ed2c6534c38/manager/0.log"
Jul 29 09:44:44.524403 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.524354    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jstc7_4325e682-4382-45e6-9fb0-0041ecb883e6/kuadrant-console-plugin/0.log"
Jul 29 09:44:44.593377 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.593337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cr8qp_9277a86e-6ace-49d0-a241-c33f168367f2/registry-server/0.log"
Jul 29 09:44:44.842862 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.842829    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jrg6_3db3f5f5-d8f6-4284-a676-cf3b7e3a7f26/manager/0.log"
Jul 29 09:44:44.984775 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:44.984645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h57d2_0bb85cb3-2f26-4396-9ac7-68cdb7a08f89/manager/0.log"
Jul 29 09:44:46.935270 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:46.935234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4d2dl_4adb981c-2cd5-4d85-a780-9f4dc7017455/node-exporter/0.log"
Jul 29 09:44:46.955100 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:46.955072    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4d2dl_4adb981c-2cd5-4d85-a780-9f4dc7017455/kube-rbac-proxy/0.log"
Jul 29 09:44:46.976612 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:46.976576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4d2dl_4adb981c-2cd5-4d85-a780-9f4dc7017455/init-textfile/0.log"
Jul 29 09:44:47.170053 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.170020    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xfvdk_5205cb49-9d3c-4ef0-ba43-3331fea2175d/kube-rbac-proxy-main/0.log"
Jul 29 09:44:47.192756 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.192667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xfvdk_5205cb49-9d3c-4ef0-ba43-3331fea2175d/kube-rbac-proxy-self/0.log"
Jul 29 09:44:47.216853 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.216825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xfvdk_5205cb49-9d3c-4ef0-ba43-3331fea2175d/openshift-state-metrics/0.log"
Jul 29 09:44:47.465267 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.465191    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6948fc4d76-jsx9p_6ec93548-a381-4c12-ae5c-a5e6657dc499/telemeter-client/0.log"
Jul 29 09:44:47.491116 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.491085    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6948fc4d76-jsx9p_6ec93548-a381-4c12-ae5c-a5e6657dc499/reload/0.log"
Jul 29 09:44:47.511680 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.511647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6948fc4d76-jsx9p_6ec93548-a381-4c12-ae5c-a5e6657dc499/kube-rbac-proxy/0.log"
Jul 29 09:44:47.542745 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.542714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/thanos-query/0.log"
Jul 29 09:44:47.564757 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.564731    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/kube-rbac-proxy-web/0.log"
Jul 29 09:44:47.590668 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.590639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/kube-rbac-proxy/0.log"
Jul 29 09:44:47.624031 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.624003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/prom-label-proxy/0.log"
Jul 29 09:44:47.645011 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.644977    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/kube-rbac-proxy-rules/0.log"
Jul 29 09:44:47.667041 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:47.666996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf85d6fc-mj4jj_6e674a05-4820-45f2-822d-74dbc96f8d3e/kube-rbac-proxy-metrics/0.log"
Jul 29 09:44:49.000980 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.000940    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"]
Jul 29 09:44:49.010258 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.010227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.015273 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.015241    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"]
Jul 29 09:44:49.128671 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.128634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-sys\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.128864 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.128704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rd87\" (UniqueName: \"kubernetes.io/projected/c96b4038-e4be-45bb-be9a-36223f2f107b-kube-api-access-9rd87\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.128962 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.128850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-lib-modules\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.128962 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.128925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-podres\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.129074 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.129042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-proc\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230302 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-lib-modules\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230575 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-lib-modules\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230655 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-podres\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230712 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-proc\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230829 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-sys\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.230829 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.230776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rd87\" (UniqueName: \"kubernetes.io/projected/c96b4038-e4be-45bb-be9a-36223f2f107b-kube-api-access-9rd87\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.231090 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.231051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-sys\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.231248 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.231233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-proc\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.231448 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.231431    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c96b4038-e4be-45bb-be9a-36223f2f107b-podres\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.240199 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.240163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rd87\" (UniqueName: \"kubernetes.io/projected/c96b4038-e4be-45bb-be9a-36223f2f107b-kube-api-access-9rd87\") pod \"perf-node-gather-daemonset-jwmkh\" (UID: \"c96b4038-e4be-45bb-be9a-36223f2f107b\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.326981 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.326868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:49.526059 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.525305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"]
Jul 29 09:44:49.530329 ip-10-0-133-190 kubenswrapper[2573]: W0729 09:44:49.530290    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc96b4038_e4be_45bb_be9a_36223f2f107b.slice/crio-de900d7a65b570021b1a2d170d53081c391af4b97ea589d575204236e1d81184 WatchSource:0}: Error finding container de900d7a65b570021b1a2d170d53081c391af4b97ea589d575204236e1d81184: Status 404 returned error can't find the container with id de900d7a65b570021b1a2d170d53081c391af4b97ea589d575204236e1d81184
Jul 29 09:44:49.638917 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.635448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/1.log"
Jul 29 09:44:49.639748 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:49.639724    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-wdbhh_b5a9ee01-32e8-4005-8e26-205b1afcdde0/console-operator/2.log"
Jul 29 09:44:50.139674 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.139639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65db55cc87-b7thh_3d4af3b4-68d4-444f-8a0a-c34935696b23/console/0.log"
Jul 29 09:44:50.519518 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.519417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh" event={"ID":"c96b4038-e4be-45bb-be9a-36223f2f107b","Type":"ContainerStarted","Data":"c267384d485a01b21618296d7aa3fd259fd9aff6ed260de81e91344b82c58ce3"}
Jul 29 09:44:50.519695 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.519661    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:50.519757 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.519705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh" event={"ID":"c96b4038-e4be-45bb-be9a-36223f2f107b","Type":"ContainerStarted","Data":"de900d7a65b570021b1a2d170d53081c391af4b97ea589d575204236e1d81184"}
Jul 29 09:44:50.538116 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.538050    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh" podStartSLOduration=2.53802957 podStartE2EDuration="2.53802957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 09:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:44:50.53522346 +0000 UTC m=+3428.507366334" watchObservedRunningTime="2026-07-29 09:44:50.53802957 +0000 UTC m=+3428.510172446"
Jul 29 09:44:50.784232 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:50.784130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-w7c9q_38b05c3d-d2a4-4361-90e1-37d0ccbfbfe0/volume-data-source-validator/0.log"
Jul 29 09:44:51.990046 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:51.990015    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sg6gw_4e13d41b-8be4-437a-9629-443e1e5cf2eb/dns/0.log"
Jul 29 09:44:52.011577 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:52.011547    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sg6gw_4e13d41b-8be4-437a-9629-443e1e5cf2eb/kube-rbac-proxy/0.log"
Jul 29 09:44:52.039325 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:52.039294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7fnsg_203d6908-3214-4cf2-b7b6-f12b5ba5a862/dns-node-resolver/0.log"
Jul 29 09:44:52.654501 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:52.654470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74db7d5bf-7zwv5_01e24675-ede7-48ab-a510-dce1d5414e96/registry/0.log"
Jul 29 09:44:52.680969 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:52.680939    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f49z_7c3a2f91-b105-4652-9681-fe85f4b7f7d7/node-ca/0.log"
Jul 29 09:44:53.962684 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:53.962653    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d544f58d6-7sgdg_92ff798b-d1cc-4b66-b0bc-17a925537801/kube-auth-proxy/0.log"
Jul 29 09:44:54.014624 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:54.014589    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/0.log"
Jul 29 09:44:54.075119 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:54.075086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/1.log"
Jul 29 09:44:54.119473 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:54.119428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6bpz9_1dc48f10-8634-452b-b3c5-b05ddd3d5cbb/payload-pre-processing/0.log"
Jul 29 09:44:54.162739 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:54.162705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:44:54.191124 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:54.191092    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68555bcf85-tdf9s_a4982339-3ff4-407a-80ae-922cfa8cdcbd/router/0.log"
Jul 29 09:44:55.073409 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.073374    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcdl7_44283aff-2b70-482c-ab25-f91bd9e7713c/serve-healthcheck-canary/0.log"
Jul 29 09:44:55.474651 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.474619    2573 scope.go:117] "RemoveContainer" containerID="f3018b25657c57e9300b07ea339a0f413c705a0d4b93e8f23327b786e813ad43"
Jul 29 09:44:55.572927 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.572871    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-zqcq6_d3553627-ff60-4db8-8abf-a093140c17e7/insights-operator/0.log"
Jul 29 09:44:55.574820 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.574787    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-zqcq6_d3553627-ff60-4db8-8abf-a093140c17e7/insights-operator/1.log"
Jul 29 09:44:55.662420 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.662388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j6zx6_e8f4f881-b42e-4d37-ad44-1707cc060151/kube-rbac-proxy/0.log"
Jul 29 09:44:55.683660 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.683629    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j6zx6_e8f4f881-b42e-4d37-ad44-1707cc060151/exporter/0.log"
Jul 29 09:44:55.707266 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:55.707242    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j6zx6_e8f4f881-b42e-4d37-ad44-1707cc060151/extractor/0.log"
Jul 29 09:44:56.539205 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:56.539177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-jwmkh"
Jul 29 09:44:58.032058 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:58.032022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r9fsr_b47d770a-97bc-40e5-b878-bc2fcb787077/manager/0.log"
Jul 29 09:44:58.503876 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:58.503803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s8t5r_43eb1f99-cf03-4f6b-8bdd-9dd771a302f4/manager/0.log"
Jul 29 09:44:58.764442 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:58.764286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-95cc89ddf-7hzfk_ff3d63b7-84bd-4a02-afe7-e4ca63120277/manager/0.log"
Jul 29 09:44:58.785372 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:58.785338    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hjgz9_3d1abe86-75a7-4024-a6ab-db5c3f5b6fe7/server/0.log"
Jul 29 09:44:58.917023 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:58.916990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4qdqs_02fc77ac-50ff-4ab4-9b01-501c1770d014/manager/0.log"
Jul 29 09:44:59.070314 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:59.070052    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-758ck_7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c/manager/0.log"
Jul 29 09:44:59.087768 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:59.087452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-758ck_7a8581a4-ccd3-4939-8fd1-69e72cfa7d9c/copy-manifests/0.log"
Jul 29 09:44:59.937145 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:59.937113    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d544f58d6-7sgdg_92ff798b-d1cc-4b66-b0bc-17a925537801/kube-auth-proxy/0.log"
Jul 29 09:44:59.978528 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:44:59.978485    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/0.log"
Jul 29 09:45:00.030533 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:00.030501    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/1.log"
Jul 29 09:45:00.064002 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:00.063681    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6bpz9_1dc48f10-8634-452b-b3c5-b05ddd3d5cbb/payload-pre-processing/0.log"
Jul 29 09:45:00.100930 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:00.100884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:45:00.116372 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:00.116343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68555bcf85-tdf9s_a4982339-3ff4-407a-80ae-922cfa8cdcbd/router/0.log"
Jul 29 09:45:00.484528 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:00.484496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zs26x_24542b07-ca74-41bc-a364-bf9801a2cfc0/openshift-lws-operator/0.log"
Jul 29 09:45:01.873783 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:01.873740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d544f58d6-7sgdg_92ff798b-d1cc-4b66-b0bc-17a925537801/kube-auth-proxy/0.log"
Jul 29 09:45:01.910912 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:01.910858    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/0.log"
Jul 29 09:45:01.971863 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:01.971817    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lqjvs_45bd778b-da1b-451a-8d60-f66d883aadcf/istio-proxy/1.log"
Jul 29 09:45:02.005337 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:02.005299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6bpz9_1dc48f10-8634-452b-b3c5-b05ddd3d5cbb/payload-pre-processing/0.log"
Jul 29 09:45:02.040532 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:02.040493    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-g5bbx_2695ccb5-8e36-4468-ae15-d2a0c96427a8/payload-processing/0.log"
Jul 29 09:45:02.064946 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:02.064884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68555bcf85-tdf9s_a4982339-3ff4-407a-80ae-922cfa8cdcbd/router/0.log"
Jul 29 09:45:04.278045 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:04.278002    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"]
Jul 29 09:45:04.280551 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:04.280532    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755260-8jz9r"]
Jul 29 09:45:04.647123 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:04.647082    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a067c614-886c-43de-8204-df96f9407736" path="/var/lib/kubelet/pods/a067c614-886c-43de-8204-df96f9407736/volumes"
Jul 29 09:45:05.528884 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:05.528851    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-t2chp_9e29c609-61bf-42f5-b49f-eaddd8d7c7a5/migrator/0.log"
Jul 29 09:45:05.547523 ip-10-0-133-190 kubenswrapper[2573]: I0729 09:45:05.547489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-t2chp_9e29c609-61bf-42f5-b49f-eaddd8d7c7a5/graceful-termination/0.log"